Livt packages

Livt.ML

Version 1.6.1

Fixed-size quantized inference, tensor storage, attention, and transformer building blocks for Livt.

Published files (132)

src/transformer/IFixedTransformerTables.lvt

namespace Livt.ML.Transformer

/**
 * Read-only integer activation/position tables. Caller validates lengths and masks.
 */
interface IFixedTransformerTables
{
	/**
	 * Returns the activation approximation in the same raw fixed-point scale as value.
	 * Providers must remain stable throughout a kernel call.
	 */
	fn Gelu(value: int) int

	/**
	 * Returns the nonnegative approximation of exp(-delta) in the configured exponent scale;
	 * delta is a nonnegative raw score difference.
	 */
	fn Exponent(delta: int) int

	/**
	 * Maps signed key-minus-query token distance to a learned relative-bias row index. Kernels
	 * validate the returned index against the selected tensor.
	 */
	fn Bucket(relativePosition: int) int
}