You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Implementation of PagedAttention from vLLM paper - a breakthrough attention algorithm that treats KV cache like virtual memory. Eliminates memory fragmentation, increases batch sizes, and dramatically improves LLM serving throughput.
Research harness for evaluating query-time bounded elimination of reconstructable KV-cache witnesses in long-context transformer inference workloads. Related provisional filing: IN 202641062451.
Public empirical record of the Triadic Set, a runtime governance architecture for the transformer forward pass. In-band constraint and restoration for LLM inference, with oracle-verified evaluation programs, engineered fixtures, exit-verdict instrumentation, and checksummed telemetry from 1B through 8B scale.