Skip to content

llm_prefix_suffix_attention

llm_prefix_suffix_attention

Attention helpers for LLM decoders with prefix and action suffix tokens.

LLMPrefixSuffixAttentionMixin

Build attention masks for single-stream LLM prefix/suffix sequences.