MInference
Million-Tokens Prompt Inference for Long-context LLMs
ツール
読み込み中…
MInference: Accelerating Pre-filling for Long-context LLMs via Dynamic Sparse Attention
5月 2024
MInference 1.0 leverages the dynamic spa…
Million-Tokens Prompt Inference for Long-context LLMs
5月 2024
MInference 1.0 leverages the dynamic spa…