Skip to content

mamba-architecture

from Orchestra-Research/AI-research-SKILLs

State-space model with O(n) complexity vs Transformers' O(n²). 5× faster inference, million-token sequences, no KV cache. Selective SSM with hardware-aware design. Mamba-1 (d_state=16) and Mamba-2 (d_

v1.0.0MIT
261
Lines
806
Words
11
Code Blocks

Languages

bashpython
01-model-architecture/mamba/SKILL.md