Skip to content

optimizing-attention-flash

from Orchestra-Research/AI-research-SKILLs

Optimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Use when training/running transformers with long sequences (>512 tokens), encountering GPU memory iss

v1.0.0MIT
368
Lines
1,287
Words
25
Code Blocks

Languages

bashpython
10-optimization/flash-attention/SKILL.md