Skip to content

rwkv-architecture

from Orchestra-Research/AI-research-SKILLs

RNN+Transformer hybrid with O(n) inference. Linear time, infinite context, no KV cache. Train like GPT (parallel), infer like RNN (sequential). Linux Foundation AI project. Production at Windows, Offi

v1.0.0MIT
261
Lines
898
Words
11
Code Blocks

Languages

bashpython
01-model-architecture/rwkv/SKILL.md