gguf-quantization
from Orchestra-Research/AI-research-SKILLs
GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU re
v1.0.0MIT
428
Lines
1,351
Words
20
Code Blocks
Languages
bashpython
10-optimization/gguf/SKILL.md