Tag: #gguf

A guide to model quantization, detailing the post-training compression techniques that enable large language models to run on consumer-grade hardware.