Quantization
Last updated
Answer in brief
Storing a model's weights at lower precision, for example 4-bit instead of 16-bit, so it needs about a quarter of the memory. Quality drops a little; 4-bit is the common choice for local use.
Olares One → Private AI for law firms → Document Q&A · drafting · local models → Client data stays in the firm
Storing a model's weights at lower precision, for example 4-bit instead of 16-bit, so it needs about a quarter of the memory. Quality drops a little; 4-bit is the common choice for local use.
Sources for this entry
- Olares One specifications (Olares docs) (Company-published)
- Olares One FAQ (Olares docs) (Company-published)
Continue this reading path
How the related websites connect
Cite this entry
Best Private AI for Lawyers. “Quantization.” Content reviewed 13 November 2026.
https://bestprivateaiforlawyers.com/glossary/quantization/