Quantization
Representing model values with fewer bits to reduce memory use or computation. Effects on speed and output quality depend on the method, hardware, and model.
For example
A quantized model may fit in a GPU that cannot hold the full-precision version. Its quality and speed still need checking.
By Dave AI Editorial · Compute & hosting