Latency
The delay between a request and a response. For streaming output, the wait for the first token and the wait for the complete answer are different measurements.
For example
An answer may start streaming after one second but take another fifteen seconds to finish. Those are different latency measurements.
By Dave AI Editorial · Compute & hosting