Throughput
The work a system completes in a period, such as requests per second or tokens per second. High throughput is different from a short wait for one request.
By Dave AI Editorial · Compute & hosting
705,632 AI resources indexedWorking toward the world’s largest AI resource index.
The work a system completes in a period, such as requests per second or tokens per second. High throughput is different from a short wait for one request.
By Dave AI Editorial · Compute & hosting