Speculative decoding
An inference technique that proposes output tokens with a faster draft process and checks them with the target model. It can reduce generation time when the setup is suitable.
By Dave AI Editorial · Compute & hosting
705,632 AI resources indexedWorking toward the world’s largest AI resource index.
An inference technique that proposes output tokens with a faster draft process and checks them with the target model. It can reduce generation time when the setup is suitable.
By Dave AI Editorial · Compute & hosting