Serve a quantized or unquantized LLM checkpoint as an OpenAI-compatible API endpoint using vLLM, SGLang, or TRT-LLM. Use when user says "deploy model", "serve model", "start vLLM server", "launch SGLang", "TRT-LLM deploy", "AutoDeploy", "benchmark throughput", "serve checkpoint", or needs an infe...
Agent skill for ML / AI Engineer, Data Scientist, Backend Developer, published by zxmengde. Project details and file access are provided by the publisher.
Agent skill for ML / AI Engineer, Data Scientist, Backend Developer, published by ComeOnOliver. Project details and file access are provided by the publisher.
Agent skill for ML / AI Engineer, Data Engineer, Product Manager, published by diegosouzapw. Project details and file access are provided by the publisher.