local-llm-expert
Master local LLM inference, model selection, VRAM optimization, and local deployment using Ollama, llama.cpp, vLLM, and LM Studio. Expert in quantization formats (GGUF, EXL2) and local AI privacy.
4,628,306 AI resources indexedWorking toward the world’s largest AI resource index.
Reusable instructions for compatible AI agents.
Field counts come from the latest full-catalog snapshot. A resource can belong to several fields and platforms.
Master local LLM inference, model selection, VRAM optimization, and local deployment using Ollama, llama.cpp, vLLM, and LM Studio. Expert in quantization formats (GGUF, EXL2) and local AI privacy.
GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.
Install and verify a local llama.cpp server for optional Deus local-generation experiments. Keeps Ollama as the required default for embeddings and judge work.
GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.
Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.
Agent skill for ML / AI Engineer, Backend Developer, Data Scientist, published by majiayu000. Project details and file access are provided by the publisher.
Agent skill for ML / AI Engineer, Backend Developer, Data Scientist, published by majiayu000. Project details and file access are provided by the publisher.
Agent skill for ML / AI Engineer, Backend Developer, Data Scientist, published by NovaAI-innovation. Project details and file access are provided by the publisher.
Agent skill for ML / AI Engineer, Data Scientist, Backend Developer, published by alexxsssun-byte. Project details and file access are provided by the publisher.
Agent skill for ML / AI Engineer, Data Engineer, Backend Developer, published by zxmengde. Project details and file access are provided by the publisher.
Agent skill for ML / AI Engineer, Data Engineer, Backend Developer, published by zxmengde. Project details and file access are provided by the publisher.
Agent skill for ML / AI Engineer, Backend Developer, Product Manager, published by majiayu000. Project details and file access are provided by the publisher.
Try a broader search or clear some filters.
Platform labels describe intended use. Read each resource's author credits, requirements and available access methods.