huggingface-local-models
A Hugging Face skill for running models on your own machine with llama.cpp.
What the skill teaches
A Hugging Face skill for running models on your own machine with llama.cpp. The agent searches the Hub for repositories that ship GGUF files, opens a model's llama.cpp local-app page for the suggested command and quantisation, confirms exact file names through the Hub API, and starts the model with llama-cli or llama-server, which can serve an OpenAI-compatible endpoint. It covers CPU, Apple Metal, CUDA and ROCm setups, choosing a quantisation for the available memory, and converting Transformers weights to GGUF when no GGUF exists. Gated models need a Hugging Face login.
Capabilities
- Find GGUF model repositories on the Hub
- Choose a quantisation for the available hardware
- Launch models with llama-cli or llama-server
- Convert Transformers weights to GGUF
About
- Publisher
- Hugging Face
- Tool
- Hugging Face
Install
What's inside
- references/hardware.md
- references/hub-discovery.md
- references/quantization.md
MCP servers and skills can run code on your computer and act on your data. Review the source before installing.
Details
| Fact | Value | Source |
|---|---|---|
| Type | Skill | |
| Tool | Hugging Face | |
| Publisher | Hugging Face | source |
| Official status | OfficialHugging Face Hub docs link to the huggingface/skills repository | source |
| Needs an API key or sign-in | Not stated in its documentation | |
| Includes scripts | No | source |
| Platforms | Not stated in its documentation | |
| AI clients | Not stated in its documentation | |
| Licence | Apache-2.0 | source |
| Pricing | Not stated in its documentation | |
| Activity | Last commit Nov 11, 202611,334 GitHub starsDownload data not available (not on npm or PyPI) | source |
| Links | Repository Website |
Copies of this skill in other repositories (2)
These differ from this skill's text. They may be adapted copies or older versions.
- huggingface-local-modelspracticalswan/agent-skills
- huggingface-local-modelsbg-szy/top-skills
More from Hugging Face
1 server · 26 skills
- hf-mcp (Skill)
- hf-cli (Skill)
- hf-mem (Skill)
- huggingface-best (Skill)
- huggingface-community-evals (Skill)
- huggingface-datasets (Skill)
Sources
- Skill file (SKILL.md)github.com/huggingface/skillsNov 10, 2026
- Web pagehuggingface.co · Backs: Official statusNov 12, 2026
- Licence file (LICENSE)github.com/huggingface/skills · Backs: LicenceNov 12, 2026
- GitHub repositorygithub.com/huggingface/skills · Backs: Publisher, Activity, LicenceNov 11, 2026
- Folder in the repository (huggingface-local-models)github.com/huggingface/skills · Backs: Includes scriptsNov 10, 2026