本文へスキップ
Kitbay
スキル公式

hf-mem

Apache-2.02026年11月11日 更新11,334GitHubスター

A short Hugging Face skill for estimating how much memory a model on the Hub needs for inference before downloading it.

スキルの内容

A short Hugging Face skill for estimating how much memory a model on the Hub needs for inference before downloading it. The agent runs the hf-mem tool through uvx with a model id, and the tool reads the Safetensors or GGUF weight metadata over HTTP range requests, optionally adding an estimate for the KV cache, so no weights are fetched or loaded locally. It is meant for questions such as whether a model fits on a given GPU. It needs uv installed, and a Hugging Face token only for gated or private models.

できること

  • Estimate inference memory for a Hub model
  • Include KV cache in the estimate
  • Check whether a model fits a GPU without downloading it