Pular para o conteúdo
Kitbay
SkillOficial

hf-mem

Apache-2.0Atualizado em 11 de nov. de 202611.334Estrelas no GitHub

A short Hugging Face skill for estimating how much memory a model on the Hub needs for inference before downloading it.

O que a skill ensina

A short Hugging Face skill for estimating how much memory a model on the Hub needs for inference before downloading it. The agent runs the hf-mem tool through uvx with a model id, and the tool reads the Safetensors or GGUF weight metadata over HTTP range requests, optionally adding an estimate for the KV cache, so no weights are fetched or loaded locally. It is meant for questions such as whether a model fits on a given GPU. It needs uv installed, and a Hugging Face token only for gated or private models.

O que faz

  • Estimate inference memory for a Hub model
  • Include KV cache in the estimate
  • Check whether a model fits a GPU without downloading it