本文へスキップ
Kitbay
スキル

hugging-face-evaluation

MIT2026年11月17日 更新49,917GitHubスター

A skill in sickn33's agentic-awesome-skills collection for putting evaluation results into Hugging Face model cards using the model-index metadata format.

スキルの内容

A skill in sickn33's agentic-awesome-skills collection for putting evaluation results into Hugging Face model cards using the model-index metadata format. It covers three routes: extracting evaluation tables already in a README, importing benchmark scores from the Artificial Analysis API, and running custom evaluations with vLLM or accelerate through lighteval or inspect-ai. The SKILL.md is short and sends the agent to a detailed guide in its references folder, and it adds strict rules on recording evaluation provenance, avoiding duplicate pull requests, and publishing only to repositories the user has authorised. The collection marks it as community-sourced.

できること

  • Extract evaluation tables from model README files
  • Import benchmark scores from Artificial Analysis
  • Run custom evaluations with lighteval or inspect-ai
  • Write model-index evaluation metadata to model cards