Skip to content
Kitbay
Skill

hugging-face-evaluation

MITUpdated on Nov 10, 202649,466GitHub stars

A skill in sickn33's agentic-awesome-skills collection for putting evaluation results into Hugging Face model cards using the model-index metadata format.

What the skill teaches

A skill in sickn33's agentic-awesome-skills collection for putting evaluation results into Hugging Face model cards using the model-index metadata format. It covers three routes: extracting evaluation tables already in a README, importing benchmark scores from the Artificial Analysis API, and running custom evaluations with vLLM or accelerate through lighteval or inspect-ai. The SKILL.md is short and sends the agent to a detailed guide in its references folder, and it adds strict rules on recording evaluation provenance, avoiding duplicate pull requests, and publishing only to repositories the user has authorised. The collection marks it as community-sourced.

Capabilities

  • Extract evaluation tables from model README files
  • Import benchmark scores from Artificial Analysis
  • Run custom evaluations with lighteval or inspect-ai
  • Write model-index evaluation metadata to model cards