Zum Inhalt springen
Kitbay
Skill

hugging-face-evaluation

MITAktualisiert am 10. Nov. 202649.466GitHub-Sterne

A skill in sickn33's agentic-awesome-skills collection for putting evaluation results into Hugging Face model cards using the model-index metadata format.

Was der Skill vermittelt

A skill in sickn33's agentic-awesome-skills collection for putting evaluation results into Hugging Face model cards using the model-index metadata format. It covers three routes: extracting evaluation tables already in a README, importing benchmark scores from the Artificial Analysis API, and running custom evaluations with vLLM or accelerate through lighteval or inspect-ai. The SKILL.md is short and sends the agent to a detailed guide in its references folder, and it adds strict rules on recording evaluation provenance, avoiding duplicate pull requests, and publishing only to repositories the user has authorised. The collection marks it as community-sourced.

Funktionen

  • Extract evaluation tables from model README files
  • Import benchmark scores from Artificial Analysis
  • Run custom evaluations with lighteval or inspect-ai
  • Write model-index evaluation metadata to model cards