# Huggingface Community Evals

> Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware.

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

- Page: https://ss33.ai/skills/waybarrios/huggingface-community-evals-38791558883
- Publisher: waybarrios
- Category: [Software Development](https://ss33.ai/skills/category/software-development-t44z8z) › [Testing & QA](https://ss33.ai/skills/category/software-development-t44z8z/testing-and-qa-g56s6z)
- Source: https://github.com/waybarrios/opencode-power-pack/blob/f6684a173af89ec6ed3ea0c6cee9e2742da149f9/skills/huggingface-community-evals/SKILL.md

## Skill

This skill's licence does not allow redistribution, so the store does not serve its text. Get it from the author: https://github.com/waybarrios/opencode-power-pack/blob/f6684a173af89ec6ed3ea0c6cee9e2742da149f9/skills/huggingface-community-evals/SKILL.md