Sealbook / Open source / AI agents & LLM apps

huggingface/lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

evaluationevaluation-frameworkevaluation-metricshuggingface

GitHub ↗Website ↗

License & maintenance

MIT is a permissive license: free to use commercially with attribution.

Last code push 14 days ago.

Similar projects

	Repository	Stars	Language	License	Activity
1	promptfoo/promptfooTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepS	★ 26.1k	TypeScript	MIT	Active
2	langfuse/langfuse🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.	★ 36k	TypeScript	Other	Active
3	Tencent/WeKnoraOpen-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.	★ 34.6k	Go	Other	Active
4	mlflow/mlflowThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and	★ 28.4k	Python	Apache-2.0	Active
5	comet-ml/opikDebug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, an	★ 22.7k	Python	Apache-2.0	Active
6	huggingface/datasets🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools	★ 22.1k	Python	Apache-2.0	Active
7	morluto/reaReverse engineer anything with agents, from app behavior down to native binaries.	★ 319.5k	TypeScript	MIT	Active
8	mattpocock/skillsSkills for Real Engineers. Straight from my .agents directory.	★ 296k	Shell	MIT	Active