Sealbook / Open source / AI agents & LLM apps

open-compass/opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

benchmarkevaluationlarge-language-modelllmllm-eval

GitHub ↗Website ↗

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 2 days ago.

Similar projects

	Repository	Stars	Language	License	Activity
1	promptfoo/promptfooTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepS	★ 26.1k	TypeScript	MIT	Active
2	langfuse/langfuse🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.	★ 36k	TypeScript	Other	Active
3	ScrapeGraphAI/Scrapegraph-aiPython scraper based on AI	★ 31.9k	Python	MIT	Active
4	comet-ml/opikDebug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, an	★ 22.7k	Python	Apache-2.0	Active
5	affaan-m/ECCThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Code	★ 283.1k	JavaScript	MIT	Active
6	firecrawl/firecrawlSupercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥	★ 192.7k	TypeScript	AGPL-3.0	Active
7	Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w	★ 187.6k	Python	Other	Active
8	ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.	★ 183.7k	Go	MIT	Active