Sealbook / Open source / AI agents & LLM apps

comet-ml/opik

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

evaluationhacktoberfesthacktoberfest2025langchainllama-indexllmllm-evaluationllm-observabilityllmopsopen-source

GitHub ↗Website ↗

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push today.

Similar projects

	Repository	Stars	Language	License	Activity
1	langfuse/langfuse🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.	★ 36k	TypeScript	Other	Active
2	mlflow/mlflowThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and	★ 28.4k	Python	Apache-2.0	Active
3	promptfoo/promptfooTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepS	★ 26.1k	TypeScript	MIT	Active
4	BerriAI/litellmThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, l	★ 61.5k	Python	Other	Active
5	huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f	★ 167.8k	Python	Apache-2.0	Active
6	unclecode/crawl4aiOpen-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Clo	★ 85.8k	Python	Apache-2.0	Active
7	rtk-ai/rtkCLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies	★ 83.9k	Rust	Apache-2.0	Active
8	janhq/janJan is an open source alternative to ChatGPT that runs 100% offline on your computer.	★ 45k	Rust	Other	Active