Helicone/helicone

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

agent-monitoringanalyticsevaluationgptlangchainlarge-language-modelsllama-indexllmllm-costllm-evaluation

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 9 days ago.

	Repository	Stars	Language	License	Activity
1	langfuse/langfuse🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.	★ 36k	TypeScript	Other	Active
2	comet-ml/opikDebug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, an	★ 22.7k	Python	Apache-2.0	Active
3	HKUDS/LightRAG[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation	★ 40.2k	Python	MIT	Active
4	mlflow/mlflowThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and	★ 28.4k	Python	Apache-2.0	Active
5	promptfoo/promptfooTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepS	★ 26.1k	TypeScript	MIT	Active
6	Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w	★ 187.6k	Python	Other	Active
7	OpenHands/OpenHands🙌 OpenHands: AI-Driven Development	★ 91.2k	TypeScript	MIT	Active
8	hiyouga/LlamaFactoryUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)	★ 75.6k	Python	Apache-2.0	Active