langwatch/langwatch

Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.

agent-testingaianalyticsdatasetsdspyevaluationgptllmllm-opsllmops

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 2 days ago.

	Repository	Stars	Language	License	Activity
1	langfuse/langfuse🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.	★ 36k	TypeScript	Other	Active
2	Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w	★ 187.6k	Python	Other	Active
3	mlflow/mlflowThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and	★ 28.4k	Python	Apache-2.0	Active
4	promptfoo/promptfooTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepS	★ 26.1k	TypeScript	MIT	Active
5	Skyvern-AI/skyvernAutomate browser based workflows with AI	★ 23.2k	Python	AGPL-3.0	Active
6	comet-ml/opikDebug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, an	★ 22.7k	Python	Apache-2.0	Active
7	huggingface/datasets🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools	★ 22.1k	Python	Apache-2.0	Active
8	firecrawl/firecrawlSupercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥	★ 192.7k	TypeScript	AGPL-3.0	Active