Giskard-AI/giskard-oss

🐢 Open-Source Evaluation & Testing library for LLM Agents

agent-evaluationai-red-teamai-securityai-testingfairness-aillmllm-evalllm-evaluationllm-securityllmops

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 2 days ago.

	Repository	Stars	Language	License	Activity
1	promptfoo/promptfooTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepS	★ 26.1k	TypeScript	MIT	Active
2	langfuse/langfuse🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.	★ 36k	TypeScript	Other	Active
3	comet-ml/opikDebug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, an	★ 22.7k	Python	Apache-2.0	Active
4	BerriAI/litellmThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, l	★ 61.5k	Python	Other	Active
5	mlflow/mlflowThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and	★ 28.4k	Python	Apache-2.0	Active
6	liguodongiot/llm-action本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）	★ 25.2k	HTML	Apache-2.0	Active
7	affaan-m/ECCThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Code	★ 283.1k	JavaScript	MIT	Active
8	firecrawl/firecrawlSupercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥	★ 192.7k	TypeScript	AGPL-3.0	Active