openai/SWELancer-Benchmark

This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?"

License & maintenance

No license stated: by default nobody may reuse the code. Ask the authors before using it in a product.

Last code push 15 months ago. Archived: read-only, no further updates.

	Repository	Stars	Language	License	Activity
1	morluto/reaReverse engineer anything with agents, from app behavior down to native binaries.	★ 319.5k	TypeScript	MIT	Active
2	mattpocock/skillsSkills for Real Engineers. Straight from my .agents directory.	★ 296k	Shell	MIT	Active
3	affaan-m/ECCThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Code	★ 283.1k	JavaScript	MIT	Active
4	NousResearch/hermes-agentThe agent that grows with you	★ 254.9k	Python	MIT	Active
5	deepseek-ai/deepseek-harnessDeepSeek Harness: Everything is a Plugin.	★ 253k	TypeScript	MIT	Active
6	multica-ai/andrej-karpathy-skillsA single CLAUDE.md file to improve Claude Code behavior, derived from Andrej Karpathy's observations on LLM coding pitfalls.	★ 220.9k	—	—	Slowing
7	anomalyco/opencodeThe open source coding agent.	★ 216.3k	TypeScript	MIT	Active
8	n8n-io/n8nFair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integ	★ 207.9k	TypeScript	Other	Active