SWE-bench
SWE-bench is the standard benchmark for evaluating large language models and autonomous coding agents on real-world software engineering tasks. Given a complete codebase and a natural-language issue (a bug report or feature request sourced from GitHub), an agent must generate a code patch that resolves the issue and passes the repository’s automated test suite. Introduced…