Why we no longer evaluate SWE-bench Verified
SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.
Story
OpenAI · Artificial Intelligence
Join the conversation
Discuss the story with the TraceFeed community.
No comments yet. Be the first to add a perspective.