Top-performing AI coding agent fails majority of real-world tasks on unfamiliar private codebases
Claude Fable 5.1 achieved the highest score on Real-SWE, a new benchmark testing AI agents against proprietary company code, yet still failed over 60% of the time. The results suggest significant gaps between public benchmark performance and real-world coding challenges.