WebsiteHunt is broughtBrought to you by Redact Everything
Benchmarking Opus 5 on SlopCodeBench
Opus 5 wins—and still fails 76% of checkpoints.
HumanLayer tests Opus 5, Sonnet 5, and Opus 4.8 across 17 checkpoints from three SlopCodeBench challenges. The benchmark measures whether coding agents can evolve a codebase as requirements arrive incrementally. Opus 5 leads with a 24% strict pass rate, but no model completes any challenge defect-free, while verbosity, code volume, and complexity grow over time.
Comments
Loading comments...
Category
You might also like
HiAPI
One API for leading AI image, video, and text generation models. ✨ Premium
ProjectManagementTools
Optimize your Projects with ProjectManagementTools 🌱 Sponsored
Museum of Failure
A collection of failed products and services
BettorEdge
Fair Bets, Big Wins—The Future of Sports Betting
Synexa AI
Simple, fast, and stable. Deploy AI models with just one line of
Keycheck
Check keyboard shortcuts of 100+ apps
Cimphony
Smarter and Faster with Cimphony
Giles' Blog
It's still worth blogging in the age of AI
TA
The Anti-Amazon
Costco's model and the future of retail
Calm Whisper
Find your focus and unwind with the soothing sounds of nature
Introducing the GPT Store
Find useful and popular custom versions of ChatGPT
SO
State of Open Source AI
A map of open-source AI, open weights, and interoperability.
One Time Fax
Send faxes online for a flat fee of $5
AI Trendz
Stay Ahead with AI Insights, Tools, and Trends
IG
IL General Assembly HB5511 Status
Official ILGA bill status and legislation.
FP
Free Public APIs
A collection of Free Public APIs for Students and Developers.
CP
C3 Programming Language
An ergonomic, safe and familiar evolution of C.
Chat100.ai: Free ChatGPT 4o and Claude 3
Experience Fast AI Chat with GPT-4o and Claude 3.5 Free Online.
ResumUp: The Ultimate AI Resume Builder
Craft Perfect Resumes with AI Resume Builder, ATS Checker, and AT
OO
OpenClaw, OpenAI and the future
OpenClaw joins OpenAI to bring agents to all; staying open.
Claude Opus 4.7
Claude Opus 4.7: improved coding, vision, and safeguards.