AI Agents & Idiomatic Laravel: Beyond Passing Tests | Mohamed Said [ ![Mohamed Said](https://cdn.msaied.com/01KT78WE565VEMM3PSNQAAB0MH.png) Mohamed Said Laravel Backend Engineer ](https://www.msaied.com) [ Home ](https://www.msaied.com) [ Projects ](https://www.msaied.com/projects) [ Articles ](https://www.msaied.com/articles) [ Certificates ](https://www.msaied.com/certificates) [ Contact ](https://www.msaied.com#contact-section) [ ](https://github.com/EG-Mohamed) [ Home ](https://www.msaied.com) [ Projects ](https://www.msaied.com/projects) [ Articles ](https://www.msaied.com/articles) [ Certificates ](https://www.msaied.com/certificates) [ Contact ](https://www.msaied.com#contact-section) [ home ](https://www.msaied.com) [ articles ](https://www.msaied.com/articles) AI Coding Agents Pass Tests — But Can They Write Idiomatic Laravel? On this page 1. [ The Benchmark That Solved Itself ](#the-benchmark-that-solved-itself) 2. [ Why Saturated Benchmarks Are Good News ](#why-saturated-benchmarks-are-good-news) 3. [ The Gap Between "Works" and "Belongs" ](#the-gap-between-quotworksquot-and-quotbelongsquot) 4. [ The Two New Metrics That Matter ](#the-two-new-metrics-that-matter) 5. [ 1. Correct Code Per Token ](#1-correct-code-per-token) 6. [ 2. Idiomatic Laravel, Not Just Correct Laravel ](#2-idiomatic-laravel-not-just-correct-laravel) 7. [ What Comes Next for Boost ](#what-comes-next-for-boost) 8. [ Key Takeaways ](#key-takeaways) ![AI Coding Agents Pass Tests — But Can They Write Idiomatic Laravel?](https://cdn.msaied.com/464/fbf5334d95623235cf1f9a08c7118f1b.png) [ Laravel ](https://www.msaied.com/articles?category=laravel) [ AI ](https://www.msaied.com/articles?category=ai) #Laravel #AI Coding Agents #Laravel Boost #Benchmarks #Idiomatic Code AI Coding Agents Pass Tests — But Can They Write Idiomatic Laravel? ===================================================================== 24 Jul 2026 4 min read ![Mohamed Said](https://cdn.msaied.com/01KT78WE565VEMM3PSNQAAB0MJ.jpg) Mohamed Said Table of contents 1. [ 01 The Benchmark That Solved Itself ](#the-benchmark-that-solved-itself) 2. [ 02 Why Saturated Benchmarks Are Good News ](#why-saturated-benchmarks-are-good-news) 3. [ 03 The Gap Between "Works" and "Belongs" ](#the-gap-between-quotworksquot-and-quotbelongsquot) 4. [ 04 The Two New Metrics That Matter ](#the-two-new-metrics-that-matter) 5. [ 05 1. Correct Code Per Token ](#1-correct-code-per-token) 6. [ 06 2. Idiomatic Laravel, Not Just Correct Laravel ](#2-idiomatic-laravel-not-just-correct-laravel) 7. [ 07 What Comes Next for Boost ](#what-comes-next-for-boost) 8. [ 08 Key Takeaways ](#key-takeaways) The Benchmark That Solved Itself -------------------------------- When the Laravel team launched [Boost Benchmarks](https://laravel.com/blog/which-ai-model-is-best-for-laravel), the central question was straightforward: can an AI coding agent produce *correct* Laravel code? The answer, as of mid-2026, is a clear yes. With [Laravel Boost](https://laravel.com/ai/boost) supplying framework context, frontier models — GPT-5.6, Claude Fable 5, Gemini 3.x, and others — now clear all 17 evals at or near 100% test accuracy. That is a genuine milestone. It is also the moment a benchmark retires itself. Why Saturated Benchmarks Are Good News -------------------------------------- SWE-bench Verified, the headline coding benchmark for the broader AI field, has hit the same wall. Leading models cluster within a point or two of the human-expert baseline after sitting around 60% just a year ago. When every frontier model lands in the same narrow band, "did it pass?" stops being a useful signal. Boost's 17-eval suite did exactly what it was designed to do. The problem got solved. Now the bar moves. The Gap Between "Works" and "Belongs" ------------------------------------- Passing a Pest test suite was always a proxy for good code — a useful one, but still a proxy. Consider a controller that: - Runs a raw query instead of using Eloquent - Ignores `Route::resource()` - Hand-rolls validation instead of using a [Form Request](https://laravel.com/docs/13.x/validation) - Skips `$fillable` entirely Every test goes green. No experienced Artisan would merge it. The industry has already bumped into this ceiling. OpenAI stopped reporting SWE-bench Verified after auditors found flawed test cases. Cursor demonstrated that models were recovering "solutions" from `.git` history rather than reasoning through problems — scores dropped sharply once that history was hidden. Boost is less exposed to those issues (every run starts from a fresh Laravel app, and architecture tests run alongside behavioral ones), but the lesson still applies: a green suite proves the agent can satisfy the suite. It does not prove the agent writes Laravel the way an Artisan would. The Two New Metrics That Matter ------------------------------- ### 1. Correct Code Per Token Once every model reaches the right answer, the interesting question becomes *what it cost to get there*. The spread is enormous — one model can spend an order of magnitude more tokens than another on an identical task and arrive at nearly the same result. Boost already records tokens and cost per run. Those numbers are moving from footnotes to first-class metrics. Every guideline, every MCP tool call, and every indexed document now has to justify itself: did it reduce the tokens needed to produce correct code? ### 2. Idiomatic Laravel, Not Just Correct Laravel "Idiomatic" does not have to mean one developer's subjective taste. Boost's [best-practices skill](https://github.com/laravel/boost/blob/main/.ai/laravel/skill/laravel-best-practices/SKILL.md) defines 19 concrete conventions: - `Cache::remember()` instead of hand-rolled caching - Form requests instead of inline `validate()` calls - `with()` for eager loading to avoid N+1 queries - `Route::resource()` for standard CRUD routes - **Consistency First**: match sibling files already in the application before reaching for a different pattern Reference-free LLM-as-judge scoring is now reliable enough to evaluate these conventions without a golden diff to compare against, opening up a new class of signal that pure test suites cannot provide. What Comes Next for Boost ------------------------- The existing 17 evals stay in place as a regression suite. On top of that foundation, the team is exploring: - **Token and cost reported alongside pass rate** for every eval and every model - **Idiomatic scoring** layered on top of Pest and architecture checks, using the best-practices skill as the rubric - **Context tightening** inside Boost itself — dropping redundant guidelines and indexing only what an agent actually needs Key Takeaways ------------- - Frontier models now pass all 17 Boost evals at ~100%, effectively saturating the benchmark. - Passing tests is a necessary but insufficient signal; code can be correct without being idiomatic. - Token efficiency is the new primary cost metric — how little context does an agent need to produce correct code? - Idiomatic Laravel is measurable: 19 concrete conventions in the Boost best-practices skill provide a checkable rubric. - The 17 existing evals remain as a regression suite; new layers for cost and idiom scoring are in active experimentation. --- *Source: [AI coding agents pass tests. Can they write idiomatic Laravel?](https://laravel.com/blog/idiomatic-laravel-ai-coding-agents) — Laravel Blog, July 24, 2026.* Found this useful? [ ](https://twitter.com/intent/tweet?url=https%3A%2F%2Fwww.msaied.com%2Farticles%2Fai-coding-agents-pass-tests-but-can-they-write-idiomatic-laravel&text=AI+Coding+Agents+Pass+Tests+%E2%80%94+But+Can+They+Write+Idiomatic+Laravel%3F) [ ](https://www.linkedin.com/sharing/share-offsite/?url=https%3A%2F%2Fwww.msaied.com%2Farticles%2Fai-coding-agents-pass-tests-but-can-they-write-idiomatic-laravel) Frequently Asked Questions ---------------------------- 3 questions Q01 What does it mean for an AI agent to write 'idiomatic' Laravel? Idiomatic Laravel means following established framework conventions rather than just producing code that passes tests. Concrete examples include using Form Requests instead of inline validation, Cache::remember() instead of hand-rolled caching, Route::resource() for CRUD routes, and eager loading with with() to avoid N+1 queries. Boost's best-practices skill defines 19 such conventions that can be scored automatically. Q02 Why are token efficiency and cost now first-class metrics in Boost Benchmarks? Once frontier models all reach near-100% pass rates, pass rate alone no longer differentiates them. Token and cost data — already recorded by Boost — reveal that models can vary by an order of magnitude in how much context they consume to produce the same correct result. Treating efficiency as a headline metric incentivises leaner guidelines and tighter tool outputs, benefiting the whole ecosystem. Q03 Are the original 17 Boost evals being retired now that models score near 100%? No. The 17 evals remain in place as a regression suite to catch regressions in previously solved tasks. New layers for token/cost reporting and idiomatic scoring are being built on top of that foundation, not as a replacement. Continue reading More Articles --------------- [ View all ](https://www.msaied.com/articles) [ ![Livewire v3 Islands, Lazy Components, and Deferred Loading in Practice](https://cdn.msaied.com/463/d875efc7776601a5cf7fe5bfa88db7d3.png) livewire laravel performance ### Livewire v3 Islands, Lazy Components, and Deferred Loading in Practice Lazy components, islands, and deferred loading in Livewire v3 let you ship fast initial pages without sacrific... ![Mohamed Said](https://cdn.msaied.com/01KT78WE565VEMM3PSNQAAB0MJ.jpg) Mohamed Said 24 Jul 2026 1 min read Read ](https://www.msaied.com/articles/livewire-v3-islands-lazy-components-and-deferred-loading-in-practice-3) [ ![Livewire v3 Internals: Morph Markers, JS Hooks, and Alpine Integration](https://cdn.msaied.com/462/47708fe659f3051588ce61aa373c7461.png) livewire laravel alpine ### Livewire v3 Internals: Morph Markers, JS Hooks, and Alpine Integration Go beyond the docs: understand how Livewire v3 morphs the DOM, where Alpine.js state lives during re-renders,... ![Mohamed Said](https://cdn.msaied.com/01KT78WE565VEMM3PSNQAAB0MJ.jpg) Mohamed Said 24 Jul 2026 3 min read Read ](https://www.msaied.com/articles/livewire-v3-internals-morph-markers-js-hooks-and-alpine-integration-3) [ ![Laravel Founders Summit 2026: A One-Day Gathering for Laravel Business Leaders](https://cdn.msaied.com/461/12537bd0a10d8e3a3a6aea18a1e8a8d5.png) Laravel Founders Summit Laravel Events ### Laravel Founders Summit 2026: A One-Day Gathering for Laravel Business Leaders Laravel has opened applications for the Founders Summit, a one-day invite-only event in November 2026 for foun... ![Mohamed Said](https://cdn.msaied.com/01KT78WE565VEMM3PSNQAAB0MJ.jpg) Mohamed Said 23 Jul 2026 3 min read Read ](https://www.msaied.com/articles/laravel-founders-summit-2026-a-one-day-gathering-for-laravel-business-leaders) [ ![Mohamed Said](https://cdn.msaied.com/01KT78WE565VEMM3PSNQAAB0MH.png) Mohamed Said Laravel Backend Engineer ](https://www.msaied.com)Senior Backend Engineer specializing in Laravel, scalable SaaS platforms, APIs, and cloud infrastructure. I build secure, high-performance web applications that help businesses grow. Explore - [Home](https://www.msaied.com) - [Projects](https://www.msaied.com/projects) - [Articles](https://www.msaied.com/articles) - [Certificates](https://www.msaied.com/certificates) - [Contact](https://www.msaied.com#contact-section) Connect - [ hello@msaied.com ](mailto:hello@msaied.com) - [ +20 109 461 9204 ](tel:+201094619204) © 2026 Mohamed Said. All rights reserved. [ ](https://github.com/EG-Mohamed) [ ](https://www.linkedin.com/in/msaiedm/) [ ](https://wa.me/201094619204) [ ](mailto:hello@msaied.com) [ ](https://drive.google.com/file/u/0/d/1MF20IPRJyzfy32mhEutjL5EpSls0w2Q8/view)