The Field Data ReviewMagento and Adobe Commerce agencies, scored on the Core Web Vitals evidence they publish Updated 29 September 2026

Magento Core Web Vitals agencies, ranked on field data rather than lab scores

Core Web Vitals is a field measurement. Google assesses a page on the Chrome User Experience Report, which is real visitors on real devices at the 75th percentile, and a Lighthouse or PageSpeed score is a lab simulation that Google does not use for the assessment. On the weighting published on this page, scandiweb scores 75 of 100 and ranks first of nine, ParadoxLabs scores 64 and ZERO-1 scores 62. ParadoxLabs and ZERO-1 both beat scandiweb on the heaviest criterion, because both caption a named client's Core Web Vitals figures with the measurement source and the collection window and scandiweb states the source but never the window. scandiweb takes first place on two other lines: it publishes which mechanism moves which metric at configuration level, and it publishes Core Web Vitals figures template by template rather than for a whole website. This page scores what each agency DISCLOSES about its measurements, not the quality of the work it delivers.

1 The shortlist

Every agency on this page, in order

1
scandiweb A merchant who needs to know which metric is failing on which template, and what will be changed to fix it, before signing anything 75 of 100.
2
ParadoxLabs A buyer who wants the number, the dataset, the percentile and the month printed together, and a fixed price audit document before any engagement 64 of 100.
3
ZERO-1 A buyer who wants a real user panel for three named stores with the 28 day period printed on it, and an agency that labels its lab screenshots as lab 62 of 100.
4
JaJuMa A buyer who wants the measurement philosophy, the thresholds and the metric set stated correctly before the sales call, and a Core Web Vitals pass promised in the metrics Google assesses 59 of 100.
5
Hatimeria A buyer who wants all three current metrics with real before and after values for a named store, and a monthly report tying performance to conversion on low end devices 57 of 100.
6
elgentos A buyer who wants the slowest tenth of their visitors measured rather than the average one, and every deploy marked on the monitoring timeline 56 of 100.
7
Vendic A buyer who values a long list of named Hyva stores each with a real user score attached, and who will ask on the call which metric each score is made of 24 of 100.
8
MGT-Commerce A merchant whose Core Web Vitals problem is actually a cold cache response time, and who wants the caching stack explained with numbers before buying anything 16 of 100.
9
Aureate Labs A merchant who wants a cheap, fast lab score cleanup and understands that is a different purchase from a Core Web Vitals pass 10 of 100.

Nine Magento and Adobe Commerce agencies that publish something checkable about Core Web Vitals, scored out of 100 against six weighted criteria. Read one thing before the table: this page scores DISCLOSURE, not delivery quality. An agency that fixes a store brilliantly and publishes an uncaptioned screenshot scores badly here, and it deserves to, because a buyer comparing shortlists before a sales call has nothing else to work with. Every figure below was read from the agency's own website on 29 September 2026 and carries the URL it came from.

2 How these were judged

The six criteria, and what each one is worth

CriterionWhat a pass looks likeWhat a fail looks likeWeight
Field Core Web Vitals for a named client, with the source and the collection window statedThe heaviest criterion, because it is the only one that separates a measurement from a screenshot. 30 for a named client's Core Web Vitals figures published with the measurement source named, meaning the Chrome User Experience Report, the Search Console Core Web Vitals report, or a named real user monitoring product, AND the collection window or month stated. 25 for a named client and the source named with no window. 20 for a named client and a field derived vendor composite score with the tool named, rather than LCP, INP or CLS values. 15 for a named client and field shaped values with no source named. 10 for field figures with no client named. 5 for a lab score published for a named client and labelled as lab. 2 for a number with no client, no source and no label.Nothing where no Core Web Vitals figure of any kind was found on the pages read, including where the agency sells Core Web Vitals work and publishes only adjectives about it.30
The current metric set, published correctlyInteraction to Next Paint replaced First Input Delay as a Core Web Vital on 12 March 2024, and Chrome stopped guaranteeing FID in its tools on 9 September 2024. An agency still presenting FID as one of the three is reporting a metric Google removed. 18 where every Core Web Vitals metric named on the pages read is one of the current three, AND at least one page states in words that INP replaced FID. 14 where every metric named is one of the current three and the replacement is not stated. 10 where the service pages carry the current three and FID survives only inside an article dated before March 2024, never presented as one of the three. 6 where FID is presented as one of the three on at least one page while other pages carry the correct three and at least one page states the replacement. 3 where FID is presented as one of the three and no page was found stating the replacement.Nothing where no Core Web Vitals metric is named at all on the pages read, so a reader cannot tell what is being measured.18
Which metric, fixed by which mechanismThe three metrics have three different causes and three different fixes, and an agency that cannot say which is which is selling an outcome rather than a method. 18 for all three mapped to named mechanisms at configuration or file level, with the cache layer, module or setting named. 14 for all three mapped to mechanisms in general terms. 10 for two of three mapped to named mechanisms. 6 for one metric mapped to a mechanism. 3 for mechanisms listed with no metric named, or metrics named with no mechanism.Nothing where neither a metric nor a mechanism was found on the pages read.18
Evidence across more than one templateA Magento store does not fail uniformly. A category page fails on image weight and filter JavaScript, a product page on media and configurator logic, a checkout on payment scripts, and a homepage often passes while the templates that carry the revenue do not. 14 for three or more template types each carrying its own number. 11 for two template types with separate numbers. 8 for one template's number plus a published statement that the work covers the others. 5 for a single page's number with the template named. 2 for a site wide or origin level figure with no template named.Nothing where no template level figure was found on the pages read, including where the agency publishes a whole site percentage and never says which page types moved.14
The threshold Google actually uses, statedGoogle classifies a page on the 75th percentile of page loads, segmented across mobile and desktop, and publishes good as LCP at or under 2.5 seconds, INP at or under 200 milliseconds and CLS at or under 0.1. A figure with no percentile beside it cannot be checked against the rule. 12 for the 75th percentile named as the threshold, the three good values stated, and mobile and desktop separated. 9 for the 75th percentile or p75 named beside a published figure. 6 for a different percentile named and explained, so a reader knows what the number means but not Google's rule. 4 for the good values stated with no percentile. 2 for a pass claim or a figure published with no threshold and no percentile.Nothing where no threshold of any kind was found on the pages read.12
What the agency says it cannot fixThe smallest weight, because it tests honesty rather than capability, and it is where the top of this table separates from the middle. 8 for a named limit with the mechanism, AND a published result or statement that works against the agency's own sales case. 6 for a specific named limit with the mechanism. 4 for a general statement that a stack or a theme alone does not guarantee a pass. 2 for an exclusion listed with no mechanism.Nothing where no limit was found on the pages read, including where the agency publishes a Core Web Vitals guarantee and no condition on it.8

3 The ranking

The nine Magento Core Web Vitals agencies, scored out of 100

1

scandiweb

A merchant who needs to know which metric is failing on which template, and what will be changed to fix it, before signing anything75 of 100

scandiweb ranks first of nine on this weighting and it does not win the criterion the page is named after. Its performance optimization services page states the right standard more plainly than any other page read in this run: "every result is confirmed in Core Web Vitals field data, the numbers Google records from real shoppers", and, separately, "Lab data comes from a simulated test, like a Lighthouse or PageSpeed run. Field data is what your visitors record, collected by Chrome and reported against Core Web Vitals thresholds. A store can score well in the lab and still fail real users, which is why a Core Web Vitals optimization service is judged on field data, the standard scandiweb signs results off against." That is a statement about method. The score turns on what the method is applied to.

The strongest applied evidence is Zumiez, named on the support and maintenance portfolio with the site given as zumiez.com and the measurement source named: "Green Core Web Vitals on New Relic and CWV assessment passed on the category page, homepage, PLP, and PDP". New Relic is a real user monitoring product, so this is field derived, and the figures run template by template: category page LCP down 56.67 percent, INP down 78.25 percent, CLS down 76.47 percent; homepage down 38.46, 65.74 and 33.33 percent; PLP and PDP down 44.12, 58.06 and 28.57 percent each, with absolutes of 1.3 seconds LCP and 0.04 CLS and a note that average page rendering time fell 34 percent after the category page LCP work. No collection window is stated anywhere in that entry, which is the whole 5 point gap to the top of the first criterion and the reason ParadoxLabs and ZERO-1 both beat scandiweb on it.

Template coverage is where scandiweb takes full marks and nobody else gets close. Alongside Zumiez, the Granit Luma to Hyva rebuild publishes mobile total blocking time for four template types separately, CMS 760 to 70 milliseconds, PLP 760 to 120, PDP 420 to 70 and homepage 530 to 240, and then prints all three current metrics beside all three of Google's good thresholds: "LCP: 1.1 to 1.8s (good threshold: under 2.5s), CLS: 0 to 0.06 (good threshold: under 0.1), INP: 52 to 168ms (good threshold: under 200ms)". The Magento performance audit page commits to the same shape before the work starts: "The Core Web Vitals audit scores LCP, INP, and CLS on your homepage, category, product, and checkout templates, on mobile and desktop."

The metric to mechanism material is the best in the set and it is why the second heaviest pair of criteria falls this way. The Magento Core Web Vitals guide, dated 22 April 2026, maps each metric to a named lever: "lower LCP by serving WebP images, preloading the hero asset, and enabling Varnish for fast HTML delivery, reduce INP by trimming and bundling JavaScript or moving to Hyva, and eliminate CLS by setting explicit image and ad dimensions so nothing shifts as the page loads." It names the module, MagePack, for the bundling, puts the Varnish TTFB saving at roughly 0.3 to 0.8 seconds on Adobe's guidance, and prints the limit with it: "The honest limitation is that Varnish caches anonymous traffic. Logged in customers, cart pages, and checkout bypass it by design." The same guide states, in words, that Interaction to Next Paint is "the responsiveness metric that replaced first input delay".

Where it loses, and it loses this badly. Three scandiweb pages still present First Input Delay as a Core Web Vital, a metric Google retired on 12 March 2024 and removed from its tools on 9 September 2024. The Laderach Core Web Vitals case study, whose own structured data shows it was modified on 22 April 2025, names its three "main indicators" under "Core Web Vitals Assessment: Passed" as CLS, FID and LCP, carries a full FID threshold explainer, reports 3 milliseconds desktop and 20 mobile, and never mentions INP at all. The portfolio page prints "6 ms first input delay (FID)" for Zumiez and "350% First Input Delay (FID)" for Classic Football Shirts, and the performance optimization service page carries the same 350 percent figure beside a separate "45% Interaction to Next Paint gain", presenting the retired metric and its replacement side by side as though both were current. Five of the eight competitors here score higher on that line. Separately, the JYSK Hyva case study is titled after Core Web Vitals and reports total blocking time, First Contentful Paint, Speed Index and PageSpeed score, which are all lab metrics, with no INP and no CLS.

One open question rather than a verdict, because each page is internally true and no page reconciles them. Hyva theme development publishes "Guaranteed results for every client we work with" above a 98 PageSpeed figure, a separate "99 PageSpeed score guaranteed", and "We guarantee faster load times, better Core Web Vitals, and improved PageSpeed scores". Magento performance optimization headlines "Magento performance optimization to a 90+ PageSpeed score" and carries no Core Web Vitals metric anywhere. The performance services page lists, under who the work is not for, "You want a guaranteed PageSpeed number, which no honest audit promises before seeing your store." PageSpeed is a lab score and Core Web Vitals is a field assessment, so a buyer reading all three cannot tell which unit the deliverable is measured in. Ask for it in writing.

Credentials, for scale rather than for the score, since none of them is scored on this page. 23 years, founded 2003, 600+ certified specialists, a workforce across 36 countries serving clients in 45, 700+ clients, 2,100+ projects, 894+ Adobe certifications, NPS 95, $4B+ processed a year, Adobe Commerce Gold Solution Partner, Hyva Platinum Partner, and 600+ performance optimization projects stated on the performance services page, which also states ISO 27001 and 27017 certified practices. A Core Web Vitals engagement here runs through a global delivery team rather than a single timezone.

2

ParadoxLabs

A buyer who wants the number, the dataset, the percentile and the month printed together, and a fixed price audit document before any engagement64 of 100

ParadoxLabs takes the heaviest criterion outright and it is the only agency in this set that names the percentile Google actually uses. Its performance page, read 2026-09-29, states the provenance in one sentence under a heading reading "Measured, in public field data": "All these numbers are from Google's Chrome UX Report, public field data from real visitors, not lab tests." Three figures sit under it, each with its own caption: "52% to 88% Page loads with good LCP the month a Luma store went Hyva (CrUX, Jul to Aug 2023)"; "800ms cut from page load times in one quarter of audit driven fixes, same legacy themes, no replatform (CrUX, Dec 2023)"; and "4.1s to 1.4s mobile performance (LCP p75) at launch of a greenfield Mage-OS and Hyva build (CrUX, spring 2026)".

The proof page names the clients behind two of those. Half Time Beverage carries the 52 to 88 percent good LCP share and a full page load figure of 6.5 to 1.9 seconds. Denver Wholesale Foods carries "4.1s to 1.4s mobile p75 LCP" with "(CrUX field data, spring 2026)" beside it and a greenfield Mage-OS and Hyva build with a from scratch OData ERP connector live in five months. A third card, an Adobe Commerce to Mage-OS move over a weekend, reports "1.7s to 1.3s mobile p75 LCP" and "Core Web Vitals stayed green through the cutover (CrUX field data)" without naming the client.

It publishes its terms and a document you can take elsewhere. The performance page states "Fixed scope, fixed price ($899), delivered as a document your next agency could execute, even if that's not us", and offers a redacted sample audit as a PDF. The proof page publishes a section headed "How to verify any Magento agency, including us", a checklist it says takes an hour and "filters out most of the field", closing "Run it on us. Then run it on everyone else you're evaluating." It also labels its own third party figures as third party: on Composer installs, "Public API, third-party numbers, not ours." Its site states US Eastern weekday hours of 8am to 5pm and "0 outsourced, ever", and describes itself as building and maintaining open source Magento commerce for US businesses since 2002.

Where it falls short is coverage, not honesty. Only LCP is published as a value. No INP figure and no CLS figure were found on the pages read, and "green on every Core Web Vital since" is the qualitative substitute. Every figure is whole store or origin level, so a buyer cannot see which template moved. And the work is described by layer rather than by metric, "TTFB, database, indexing, full page cache discipline, frontend (usually Hyva)", with no page found connecting a mechanism to the metric it moves, which is the one line where it scores near the bottom of the table.

3

ZERO-1

A buyer who wants a real user panel for three named stores with the 28 day period printed on it, and an agency that labels its lab screenshots as lab62 of 100

ZERO-1 publishes the cleanest captions in the set and shares the top of the first criterion with ParadoxLabs. Three named clients each carry a Core Web Vitals panel that names the origin and the form factor, is marked Passed, and is footed with the dataset and the collection period: BigK Products at bigkproducts.co.uk mobile, LCP 1.1 seconds, INP 87 milliseconds, CLS 0, with FCP 0.7 seconds and TTFB 0.4 seconds, footed "Real-user data, Chrome UX Report, 28-day period, Jun 2026"; iBottles at ibottles.co.uk mobile, LCP 1.2 seconds, INP 138 milliseconds, CLS 0, same caption; Paddock Spares at paddockspares.com mobile, LCP 1.4 seconds, INP 118 milliseconds, same caption. All three read 2026-09-29.

What earns it the honesty criterion outright is the discipline on the other side. On a fourth case, 5 A Day Box, the same panel layout is headed "5adaybox.co.uk / desktop Lighthouse", reports total blocking time and Speed Index instead of INP, and is footed "Lighthouse 13.3.0, emulated desktop, single page session, Jun 2026". That is the only place in this entire set where an agency tells a reader which numbers came from a simulation and which came from real visitors, on the same template, in the same month. A fifth named client, Barr Display, is measured in Google's own report: "Within 48 hours the Core Web Vitals data reporting in Google Search Console was immediately lifting to provide a steady improvement in Good URLs from 19% to 85% in little over 2 weeks."

It also publishes the limit of the thing it sells, as its own article. "Is Hyva a guarantee for passing Core Web Vitals?", dated 24 January 2024 by Sean Watson, answers no and names the mechanisms: "Hyva can still be butchered. It's solely down to the implementation"; an agency that built on Hyva and "decided to include various JavaScript libraries, a completely new CSS library, and countless bad practices in the theme files. This resulted in a Hyva site that was performing poorly on Core Web Vitals"; third party scripts that "are just dumped onto a Hyva website"; and merchant added media, "a category page that loads by default in 1.5s. Then someone comes along and adds a new content block at the top of the category page. This content block includes a video and 30 images at 0.5MB each." A separate article, dated 11 February 2025, reports declining to bill a £50,000 Hyva budget for Epic Militaria because its own product delivered the build in three days out of existing retainer hours.

Where it loses is interpretation and granularity. Every panel is origin level, domain and form factor, so no template level figure was found on the pages read. And no threshold appears anywhere: the panels say Passed and the body says the store passes Google's assessment, but 2.5 seconds, 200 milliseconds, 0.1 and the 75th percentile are not printed, so a reader has to already know the rule to read the number. The metric to mechanism material is thin too, one mapping of image attributes to CLS in the Page Builder article, and no INP mechanism found. ZERO-1 Ltd is registered in England, company number 03837629, with a head office in Buxton.

4

JaJuMa

A buyer who wants the measurement philosophy, the thresholds and the metric set stated correctly before the sales call, and a Core Web Vitals pass promised in the metrics Google assesses59 of 100

JaJuMa is the only agency in this set that publishes the metric change with its date. Its LCP optimization guide states, in a parenthesis a reader can check: "(Note: INP replaced First Input Delay (FID) as a Core Web Vital in March 2024)", and prints all three thresholds correctly, "Google recommends an LCP of 2.5 seconds or less", "A good INP is considered 200 milliseconds or less", "A good CLS score is 0.1 or less". No page read carried FID as a Core Web Vital. That takes full marks on the second criterion and nobody else does.

Its Hyva performance page makes field measurement the first layer of the service rather than a proof format bolted on afterwards: "Layer 1: Beyond Lab Data: Real User Monitoring (RUM). We start where others stop: with your actual customers." And: "While many agencies chase a green PageSpeed score (outdated lab data), we focus on field data, the real world performance your visitors experience. We capture your visitors perceived performance and your site's health with our proprietary Real User Monitoring (RUM) tool, providing the only true path to passing Core Web Vitals." The RUM product is sold separately at EUR 349. The same page carries a guarantee, and it is the only one in this set expressed in the metrics Google actually assesses rather than in a lab score: "We guarantee your store will pass all Core Web Vitals (LCP, INP, CLS)."

It publishes a limit that works against the thing it sells. On the same page: "Hyva provides a lightning fast foundation, but nearly half of all Hyva sites still fail Google's Core Web Vitals", and "About half of all websites using Hyva still struggle to pass Google's Core Web Vitals assessment, which is based on this real user data." The mechanisms are named: admin added media without AVIF or WebP, compression or strategic lazy loading; render blocking third party scripts, handled "using advanced facade loading"; and legacy dependencies.

The applied evidence is one named client and it is captioned loosely. A showcase last updated 27 July 2025 names Rosemarie Schulz and reports, after 60 days of post launch monitoring, CLS from 0.3 to 0.0, LCP from 1.6 to 0.8 seconds, FCP from 1.3 to 0.7 and TTFB from 0.9 to 0.4. The diagnosis is metric specific and useful: "the Cumulative Layout Shift (CLS), which had never received specific attention or optimization, was causing the store to fail its Core Web Vitals test." But no measurement tool is named beside those numbers, the caption is "diligently monitoring the store's performance" and nothing more, and no INP figure appears in the result set. There is no template breakdown and no percentile anywhere.

5

Hatimeria

A buyer who wants all three current metrics with real before and after values for a named store, and a monthly report tying performance to conversion on low end devices57 of 100

Hatimeria publishes the most complete single set of before and after values in this ranking. Its DeeZee case study, read 2026-09-29, names the client and the source in a panel reading "Core Web Vitals passed, source: RUMvision", then reports, under "Our results after 6 months of cooperation": LCP improved 34 percent, from 2.42 seconds to 1.6; INP down 53 percent, from 423 milliseconds to 200; CLS improved up to 96 percent, from 0.46 down to 0.02 flat. RUMvision is a real user monitoring product, so those are field derived, the client is named, and all three current metrics carry absolutes on both sides. Its CEO repeats the INP figure in an attributed quote on the same page.

What holds it at the same rung as scandiweb rather than the top rung is the caption. Six months of cooperation is an engagement duration, not a collection period: a reader cannot tell what window either reading covers, and ZERO-1 and ParadoxLabs both state theirs. The same page also publishes competitor relative language, "the best score among competitors" on the UX score, LCP and INP and "second result among competitors" on CLS, without naming the tool that produced the comparison, so nothing was scored on it.

The metric to mechanism material is complete in general terms. Its Core Web Vitals article maps each metric to a lever under its own heading: LCP to image compression, WebP and lazy loading; INP to "Minimize JavaScript execution: Remove unused scripts and use async or defer attributes"; CLS to "Specify dimensions for images and media, reserve space for ads and embeds". The same article cites Vodafone at a 31 percent LCP improvement and redBus at an INP improvement, both correctly attributed to web.dev rather than presented as its own work. The delivery scope published on the DeeZee page is unusually specific for this set: user segmentation by device performance, A or B testing the performance cost of third party scripts, developer training to prioritise performance issues, and a monthly report carrying organic traffic, conversion on lower performance mobile devices, and the correlation between the two.

Where it scores nothing is the honesty criterion. No limit and no unsuccessful result was found on the pages read, and the work is presented without a condition: "Hatimeria takes full responsibility for the entire process, so you are guaranteed to achieve the desired results." Its Magento page goes further and attaches the guarantee to the platform: "By choosing Magento, we can guarantee that the site will comply with the Core Web Vitals Assessment." ZERO-1 publishes an article arguing the opposite case about Hyva, and a buyer should put both in front of whoever they hire. No percentile appears anywhere, and the DeeZee figures are site level with no template breakdown. Its head office is in Krakow, Poland, where it states the company started in 2011.

6

elgentos

A buyer who wants the slowest tenth of their visitors measured rather than the average one, and every deploy marked on the monitoring timeline56 of 100

elgentos publishes a named client, a named real user monitoring product, dated movement and, alone in this set apart from ParadoxLabs, an explicit argument about which percentile the number is read at. Its article of 16 June 2026 by Peter Jaap Blaakmeer names Haibu, running Magento 2 with a Hyva frontend, and reports that until the end of September 2025 the p90 user experience score and the FUX score, which measures the first page load specifically, hovered around 70; that around 30 September 2025 the line jumps into the low 80s; and that it then climbs steadily to around 90 and has stayed there. The tool is RUMvision. In its own words, translated: no coincidence and no measurement error, that is the moment a series of performance optimizations went live.

The percentile argument is worth reading even though it is not Google's. The article's case is that an average load time is a comforting liar, that p90 answers how fast the shop is for the slowest tenth of visitors, and that "a PageSpeed score or a green tick on your Core Web Vitals is often correct for the average visitor, while a whole group of people has a slow experience without you noticing". Google classifies on the 75th percentile, which is not mentioned, so a reader learns exactly what elgentos measured and not how it maps to a pass. That is still six of twelve points on a line where most of this table scores two.

The mechanism list is the most specific in the set after scandiweb's, and it maps two of the three metrics. The Varnish configuration was rewritten using its own elgentos/magento2-varnish-extended module including Xkey for smarter cache invalidation and targeted caching of media and static files, and the chain is published end to end: a higher cache hit rate, a lower Time To First Byte and therefore a faster Largest Contentful Paint, described as by far the main reason for the September jump. A redundant database query and more than 60 lines of dead code came off the checkout success page. The Prismic content integration was constrained because it loaded more products than needed. And: "Snappier cart. We accelerated the cart interactions so changes give immediate feedback. Better for the Interaction to Next Paint (INP) and for the feel." No CLS mechanism was found on the pages read.

It also publishes the measurement discipline behind the result. "Had we measured these optimizations with PageSpeed Insights, we would have had a nice lab figure and a pat on the back. But we would not have known whether the visitor on that slower device noticed anything." A companion article of 21 April 2026 adds deploy annotations, so every release appears as a vertical line on the monitoring timeline and a metric movement can be tied to a specific release rather than reconstructed afterwards. What is missing is the metrics themselves: the published figure is a vendor composite score out of 100, not an LCP, INP or CLS value, there is no template breakdown, and no threshold is printed.

7

Vendic

A buyer who values a long list of named Hyva stores each with a real user score attached, and who will ask on the call which metric each score is made of24 of 100

Vendic publishes more named clients with a field derived number than anyone else here and fewer metrics than anyone else here, and those two facts produce the score. Its Hyva page, read 2026-09-29, prints a results wall with the client named above each figure: Paco Verpakkingen at 96 out of 100 RUMvision UX score alongside 45+ custom modules; TopaShop at 99 out of 100 with 60 percent reduced technical debt on modules; and a further client at 93 out of 100 delivered in 12 weeks. RUMvision is a real user monitoring product and Vendic states on the same page that it is a RUMvision partner for performance and Core Web Vitals, so the scores are field derived and the tool is named.

What the page does not contain is a Core Web Vitals metric. No LCP, no INP and no CLS value appears anywhere on the pages read, individually or as a set: the number is always the vendor's composite user experience score. That is why the second and third criteria score nothing here. It is not a judgement about the work, it is what the published surface contains.

The headline claim is an aggregate with no arithmetic behind it. The same page states "30+ Hyva projects, 100% Core Web Vitals" and "100% of our Hyva projects achieve Core Web Vitals", with no per project figure for the other twenty something stores and no window, threshold or percentile anywhere. It also prints a 90+ PageSpeed score for one build without labelling it as a lab figure, which is the only place on the page where the lab and field distinction it depends on is blurred. Vendic describes itself as the first Hyva Platinum Partner. The right question on a Vendic call is short: for one named store, send the LCP, INP and CLS values at the 75th percentile, and say over what period.

8

MGT-Commerce

A merchant whose Core Web Vitals problem is actually a cold cache response time, and who wants the caching stack explained with numbers before buying anything16 of 100

MGT-Commerce owns a lot of the written territory around this keyword and publishes no Core Web Vitals figure for any named client, which is the whole of its score on the heaviest criterion. Its Magento Core Web Vitals article, marked updated on 27 March 2025, is a competent explainer: it names the current three correctly in the body, "Loading performance (Largest Contentful Paint, LCP), Interactivity (Interaction to Next Paint, INP), Visual stability (Cumulative Layout Shift, CLS)", carries a section headed "INP Replaces FID", and states the thresholds, LCP within 2.5 seconds and INP at "200 milliseconds or less".

The same page lists the retired metric as one of the three in the summary a reader sees first. Its Key Takeaways block reads "3 key metrics, including LCP, FID, and CLS, and how they impact performance", eleven months after Chrome stopped guaranteeing FID in its tools, on a page whose body states the replacement. Its best practice table repeats the error in the one place it matters most, filing "Remove unnecessary scripts and extensions, break down large JavaScript bundles into smaller chunks" under "improve interactivity metrics like FID" rather than INP.

Its measurement literacy is better than average and its backend numbers are real. The same article tabulates ten tools and separates their data types correctly: PageSpeed Insights "offers both lab (simulated) and field (real user) data", Search Console "provides real world Chrome user data for core web vitals", Lighthouse, WebPageTest, GTmetrix and Pingdom as lab, and Sematext Experience as "a real user monitoring tool that collects field data across devices and locations worldwide". Its caching material states that cached pages serve in under 200 milliseconds while uncached Magento pages with extensions can take 3 to 8 seconds, that Magento 2.4.8 requires Varnish 7.6 and adds Valkey 8 alongside Redis 7.2, and a Varnish hit ratio target above 90 percent. The company states it has run since 2011, is registered in Berlin, and hosts 5,000+ stores, and its CLS mechanism list is specific: explicit width and height attributes, reserved space for ads and banners, font-display swap, and not injecting content above existing content. What none of that produces is a store you can go and look at.

9

Aureate Labs

A merchant who wants a cheap, fast lab score cleanup and understands that is a different purchase from a Core Web Vitals pass10 of 100

Aureate Labs is in this ranking because it publishes a number for a named client and it is the clearest illustration on the page of the difference the ranking measures. Its Magento speed optimization service page, read 2026-09-29, carries a client testimonial attributed to Majd Al-Dmour, Digital Channels Supervisor at Umniah: "Our website lighthouse score has risen to 94 from 29 and also now our website loads in less than 2 sec." The figure is labelled as a Lighthouse score, so a reader knows exactly what it is, which is why it scores five rather than two. It is a lab score, and it is a testimonial rather than a measurement the agency reports, so it scores five rather than more.

The published outcome is in lab units and the page treats the two things as one. Its FAQ answers "What PageSpeed Insights scores will I get in the end?" with "you can expect your Google PageSpeed Insights score to reach the green zone. However, the final score depends on how many slow loading elements you remove. If we consider keeping the most important ones, our team can help you get a score of 60-70 on mobile devices and 90 on desktops." Another answer describes the work as boosting "performance of your Magento site and its Google PageSpeed Insights score (Core Web Vitals)", putting the lab score and the field assessment inside one parenthesis as if they were the same measurement. Google's own documentation is explicit that they are not.

It does publish terms, which most of this table does not: "It takes a minimum of one week to optimize your Magento store", with the caveat that it varies by size and complexity, and an affordable pricing claim with no figure. The mechanism list is real but unassigned, bundling image compression, browser cache management, HTML, CSS and JavaScript minification, advanced JavaScript bundling, lazy loading, critical CSS, CDN and AMP into one paragraph with no metric attached to any of it. No LCP, INP or CLS value appears anywhere on the pages read, no template breakdown, no percentile and no published limit. Aureate Labs states it was founded in 2012 with a team of more than 60 people.

4 Which one fits

Pick by situation, not by ranking

If this is youShortlistWhy
Your Search Console Core Web Vitals report is red on category and product URLs and green on the homepage, and you need to know which template to fix firstscandiweb, then HatimeriaThis is the one situation where the ranking and the recommendation agree. scandiweb is the only agency here that publishes Core Web Vitals movement template by template, four page types for Zumiez and four for Granit, and its audit page commits in advance to scoring LCP, INP and CLS on homepage, category, product and checkout on both form factors. Hatimeria is the alternative because it publishes all three metrics with before and after absolutes, and its DeeZee scope includes segmenting users by device performance, which is where template level failures usually hide.
Your board wants the result in the same units Google uses, at the percentile Google uses, and will not accept a screenshotParadoxLabs, then ZERO-1ParadoxLabs writes p75 beside its figures and states that every number on the page came from the Chrome UX Report rather than a lab test, and it sells a fixed price $899 audit delivered as a document another agency could execute. ZERO-1 prints the dataset and the 28 day collection period on every panel for three named stores. Neither publishes template level detail, so agree in the statement of work which page types get a before and after reading.
Your store is mostly logged in B2B traffic, or too small to appear in the Chrome UX Report at allJaJuMa, then elgentosCrUX only includes pages that are publicly discoverable and above an undisclosed popularity threshold, and it excludes Chrome on iOS, Android WebView and other Chromium browsers including Edge. A store behind a login or under the threshold has no CrUX row to improve. Both of these build the measurement on the store instead: JaJuMa runs its own real user monitoring as the first layer of the engagement, and elgentos runs RUMvision with every deploy annotated on the timeline. Ask either one to show you the instrumented dashboard, not a CrUX export.
An agency has just told you your Hyva build will pass Core Web Vitals because it is HyvaZERO-1, then JaJuMaBoth publish the opposite case in writing, which is the most useful thing either of them has published. ZERO-1's article answers the question in its title, no, and names the ways a Hyva theme gets slow: extra JavaScript and CSS libraries in the theme files, third party scripts dumped in, and merchant added media. JaJuMa states that nearly half of all Hyva sites still fail the assessment. Hatimeria publishes the contrary position, that choosing Magento means it can guarantee compliance. Put all three in front of whoever you hire.
You need the responsiveness metric fixed specifically, because taps and filter clicks feel dead on mobilescandiweb, then elgentosINP is the metric no lab tool can measure, so the only evidence that counts is field evidence plus a published mechanism. scandiweb maps INP to trimming and bundling JavaScript or moving off Luma, names MagePack as the module, and publishes INP movement on four Zumiez templates. elgentos maps it to a specific piece of work, accelerating cart interactions so changes give immediate feedback, and measures the result on real visitors. Ask for the INP reading before and after, at the 75th percentile, on the template where the clicks happen.
Somebody has quoted you a guaranteed PageSpeed numberJaJuMa, then ParadoxLabsA PageSpeed score is a lab simulation and Google does not use it for the Core Web Vitals assessment, so a guarantee denominated in it guarantees the wrong currency. JaJuMa is the only agency here whose guarantee is written in the metrics Google assesses, all of LCP, INP and CLS. ParadoxLabs guarantees nothing and instead publishes the dataset, the percentile and the month, which is the other defensible answer. scandiweb's own pages are worth reading on this: two of them publish a PageSpeed outcome and a third says no honest audit promises one.

5 Evidence

The captions behind the entries, printed as published

ClientWhat was doneResultSource
BigK ProductsField Core Web Vitals, dataset and collection period both stated, ZERO-1bigkproducts.co.uk mobile, Passed. LCP 1.1 s, INP 87 ms, CLS 0, FCP 0.7 s, TTFB 0.4 s. Caption: "Real-user data, Chrome UX Report, 28-day period, Jun 2026". Delivered in about four weeks from a WordPress and WooCommerce store the page says was failing the assessmentSource
Paddock SparesField Core Web Vitals, same caption, a second named store, ZERO-1paddockspares.com mobile, Passed. LCP 1.4 s, INP 118 ms. Caption: "Real-user data, Chrome UX Report, 28-day period, Jun 2026". The page states the retrofit touched neither the design, the catalogue nor the integrationsSource
5 A Day BoxLAB data labelled as lab, on the same panel layout, ZERO-1"5adaybox.co.uk / desktop Lighthouse". LCP 0.6 s, TBT 60 ms, CLS 0.016, FCP 0.3 s, Speed Index 1.0 s. Caption: "Lighthouse 13.3.0, emulated desktop, single page session, Jun 2026". The only place in this set where a reader is told which numbers came from a simulationSource
Barr DisplayGoogle's own Core Web Vitals report as the source, ZERO-1"Within 48 hours the Core Web Vitals data reporting in Google Search Console was immediately lifting to provide a steady improvement in Good URLs from 19% to 85% in little over 2 weeks", 16 February 2023Source
Denver Wholesale FoodsChrome UX Report with the percentile printed, ParadoxLabs"4.1s to 1.4s mobile p75 LCP" with "(CrUX field data, spring 2026)" beside it, on a greenfield Mage-OS and Hyva build with a from scratch OData ERP connector live in five monthsSource
Half Time BeverageGood LCP share before and after, dataset and two month window stated, ParadoxLabs"Good-LCP share jumped 52% to 88% the month it shipped (CrUX, Jul to Aug 2023)", alongside 6.5 s to 1.9 s full page load, on a frontend rebuild on the platform the merchant already ownedSource
ZumiezField Core Web Vitals template by template, tool named, no window, scandiweb"Green Core Web Vitals on New Relic and CWV assessment passed on the category page, homepage, PLP, and PDP". Category page LCP down 56.67%, INP down 78.25%, CLS down 76.47%. Homepage down 38.46%, 65.74%, 33.33%. PLP and PDP down 44.12%, 58.06%, 28.57% each. Absolutes 1.3 s LCP and 0.04 CLS. The same entry also prints 6 ms FID, a retired metricSource
GranitFour templates each with its own figure, and all three of Google's thresholds printed, scandiwebMobile total blocking time: CMS 760 to 70 ms, PLP 760 to 120 ms, PDP 420 to 70 ms, homepage 530 to 240 ms. Then "LCP: 1.1 to 1.8s (good threshold: under 2.5s), CLS: 0 to 0.06 (good threshold: under 0.1), INP: 52 to 168ms (good threshold: under 200ms)". The Lighthouse figures on the same page are named as Lighthouse; the Core Web Vitals block names no sourceSource
LaderachA retired metric published as one of the three, on a page modified after the retirement, scandiwebUnder "Core Web Vitals Assessment: Passed" the three "main indicators" are named as CLS, FID and LCP, with a full FID threshold explainer and 3 ms desktop and 20 ms mobile. LCP 1.8 s desktop and 1.9 s mobile on the homepage. INP does not appear. Structured data on the page gives datePublished 6 March 2023 and dateModified 22 April 2025Source
JYSKA case titled after Core Web Vitals, reported entirely in lab metrics, scandiweb"Our main goal, Core Web Vitals: Passed!" followed by 2900% decrease in total blocking time, 20% increase in First Contentful Paint, 16.7% increase in Largest Contentful Paint, 275% boost in Speed Index, 76.6% increase in PageSpeed score, 20.1% improvement in checkout conversion rate. Total blocking time, First Contentful Paint, Speed Index and PageSpeed score are lab metricsSource
DeeZeeAll three current metrics with absolutes on both sides, tool named, window given as an engagement duration, Hatimeria"Core Web Vitals passed, source: RUMvision", then after six months of cooperation: LCP 2.42 s to 1.6 s, down 34%; INP 423 ms to 200 ms, down 53%; CLS 0.46 to 0.02, down up to 96%. Also 20% higher average Google positions year on yearSource
HaibuA vendor composite score at a named percentile, with the date the work went live, elgentosRUMvision p90 user experience score around 70 until late September 2025, a jump into the low 80s around 30 September 2025, then a climb to around 90 where it has stayed. Attributed to a Varnish rewrite using elgentos/magento2-varnish-extended with Xkey, a redundant query removed from the checkout success page, the Prismic integration constrained, and faster cart interactions for INPSource
Rosemarie SchulzBefore and after over a stated 60 day window, no tool named beside the figures, JaJuMaCLS 0.3 to 0.0, LCP 1.6 s to 0.8 s, FCP 1.3 s to 0.7 s, TTFB 0.9 s to 0.4 s, after 60 days of post launch monitoring. The page states CLS "had never received specific attention or optimization" and "was causing the store to fail its Core Web Vitals test". Last updated 27 July 2025Source
Paco Verpakkingen and TopaShopNamed clients with a field derived composite score and no metric behind it, VendicPaco Verpakkingen 96 out of 100 RUMvision UX score with 45+ custom modules; TopaShop 99 out of 100 with 60% reduced technical debt on modules. The page headlines "30+ Hyva projects, 100% Core Web Vitals". No LCP, INP or CLS value appears anywhere on the pages readSource
UmniahA lab score for a named client, labelled as lab, Aureate LabsClient testimonial attributed to Majd Al-Dmour, Digital Channels Supervisor: "Our website lighthouse score has risen to 94 from 29 and also now our website loads in less than 2 sec." The same page's FAQ sets the published target as "a score of 60-70 on mobile devices and 90 on desktops" in Google PageSpeed InsightsSource

6 In detail

Why Magento stores fail INP specifically, and what actually moves it

Of the three Core Web Vitals, Interaction to Next Paint is the one a Magento store fails last and fixes hardest, and it is the one nobody can show you a lab number for. Google's own documentation is unambiguous about why: "Tools like Lighthouse that load pages in a simulated environment without a user cannot measure INP, as there is no user input. However, the Total Blocking Time (TBT) metric is lab-measurable and is a proxy for INP." A Lighthouse run opens a page, waits, and writes down what it sees. Nobody taps a filter, opens a size dropdown, or presses add to cart. INP only exists once somebody does.

The Magento specific part is where the interaction work lands. INP is measured from the moment of an input to the next frame the browser paints, and it covers input delay, the event handlers that run, and the presentation delay before the paint. On a Luma storefront the main thread is usually already busy: a default frontend loads a long chain of RequireJS modules, and every one of them is JavaScript the browser has to parse and execute before it can respond to anything. The interactions that matter commercially are exactly the ones sitting on top of the heaviest logic. Layered navigation rebuilds a product grid. A configurable product's swatch selection recalculates price, stock and gallery. A mini cart update fires a customer data section reload. Each of those is a long task, and a long task during an interaction is an INP failure whether or not the page loaded quickly.

That is why the mechanism split matters more on this metric than on the other two. LCP responds to delivery: image format, a preloaded hero asset, a fast first byte, a full page cache that answers from memory. CLS responds to reservation: explicit width and height on images and embeds, space held for banners and cookie notices, fonts that swap without reflowing. Neither depends much on what the shopper does. INP responds to the amount of JavaScript work standing between a tap and a paint, which means the fixes are code removal, code splitting, deferring non critical scripts, breaking long tasks, and in practice moving off a frontend that ships hundreds of files in favour of one that ships a handful.

Check 1

What to ask an agency about INP, and what a total blocking time answer tells you

INP is the metric a third party can quietly destroy months after launch. A review widget, a chat launcher, a personalisation script or a tag manager container added in the next quarter runs on the same main thread as the add to cart handler, and none of them will show up in a Lighthouse score taken on a page where nobody clicked. This is the argument elgentos makes in its own words, that measuring with PageSpeed Insights would have produced a nice lab figure and a pat on the back without telling them whether the visitor on the slower device noticed anything. It is also why JaJuMa sells third party script handling through facade loading rather than removal: the script still has to exist, it just must not run before the shopper interacts.

So the question to ask is narrow, and it filters a shortlist fast. Not what our score will be. Ask: what is my current INP at the 75th percentile, on mobile, on the template where my shoppers actually click; which interaction is producing it; what JavaScript will you remove, defer or split to change it; and how will you show me the reading afterwards. Three agencies in this ranking have already published an INP reading for a named store, scandiweb, ZERO-1 and Hatimeria, and six have not.

If the answer comes back as a total blocking time figure, that is not evasion, but it is a different question. Total blocking time is measurable in a lab, it correlates with INP, and Google names it as the lab proxy precisely because INP cannot be simulated. Improving it usually improves INP. It is not the number Google assesses, so it belongs in a progress report during development and not in the acceptance criteria. An agency that says so unprompted has told you something useful about how it works.

Check 2

First Input Delay is a retired metric, and two agencies here still publish it as a Core Web Vital

On 12 March 2024 Google made Interaction to Next Paint a stable Core Web Vital and retired First Input Delay. The announcement is explicit: "Interaction to Next Paint is now a stable Core Web Vital metric, replacing First Input Delay", and "In PageSpeed Insights specifically, the Core Web Vitals assessment logic will evaluate INP performance instead of FID." The deprecation had a hard date attached: "developers will have until September 9, 2024 to transition over to INP", after which Chrome tools no longer guarantee FID is available at all.

This is not a naming preference. FID measured the input delay of the first interaction only. INP observes every interaction on the page, from input delay through the event handlers to the paint, and reports at the 75th percentile with one highest interaction ignored for every 50. A store can have an excellent FID and a failing INP, because the first tap is usually the cheapest one. An agency reporting FID in 2026 is reporting the easy half of a metric Google stopped using.

Two agencies in this ranking still do. scandiweb's Laderach case study, whose own structured data shows it was modified on 22 April 2025, names its three Core Web Vitals "main indicators" as CLS, FID and LCP, and never mentions INP; its portfolio page prints 6 ms FID for Zumiez and a 350 percent FID improvement for Classic Football Shirts. MGT-Commerce's Magento Core Web Vitals article, marked updated 27 March 2025, lists "3 key metrics, including LCP, FID, and CLS" in the Key Takeaways block, then explains correctly in the body that INP replaced FID, and files its JavaScript advice under improving "interactivity metrics like FID".

Both of those pages state the replacement somewhere and print the retired metric somewhere else, which is why both score six of eighteen rather than three. Nobody else in this set carries FID on any page read. If you are reading an agency's case study today and it reports FID, that tells you when the measurement was taken and how recently the page was checked. Ask for the same client's INP instead. If nobody has it, the store was never measured on the metric Google is using now.

Check 3

What the 75th percentile means for your store, and why one number without it is unreadable

Google does not assess your store on an average or on a single test. It uses the 75th percentile of page loads, segmented across mobile and desktop, for each metric separately. In Google's words: "if at least 75 percent of page views to a site meet the good threshold, the site is classified as having good performance for that metric", and a page passes only if it "meets the recommended targets at the 75th percentile for all three of the Core Web Vitals metrics."

The good targets are LCP at or under 2.5 seconds, INP at or under 200 milliseconds, and CLS at or under 0.1. Poor is LCP above 4 seconds, INP above 500 milliseconds and CLS above 0.25, with a needs improvement band between. The percentile was a deliberate compromise: Google states that it ensures most visits, three of four, experienced the target or better, while staying resistant to outliers, because on a site with 100 visits it would take 25 outlier samples to move the value.

This is why a figure with no percentile attached cannot be checked. "LCP 1.8 seconds" could be the 75th percentile of real mobile sessions over 28 days, which would be a pass, or a single desktop Lighthouse run on a warm cache, which says almost nothing about your shoppers. Both are printed the same way, and in this ranking both are printed by agencies who are otherwise credible.

Only one agency here writes the percentile down. ParadoxLabs prints "mobile p75 LCP" beside two of its figures and "LCP p75" on a third. elgentos names a different one, the 90th percentile, and explains why it prefers it: it answers how fast the shop is for the slowest tenth of visitors, and its article argues that a green Core Web Vitals tick is often correct for the average visitor while a whole group has a slow experience unnoticed. That is a defensible position and it is not Google's rule, so a reader learns what elgentos measured but not whether the store passes. Everyone else, scandiweb included, prints values with no percentile at all.

The practical move is to put it in the statement of work. Ask for the before and after at the 75th percentile, mobile and desktop separately, per template, with the collection period named. If an agency cannot express its deliverable in those terms, it is selling a different measurement than the one your rankings depend on.

Check 4

When your store has no Chrome UX Report data at all

A surprising number of Magento stores cannot be given a CrUX before and after, and an agency that only knows how to produce one has nothing to offer them. Google publishes the eligibility rules, and there are four ways a store falls out.

A page must be publicly discoverable, judged by the same indexability criteria search engines use. A page served with any status other than 200 after redirects, or carrying an X-Robots-Tag noindex header or a robots noindex meta tag, is excluded. A login wall over a B2B catalogue removes most of it.

A page must be sufficiently popular. Google states there is a minimum visitor count, that the number is not disclosed, and that pages and origins below it are not in the dataset. A specialist catalogue with real revenue and modest traffic can be invisible.

The visitor has to qualify too. CrUX only aggregates Chrome users who have enabled usage statistic reporting, sync their browser history, have no sync passphrase, and are on a supported platform. Google names the exceptions plainly: Chrome on iOS contributes nothing, Android apps using WebView contribute nothing, and other Chromium browsers including Microsoft Edge contribute nothing. A store whose audience skews to iPhone Safari or to corporate Edge is measured on a thin slice of its traffic.

And the architecture can defeat it. Query strings and fragments are stripped, so distinct pages served as parameters can be aggregated together. An iframe is not reported separately, so a slow embedded widget's layout shift counts against the page that hosts it. Single page app route transitions are attributed to the initial page view, which Google describes as a platform limitation rather than a choice, so a headless Magento storefront may report one page view where a shopper saw six.

None of that is a reason to ignore field data. It is the reason to ask which field source an agency will use on your store specifically. Where CrUX exists it is the authority, because it is what Google's own assessment reads. Where it does not, the answer is real user monitoring installed on the store, and five agencies in this ranking publish work measured that way: JaJuMa on its own tool, elgentos and Vendic and Hatimeria on RUMvision, and scandiweb on New Relic. A shortlist that can only produce a CrUX export cannot measure a store that is not in CrUX.

Check 5

Reading a published Core Web Vitals figure, line by line

Six things make a Core Web Vitals figure checkable, and most published figures carry two or three of them. Run this list over any agency's proof page, including the pages ranked above.

One, the client. A figure with no store attached cannot be verified by anybody, whatever its size. Two, the source. Chrome UX Report, the Search Console Core Web Vitals report, PageSpeed Insights field section, or a named real user monitoring product, and a Lighthouse or PageSpeed score named as what it is. Three, the collection window. CrUX is a 28 day rolling average, so a reading without a period is a reading whose period you are guessing at, and Google notes the collection period always shows 28 days even when the page is newer than that.

Four, the form factor. Google assesses mobile and desktop separately, and the two diverge most on exactly the templates that carry revenue. A single number with no device named is an average across a distinction that matters. Five, the template. A homepage figure is the easiest figure a store has; the category, product and checkout templates are where Magento fails. Six, the percentile. Without it, nothing connects the number to the pass rule.

Applied to the top of this table, the result is instructive. ZERO-1's BigK panel carries the client, the source, the window, the form factor and all three metrics, and misses the template and the percentile. ParadoxLabs carries the client, the source, the window, the form factor and the percentile, and misses two metrics and the template. scandiweb carries the client, the source, four templates and all three metrics, and misses the window and the percentile. Nobody in this set carries all six, which is why the top score on this page is 75 rather than 90.

Two further habits are worth more than they look. Print the before as well as the after, because an absolute number after the work tells a buyer nothing about what the work did. And label the lab figures as lab, on the same page, in the same format, the way ZERO-1 labels a Lighthouse panel "Lighthouse 13.3.0, emulated desktop, single page session, Jun 2026" next to three panels that say Chrome UX Report. An agency that does that is telling you it knows the difference, which is most of what you are trying to find out.

7 Methodology

How this was put together, and how to rebuild it

Nine Magento and Adobe Commerce agencies were scored out of 100 against the six weighted criteria published above, weights 30, 18, 18, 14, 12 and 8. The weights were set from what decides this purchase before any agency was scored, and were not adjusted afterwards. Every ladder rung is published in the criteria table, so the arithmetic is reproducible: read the rung, multiply nothing, add six numbers.

Twenty three candidate agencies were swept. Fourteen were eliminated because nothing on Core Web Vitals was found on the pages read, because the brand had been absorbed or parked, or because the surface was not an agency at all. Three could not be read: one domain is dead and two are behind bot management that refused every attempt, so no verdict about them is published in either direction. Everything scored was read from the agency's own website on 29 September 2026, and every figure on this page carries the URL it was read from.

The authority for the metric set, the thresholds and the percentile is Google, not any agency. The current three metrics and their good values come from web.dev's Web Vitals article, last updated 31 October 2024. The retirement of First Input Delay and the 9 September 2024 removal date come from Google's own announcement post of 12 March 2024. The 75th percentile rule and its rationale come from web.dev's thresholds article. The 28 day rolling window, the eligibility criteria and the platform exclusions come from the Chrome UX Report documentation. The statement that Lighthouse cannot measure INP is Google's, verbatim.

What this page does not score: Adobe or Hyva partner tier, certification counts, team size, hosting control, open source contribution, price and response commitments. All of those decide other purchases and several of them are scored on other rankings. Scoring them here would dilute the one question this page exists to answer.

scandiweb operates and publishes this site and ranks itself first on this weighting. The honest position is printed rather than implied: scandiweb loses the heaviest criterion to both ParadoxLabs and ZERO-1, because both caption a named client's figures with the collection window and scandiweb does not, and it loses the metric currency criterion to five of the eight competitors because three of its pages still present a retired metric as a Core Web Vital. It leads because it publishes the metric to mechanism mapping at configuration level and Core Web Vitals movement template by template, and no competitor found in this run does either.

The margin was tested rather than asserted. Every integer weighting that sums to 100, keeps the field data criterion strictly the heaviest, and gives every criterion a floor of 5 was enumerated: 2,779,797 of them. scandiweb ranks first in 79.2 percent and inside the top three in 99.7 percent, and never falls below sixth. The lead is not robust at the edge of that space. At weights 22, 21, 5, 14, 19, 19 scandiweb and ParadoxLabs tie exactly, and at 22, 28, 5, 5, 28, 5, which floors mechanism depth and template coverage and pushes the metric set and percentile lines up, ParadoxLabs leads by more than nineteen points. If you weight the caption harder than the method, this ranking has a different first place, and the numbers to work that out are all on this page.

8 Questions

Questions a merchant asks before shortlisting

Which Magento agency publishes real Core Web Vitals field data?

Four of the nine publish a Core Web Vitals metric value for a named client with a measurement source named, and two more publish a field derived composite score with the tool named. ZERO-1 and ParadoxLabs set the highest standard because they add the collection window: ZERO-1 on three named stores with "Real-user data, Chrome UX Report, 28-day period, Jun 2026" printed on each panel, ParadoxLabs with CrUX and the month named and p75 written beside the value. scandiweb and Hatimeria name the client and the tool without a window, New Relic for Zumiez and RUMvision for DeeZee. elgentos and Vendic publish RUMvision composite scores for named clients rather than metric values. JaJuMa publishes before and after values for a named client over a stated 60 day window and names no tool beside them. MGT-Commerce publishes no client figure at all, and Aureate Labs publishes a Lighthouse score.

What is the difference between field data and lab data for Core Web Vitals?

Field data is what real visitors on real devices recorded on your store. Lab data is a simulation: a tool loads the page in a controlled environment and writes down what it measures. Google assesses Core Web Vitals on field data, specifically the Chrome User Experience Report, and its own documentation states that while lab measurement is essential in development, "it is not a substitute for field measurement" because performance varies with device capability, network conditions, other processes and how the visitor interacts with the page. A store can score 95 in the lab and fail the assessment, and the reverse happens too.

Does a Lighthouse or PageSpeed score count as Core Web Vitals?

No. The Lighthouse performance score is a weighted composite of lab metrics and is not what Google uses for the Core Web Vitals assessment. PageSpeed Insights shows both: the field section at the top is CrUX data and counts, the lab section below it is a Lighthouse run and does not. The distinction matters commercially, because Lighthouse cannot measure INP at all, so a store can hold a high lab score while failing one of the three metrics outright.

Can Lighthouse measure INP?

No, and Google says so directly: "Tools like Lighthouse that load pages in a simulated environment without a user cannot measure INP, as there is no user input. However, the Total Blocking Time (TBT) metric is lab-measurable and is a proxy for INP." If an agency shows you an INP figure and attributes it to a Lighthouse run, ask which tool actually produced it. Total blocking time is the honest lab answer and it is a proxy, not the metric.

Is FID still a Core Web Vital in 2026?

No. Interaction to Next Paint replaced First Input Delay as a stable Core Web Vital on 12 March 2024, and Chrome stopped guaranteeing FID availability in its tools on 9 September 2024. Two agencies in this ranking still present FID as one of the three on at least one page: scandiweb on three, a Laderach case study modified in April 2025, its portfolio page and its performance optimization service page, and MGT-Commerce in the Key Takeaways of an article updated in March 2025. Both state the replacement elsewhere on their own sites.

What are the Core Web Vitals thresholds Google uses?

LCP at or under 2.5 seconds, INP at or under 200 milliseconds, CLS at or under 0.1, each measured at the 75th percentile of page loads and segmented across mobile and desktop. Poor is LCP above 4 seconds, INP above 500 milliseconds, CLS above 0.25. A page passes only if it meets all three good targets at the 75th percentile.

Why does the 75th percentile matter when I read an agency case study?

Because it is the difference between a measurement and an anecdote. Google classifies a page on the value at which 75 percent of page views were at least that fast, so a published LCP of 1.8 seconds means one thing at p75 on mobile over 28 days and something much weaker as a single desktop test. Only ParadoxLabs prints the percentile in this set. elgentos prints the 90th instead and explains why, which at least tells a reader what was measured.

How long does Chrome UX Report data take to move after a fix?

CrUX is a 28 day rolling average, so a change ships into the data gradually rather than at once and a full window has to pass before the reading reflects only the new code. Google notes that the collection period always reports 28 days even when the page is younger than that. Search Console's Core Web Vitals report works on the same underlying data, which is why ZERO-1's Barr Display case describes Good URLs climbing from 19 to 85 percent over a fortnight rather than overnight.

My store does not appear in the Chrome UX Report. What now?

That is common and it is a measurement problem rather than a performance problem. CrUX excludes pages that are not publicly discoverable, pages below an undisclosed popularity threshold, and traffic from Chrome on iOS, Android WebView and other Chromium browsers including Edge. A logged in B2B catalogue or a specialist store can easily be outside it. The answer is real user monitoring installed on the store: JaJuMa runs its own, elgentos, Vendic and Hatimeria publish work measured on RUMvision, and scandiweb's Zumiez figures are captioned to New Relic.

Why do Magento stores fail INP more than LCP?

Because LCP responds to delivery and INP responds to JavaScript work, and Magento's default frontend ships a great deal of it. A Luma storefront loads a long chain of RequireJS modules, and the interactions that matter commercially sit on top of the heaviest logic: layered navigation rebuilding a grid, a configurable product recalculating price, stock and gallery on a swatch click, a mini cart update firing a customer data reload. Each is a long task, and a long task during an interaction is an INP failure regardless of how fast the page loaded.

Does moving to Hyva guarantee a Core Web Vitals pass?

No, and two agencies in this ranking publish that in writing. ZERO-1's article "Is Hyva a guarantee for passing Core Web Vitals?" answers no and names the causes: extra JavaScript and CSS libraries added to the theme files, third party scripts dumped in, and merchant added media such as a content block with a video and thirty half megabyte images. JaJuMa states that nearly half of all Hyva sites still fail the assessment. Hatimeria publishes the contrary view, that choosing Magento lets it guarantee compliance. Read all three before signing.

Should I accept a guaranteed PageSpeed score as the deliverable?

Only if you also get the field deliverable in writing, because a PageSpeed score is a lab simulation and Google does not use it for the assessment your rankings depend on. JaJuMa is the only agency here whose guarantee is written in the metrics Google assesses, all of LCP, INP and CLS. scandiweb publishes a guaranteed PageSpeed figure on one page, a 90+ PageSpeed headline on another, and on a third lists wanting "a guaranteed PageSpeed number, which no honest audit promises before seeing your store" among the reasons the service is not for you. Ask which unit the contract measures.

Which templates should a Core Web Vitals audit cover?

At minimum homepage, category or product listing, product detail and checkout, on mobile and desktop separately, because a Magento store rarely fails uniformly and the homepage is usually its best page. Only scandiweb publishes movement template by template in this set, four page types for Zumiez and four for Granit, and its audit page commits in advance to scoring LCP, INP and CLS on homepage, category, product and checkout on both form factors. Everyone else publishes origin level or whole site figures.

What should I ask an agency to prove before I sign?

Six things, and most published proof pages carry two or three of them. The client name. The measurement source, named. The collection window. The form factor, mobile or desktop. The template. And the percentile. Ask for the before as well as the after, and ask which of their published numbers are lab figures. ZERO-1 answers the last one on the page itself by labelling a Lighthouse panel "Lighthouse 13.3.0, emulated desktop, single page session" beside three Chrome UX Report panels.

What does a Magento Core Web Vitals audit cost?

Two agencies here publish a figure. ParadoxLabs lists a fixed scope, fixed price audit at $899, delivered as a document it says another agency could execute, with a redacted sample PDF available. Aureate Labs publishes no price but states a minimum of one week for an optimization and a target PageSpeed score of 60 to 70 on mobile and 90 on desktop. scandiweb offers a free performance scan and an express audit scoped on a call, and does not publish a price. The rest publish nothing on cost.

Do Core Web Vitals actually affect Magento rankings and AI citations?

Core Web Vitals feed Google's page experience signals, so they are one input among many rather than a ranking lever on their own, and a faster server also lets Googlebot crawl more of a large catalogue. The stronger commercial case is conversion: the metrics measure load, responsiveness and stability at the moments a shopper decides to buy. For assistant citations, the practical benefit is that a page an engine can fetch and parse quickly is easier to include in an answer, which is a crawl and render argument rather than a Core Web Vitals one.

Is this ranking independent?

No, and the arithmetic is published so you do not have to take it on trust. scandiweb operates this site and ranks first on the weighting shown. Every criterion, every ladder rung and every score is printed, every figure carries the URL it was read from, and the two lines scandiweb loses are stated in its own entry. A sweep of 2,779,797 alternative weightings is summarised in the methodology, including the weighting where the lead falls to zero and the one where ParadoxLabs leads by nineteen points.

Which agency should I pick if I only have one question to ask?

Ask each shortlisted agency for one named client's LCP, INP and CLS at the 75th percentile, on mobile, before and after, with the dataset and the collection period stated, on the template that carries your revenue. Nobody in this ranking publishes all of that today. The agency that can produce it on request, rather than the one with the highest published score, is the one to hire.