Pricing Dashboard

Research

Live tests of how real websites answer AI crawlers, with the source files behind the numbers and what the tests did not measure.

We fetched 96 websites as AI crawlers. The answer depended on who was asking.
October 28, 2026 · 11 min read
In October 2026 we ran three rounds of live tests, fetching real websites under the names of AI crawlers and comparing each answer with a plain browser fetch. Here is what our requests received, and what that does not show.
Read more →