Agent View
The site as an AI agent gets it, beside the site as a person sees it. What it can read, what it has to cut away, and what it never sees.
CompactPodcastAboutDonateSubscribeSign In
Matthew Schmitz
Matthew Schmitz is the editor of Compact, religion editor of Washington Post Opinions, and co-host of the podcast Counterculture. His essays on politics and culture have appeared in The New York Times, The Wall Street Journal, The Claremont Review of Books, The Atlantic, and First Things, where he was senior editor.
PodcastAboutDonateSubscribeSign InCompactmicah rich
**Matthew Schmitz** is the editor of *Compact*, religion editor of *Washington Post* Opinions, and co-host of the podcast [*Counterculture*](https://www.patreon.com/counterpod?ref=compactmag.com)*.* His essays on politics and culture have appeared in *The New York Times*, *The Wall Street Journal*, *The Claremont Review of Books*, *The Atlantic*, and *First Things*, where he was senior editor.
Thin: Too few words of their own are in the HTML for a page of their kind. Render the rest on the server. No h1: Give each one h1 that says what the page is.
The figures
100 pages, set against the 167,893 sites with figures.
- Readablehigher is better
- 92%92 of 100 pages
- All 167,893 sitesBetter than 31%
Pages whose own text is in the HTML the server sends, enough of it for their kind.
- Cleanhigher is better
- 84%middle page
- All 167,893 sitesBetter than 73%
Of the words before script, the share that are the page and not menus, footer and forms. 8 pages are not measured, with no <main> or no words.
- Costshown, never scored
- 189,399tokens
- About 1,894 a page
To read every page once. A long page that answers well is not worse for it. Tokens are estimated at about 4 characters each.
How its pages spread on Clean
92 pages measured. Not measured: 6 with no <main> or no words and 2 shells with no words before script.
Against its rivals
The sites nearest it by what they do, with figures. Close means similar work, not better.
| Readinghigher is better | Costnot scored | ||
|---|---|---|---|
| Site | Readable | Clean | Tokens a page |
| compactmag.comThis site, 100 pages | 92% | 84% | 1,894 |
| dc.claremont.org100 pages | 92% | 96% | 3,523 |
| catalyst-journal.com100 pages | 95% | 97% | 2,515 |
| theargumentmag.com91 pages | 99% | None | 2,751 |
Third of 4 on Readable, third on Clean.
AI crawler access
What robots.txt says to each, as read on October 24, 2026. 8 of 8 may read the site.
| Crawler | robots.txt says | Used for | The line that decides |
|---|---|---|---|
| GPTBotOpenAI | Not named | Training models | Falls to User-agent: * |
| OAI-SearchBotOpenAI | Not named | ChatGPT search | Falls to User-agent: * |
| ChatGPT-UserOpenAI | Not named | A page a person asks about | Falls to User-agent: * |
| ClaudeBotAnthropic | Not named | Training models | Falls to User-agent: * |
| Claude-SearchBotAnthropic | Not named | Claude’s search | Falls to User-agent: * |
| PerplexityBotPerplexity | Not named | Perplexity search | Falls to User-agent: * |
| Google-ExtendedGoogle | Not named | Training Gemini | Falls to User-agent: * |
| bingbotMicrosoft | Not named | Bing and Copilot | Falls to User-agent: * |
Every AI crawler mttr checks may read it. Not named means the rules for every crawler apply.
Every page
Worst first. Each opens in Agent View at the top.
2 pages are shells a script fills in. Put the text in the HTML the server sends, so an agent gets it without running script.Open the action plan
| What an agent getshigher is better | Signals | Costnot scored | ||||
|---|---|---|---|---|---|---|
| Page | Words | Clean | Readable | Main heading | Tokens | What it loses |
| /sohrab-ahmari | 8 | No words | No | None | 13 | Shell |
| /stephen-adubato | 8 | No words | No | None | 14 | Shell |
Show where it stands
A card, a badge and a line, each with the figures.
A badge for the site
<a href="https://mttr.si/agent-view/compactmag.com"><img src="https://mttr.si/agent-view/compactmag.com/badge.svg" alt="Agent View: 92% readable, 84% clean" height="20"></a>
The figures in one line
compactmag.com in Agent View: 92% of pages readable, better than 31% of sites; 84% clean; 189,399 tokens to read all 100 pages. mttr.si/agent-view/compactmag.com
What to do next
Fix the pages, let an agent do it, and read the site again to see the figures move.
Fix what agents miss
- Give 10 pages a main headingClearer
- Wrap 6 pages in <main>Clean measured
- Render the rest of 6 pages on the serverReadable
Connect your agent
Claude Code, Codex or Cursor reads the site’s fixes over MCP, fixes a page in your code, has mttr read it again, and checks the fix landed.
https://mttr.si/mcpSet up an agent
Claim the site
Prove it is yours with a DNS record or a file. Your agent can then reach its reads and jobs, and set each change to wait for your approval.
Claim the siteDrawn from the HTML mttr fetched on its read of October 24, 2026, not a screenshot, and only from the 100 pages read, where the read stopped at its page limit. An assistant’s own reader may differ. Tokens are estimated at about 4 characters each. A site an agent reads well is not a site an assistant cites.