Agent View
The site as an AI agent gets it, beside the site as a person sees it. What it can read, what it has to cut away, and what it never sees.
This page is a shell a script fills in. What is below is all its HTML holds before script runs; a person sees more once script runs, and most AI crawlers do not run it.
Skip to main content
Cory Dransfeldt[email protected]~/coryd.dev ~ / c o r y d . d e vPostsMusicWatchingReadingLinks
A Rant About “Technology”
Via Ursula K. Le Guin, December 11, 2023
/links/a-rant-about-technology
Ursula K. Le Guin on the presence of technology in her work
tech
Frozen SoulNo Place of WarmthContactSchedule a meetingBuy Me a CoffeeActivityColophonStats
# [A Rant About “Technology”](https://www.ursulakleguin.com/a-rant-about-technology) Via [Ursula K. Le Guin](https://www.ursulakleguin.com/), December 11, 2023 > Ursula K. Le Guin on the presence of technology in her work [tech](https://www.coryd.dev/tags/tech)
This page is a shell a script fills in. The server sends 25 words of its own; the rest of what a person reads arrives only after script runs, and most AI crawlers do not run script.
The figures
100 pages, set against the 167,893 sites with figures and 195 in news.
- Readablehigher is better
- 82%82 of 100 pages
- All 167,893 sitesBetter than 25%195 news sitesBetter than 27%
Pages whose own text is in the HTML the server sends, enough of it for their kind.
- Cleanhigher is better
- 74%middle page
- All 167,893 sitesBetter than 55%195 news sitesBetter than 56%
Of the words before script, the share that are the page and not menus, footer and forms. 19 pages are not measured, with no <main> or no words.
- Costshown, never scored
- 22,115tokens
- About 221 a page
To read every page once. A long page that answers well is not worse for it. Tokens are estimated at about 4 characters each.
How its pages spread on Clean
81 pages measured. Not measured: 1 with no <main> or no words and 18 shells with no words before script.
Against its rivals
The sites nearest it by what they do, with figures. Close means similar work, not better.
| Readinghigher is better | Costnot scored | ||
|---|---|---|---|
| Site | Readable | Clean | Tokens a page |
| coryd.devThis site, 100 pages | 82% | 74% | 221 |
| ritiksahni.com69 pages | 93% | 87% | 524 |
| damien.zone100 pages | 53% | 96% | 926 |
Second of 3 on Readable, third on Clean.
AI crawler access
What robots.txt says to each, as read on October 23, 2026. 1 of 8 may read the site.
| Crawler | robots.txt says | Used for | The line that decides |
|---|---|---|---|
| GPTBotOpenAI | Blocked | Training models | User-agent: GPTBot / Disallow: / |
| OAI-SearchBotOpenAI | Blocked | ChatGPT search | User-agent: OAI-SearchBot / Disallow: / |
| ChatGPT-UserOpenAI | Blocked | A page a person asks about | User-agent: ChatGPT-User / Disallow: / |
| ClaudeBotAnthropic | Blocked | Training models | User-agent: ClaudeBot / Disallow: / |
| Claude-SearchBotAnthropic | Blocked | Claude’s search | User-agent: Claude-SearchBot / Disallow: / |
| PerplexityBotPerplexity | Blocked | Perplexity search | User-agent: PerplexityBot / Disallow: / |
| Google-ExtendedGoogle | Blocked | Training Gemini | User-agent: Google-Extended / Disallow: / |
| bingbotMicrosoft | Not named | Bing and Copilot | Falls to User-agent: * |
7 of 8 are kept out. A crawler kept out never reads a page, however well it is made.
Every page
Worst first. Each opens in Agent View at the top.
20 pages of 100 lose something. Pick a loss to see what to do about it.Open the action plan
Show where it stands
A card, a badge and a line, each with the figures.
A badge for the site
<a href="https://mttr.si/agent-view/coryd.dev"><img src="https://mttr.si/agent-view/coryd.dev/badge.svg" alt="Agent View: 82% readable, 74% clean" height="20"></a>
The figures in one line
coryd.dev in Agent View: 82% of pages readable, better than 27% of news sites; 74% clean; 22,115 tokens to read all 100 pages. mttr.si/agent-view/coryd.dev
What to do next
Fix the pages, let an agent do it, and read the site again to see the figures move.
Fix what agents miss
- Put the text of 18 pages in the HTMLReadable
- Give 2 pages a main headingClearer
- Wrap 1 page in <main>Clean measured
Connect your agent
Claude Code, Codex or Cursor reads the site’s fixes over MCP, fixes a page in your code, has mttr read it again, and checks the fix landed.
https://mttr.si/mcpSet up an agent
Claim the site
Prove it is yours with a DNS record or a file. Your agent can then reach its reads and jobs, and set each change to wait for your approval.
Claim the siteDrawn from the HTML mttr fetched on its read of October 23, 2026, not a screenshot, and only from the 100 pages read, where the read stopped at its page limit. An assistant’s own reader may differ. Tokens are estimated at about 4 characters each. A site an agent reads well is not a site an assistant cites.