The Plain Fetch viewer
In short
The viewer requests a URL the way a plain-fetch agent does: no JavaScript, one request for HTML, one for markdown, one for llms.txt and one for a path that should not exist. It shows the initial HTML on the left, the readable text on the right, and seven flags underneath.
Pre-loaded with www.wikipedia.org, read 4 November 2026. Type any public URL to run your own.
The page answers a plain fetch: 4 of 6 checks found.
Initial HTML what a plain fetch receives
<!DOCTYPE html>
<html lang="en-US">
<head>
[... 1 more head element folded ...]
<title>Business Insider - Latest News in Tech, Markets, Economy & Innovation</title>
<meta charset="UTF-8">
[... 1 more head element folded ...]
<meta
name="viewport"
content="width=device-width, initial-scale=1"
>
<meta
name="description"
content="Business Insider tells the global tech, finance, stock market, media, economy, lifestyle, real estate, AI and innovative stories you want to know."
>
[... 6 more head elements folded ...]
<link rel="alternate" type="application/rss+xml" href="https://feeds.businessinsider.com/custom/all" />
[... 4 more head elements folded ...]
<link
rel="canonical"
href="https://www.businessinsider.com/"
>
[... 55 more head elements folded ...]
</head>
<body
data-site-id="bi"
data-id="homepage"
class=""
>
<header
class="masthead homepage-masthead with-trending-bar is-user-logged-out"
data-component-type="masthead"
data-mode="read"
data-load-strategy="exclude"
style="--scroll: 0"
role="banner"
>
<section class="top-section full-width-section">
<div
class="masthead-ad style-loading pre-render as-homepage"
data-component-type="masthead-ad"
data-load-strategy="exclude"
data-ad-subnav=""
data-ad-refresher-expand="" [... 123 characters folded ...]>
<div class="masthead-ad-wrapper ad-label">
<div
data-bi-ad
id="gam-homepage-sub_nav-desktop-1"
class="ad ad-wrapper fluid only-desktop is-collapsible"
data-force=""
data-ty [... 1298 characters folded ...]></div>
<div class="close-icon-wrapper" aria-label="Close this ad">
<div class="close-icon-circle"><svg
aria-hidden="true"
focusable="false"
class="svg-icon close-icon "
xmlns="http://www.w3.org/2000/svg"
width="1em"
height="1em"
viewBox="0 0 24 24"
>[... 172 characters folded ...]</svg></div>
</div>
</div>
</div>
</section>
<section class="subnav-section">
<nav
class="masthead-subnav subnav with-trending-bar"
data-track-click-shared="{"product_field":"vertical","event":"navigation","element_name":"navbar"}"
role="navigation"
>
<ul class="subnav">
<li class="subnav-item">
<a
class="subnav-item-link label-lg-strong"
href="/business"
data-track-click=""
>
Business
</a>
</li>
<li class="subnav-item">
<a
class="subnav-item-link label-lg-strong"
href="/tech"
data-track-click=""
>
Tech
</a>
</li>
<li class="subnav-item">
<a
class="subnav-item-link label-lg-strong"
href="https://markets.businessinsider.com/"
data-track-click=""
>
Markets
</a>
</li>
<li class="subnav-item">
<a
class="subnav-item-link label-lg-strong"
href="/lifestyle"
data-track-click=""
>
Lifestyle
</a>
</li>
<li class="subnav-item">
<a
class="subnav-item-link label-lg-strong"
href="/defense"
data-track-click=""
>
Military & Defense
</a>
</li>
<li class="subnav-item">
<a
class="subnav-item-link label-lg-strong"
href="/guides"
Shown with 359 long blocks (scripts, styles, long tags) folded into a marker that says how many characters they hide; the pane stops after the first 200 words; the page is 603 KB.
Reading view the text a plain-fetch client can extract
title: Business Insider - Latest News in Tech, Markets, Economy & Innovation
Business Insider - Top Stories
Business Tech Markets Lifestyle Military & Defense Reviews Video Level Up Community Newsletters Subscribe Read Watch Listen Search Business Strategy Economy Finance Retail Advertising Careers Law Media Real Estate Small Business The Better Work Project Personal Finance Tech Science AI Enterprise Transportation Startups Innovation Markets News Stocks Indices Commodities Crypto Currencies ETFs Lifestyle Entertainment Culture Travel Food Health Education Parenting Military & Defense Politics Reviews Home Kitchen Style Streaming Pets Tech Deals Gifts Tickets Video Big Business So Expensive View From Above Small Business Authorized Account Risky Business Boot Camp Still Standing How Crime Works Life Lessons Live Events Tech Insider: Growth Mode The Long Play Stream Business Insider Level Up Community Job Scout Subscribe My account Log in Newsletters Saved Articles US edition Deutschland & Österreich España Japan Polska TW 全球中文版 Get the app Business Insider - Top Stories Top stories AI Insider Following the money, work, and power reshaped by AI The Chinese spy allegation that toppled Nvidia's CEO is starting to look shaky 8 min read Let's say the espionage doubters are right. Should Jensen Huang still get his job back? 3 min read A petition to reinstate Jensen Huang as Nvidia CEO has over 100,000 signatures,
1179 more words follow in the initial HTML.
| Check | Result | Detail |
|---|---|---|
| H1 in the initial HTML | Found one H1 | First H1: Business Insider - Top Stories |
| First 200 words in the initial HTML | Found 200 of 200 words | The initial HTML carries 1379 words of visible text; the first 200 are marked in the left pane. |
| llms.txt present and linked | Note present, not linked | 1066 bytes, 9 links. Structure grade A (6 of 6). Nothing on the home page points to it. Ora's lab found 86 percent of llms.txt fetches arrived through a link. |
| Markdown on request | Missing 200 text/html | Accept: text/markdown returned 200 with text/html; charset=utf-8. The server ignores the header. |
| Status of a made-up path | Found 404 | /agent-ready-html-missing-path-check returned 404: a real status code for a missing page. |
| JSON-LD types | Found Brand, CollectionPage, ContactPoint, ImageObject and 7 more | 11 schema.org types in JSON-LD blocks on the home page: Brand, CollectionPage, ContactPoint, ImageObject, ItemList, ListItem, NewsMediaOrganization, Organization, Person, SearchAction, WebSite. |
| OpenAPI link | Note none on the home page | No OpenAPI link on the home page. It matters only for a site that ships an API. |
Run the full check
The viewer read one page with four requests. The full check we recommend next is Ora's scan. Its Access layer runs 42 checks worth 30 of its 100 points, among them content without JavaScript, bot detection, llms.txt, markdown on request, JSON-LD and the sitemap (Ora's check catalogue, contract 1.38.0, read 5 November 2026). Open Ora's report for businessinsider.com.
Limits: Ora reads public URLs only, says two runs of one scan land within a couple of points without publishing repeat-scan data, and keeps the product that fixes what it finds behind a waitlist. Cloudflare's scanner at isitagentready.com is a quick free alternative, and Mintlify's score covers documentation.
What the viewer does
It sends four plain GET requests with the user agent Mozilla/5.0 (compatible; agent-readiness-crawl/1.0): the URL itself, the same URL with Accept: text/markdown, /llms.txt on the same host, and a made-up path at the root. It runs no JavaScript. The left pane is the first bytes of the HTML as text, with long scripts and styles folded into a marker that says how many characters they hide. The H1 and the first 200 words of visible text are marked in both panes. The flags under the panes say what the four responses added up to.
Limits
- Ten seconds for all four requests together, 1.5 MB read from the home page, at most five redirects, each one checked again.
- http and https only, default ports only. Private, local and internal addresses and names are refused.
- Ten runs per address per minute. The counter lives in memory on the edge function, so it is per instance rather than global. Past ten you get a 429 with a Retry-After header.
- Results are cached for 24 hours by the response headers. Nothing is written to a database: the viewer keeps the first 200 words and the extracted fields for the length of the request and keeps no page body beyond that.
What it does not tell you
A plain fetch from this server is not a real agent. Bot protection weighs the source address more than the user agent, so a page that answers 200 here can still refuse an agent, and the reverse. Ora's lab found (2026-10-19) that returning 403 to agent user agents and hiding the answer in JavaScript were the only two of 19 configurations that stopped retrieval; the viewer can see the second, and can only hint at the first. The initial HTML reference covers both. The server logs and the published crawler address ranges settle the first.
The seven flags
- H1 in the initial HTML
- Whether the HTML the server sends already contains an H1. It is the cheapest sign that the page does not depend on scripts to say what it is.
- First 200 words in the initial HTML
- Whether at least 200 words of visible text arrive in the initial HTML. Under 40 words with an app root element is flagged as a JavaScript shell.
- llms.txt present and linked
- Whether /llms.txt answers with a plain-text file, whether the home page links it (an anchor, a link element or a Link header), and the structure grade the index uses.
- Markdown on request
- Whether a request with Accept: text/markdown comes back as text/markdown. Cloudflare Radar found 3.9 percent of scanned top sites passing this at its April 2026 launch.
- Status of a made-up path
- Whether a path that should not exist returns 404 or 410. A 200 is a soft 404 and reads as a live page.
- JSON-LD types
- The schema.org types found in JSON-LD blocks on the page. Ora's lab found JSON-LD made no difference when the answer was already in the HTML.
- OpenAPI link
- Whether the page links an OpenAPI file, by an anchor or a service-desc link relation. It matters only for a site that ships an API.
Sources
- Ora: AgentReady launch post (Ora's lab findings) https://ora.ai/blog/agentready-launch, read 4 November 2026
- Ora check catalogue, contract 1.38.0 (132 checks, 42 in the Access layer) https://ora.ai/api/checks, read 5 November 2026
- Ora home page (the fixing product is behind a waitlist) https://ora.ai/, read 5 November 2026
- Ora: Introducing Deep Scan (repeat scans) https://ora.ai/blog/introducing-deep-scan, read 5 November 2026
- Ora llms.txt (public URLs only) https://ora.ai/llms.txt, read 5 November 2026
- Vercel: Make your site readable by AI agents https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents, read 4 November 2026
- llms.txt proposal (llmstxt.org) https://llmstxt.org/, read 4 November 2026
Last reviewed 5 November 2026