llms.txt · llms-full.txt · Markdown
Make your website easier for AI assistants to understand.
BlogRainbow AI Ready crawls your site, writes an accurate llms.txt and clean Markdown, publishes it, and keeps it current. No code, no guesswork, no invented facts.
Checks your homepage, robots.txt and sitemap. No signup needed. Limited to a few analyses per hour.
# Acme Widgets > Acme Widgets designs and manufactures durable steel widgets for home workshops and small factories. Official website: https://acme.example - Primary language: en - Contact email: hello@acme.example ## Main pages - [About Acme Widgets](https://acme.example/about): Family workshop building repairable widgets from recycled steel. - [Contact](https://acme.example/contact): Opening hours, phone and workshop address. ## Products - [Blue Widget](https://acme.example/products/blue-widget): Powder-coated steel widget for heavy daily use. ## Optional - [Full content (llms-full.txt)](https://files.blograinbow.com/k3x9…/llms-full.txt)
How it works
From URL to published llms.txt in four steps
- 01
Add your website
Enter your URL. We check robots.txt, find your sitemaps, detect your platform and produce a first readiness report.
- 02
Verify ownership
Add a DNS TXT record, upload a small file, or paste a meta tag. You can preview your files before verifying.
- 03
We crawl and generate
Allowed pages are fetched politely, converted to clean Markdown, and turned into llms.txt, llms-full.txt and JSON files.
- 04
Publish and stay current
Files go live on your hosted URL (or your domain via the plugin) and refresh on your schedule.
Features
Everything AI systems need to read your site accurately
Built for accuracy first: every fact is traceable to a page you published, and every AI-written sentence is labelled.
llms.txt that follows the proposal
A concise H1/summary/sections file that follows the llmstxt.org proposal, with every link checked against pages we actually crawled.
llms-full.txt and clean Markdown
The full text of your important pages as clean Markdown, one file per page, plus an llms-full.txt companion that is split automatically when it gets large.
Facts, never fabrications
Prices, SKUs, availability and contact details only come from what your pages publish (structured data, meta tags, visible links). AI text is labelled and source-linked.
Kept up to date automatically
Weekly crawls by default (daily or monthly on request), with incremental fetching so unchanged pages are not processed again.
Hosted or on your own domain
Every site gets hosted URLs instantly. The WordPress plugin serves the files from your own domain root, and guides cover other platforms.
Versions and one-click rollback
Each generation is validated and kept as an immutable version. A failed run never replaces a good published file, and you can roll back at any time.
AI-Agent Ready badge
A lightweight SVG badge that reflects your real status: verified ownership, a valid published llms.txt and a recent successful crawl.
Readiness report
Checks for HTTPS, robots.txt, sitemaps, structured data, meta descriptions and JavaScript-only content, with a score and concrete fixes.
Private by design
Generation runs on our own server with a local AI model. Your content is never used to train models, and external AI providers are never required.
Why it matters
AI assistants read the web differently
Assistants and agents work best with concise, well-structured text. Navigation menus, scripts and pop-ups get in the way.
- A curated index tells AI tools which pages matter and what each one covers.
- Clean Markdown removes layout noise so your actual content is read correctly.
- Published facts (products, prices, policies, contacts) stay consistent with your site.
- Automatic refreshes mean AI tools never see last year's prices or retired pages.
We don't claim that any AI company will index, cite or rank your website. This is infrastructure for being read accurately, not an SEO guarantee.
Status
Published
Pages
48
Next crawl
Mon 03:00
llms.txt · v12 · valid
llms-full.txt · v12 · 214 KB
pages/*.md · 48 files
products.json · 31 items
AI-Agent Ready badge
Show visitors your site is AI-ready
A tiny SVG served from our server that reflects your real status: verified ownership, a valid published llms.txt and a recent successful crawl. If something breaks, it stops saying 'Verified'.
Not an official certification from any AI company.
Pricing
Simple, honest pricing
Start free. Upgrade when you want automatic weekly updates and AI-written descriptions.
Free
$0/month
- 1 website
- Up to 25 pages per crawl
- Automatic monthly crawling
- 2 manual crawls per day
- llms.txt + llms-full.txt + Markdown pages
- Hosted public files
- AI-Agent Ready badge
- Descriptions from your meta tags
- Crawl history & readiness report
Starter
$9/month
- 1 website
- Up to 100 pages per crawl
- Automatic monthly, weekly, daily crawling
- 5 manual crawls per day
- llms.txt + llms-full.txt + Markdown pages
- Hosted public files
- AI-Agent Ready badge
- AI-written page descriptions (local model)
- JavaScript rendering for JS-only pages
- Crawl history & readiness report
FAQ
Questions, answered honestly
Give AI assistants an accurate picture of your website
Set up in a few minutes. Your first llms.txt is generated right after you add your site.