Can ChatGPT, Claude and Google read your site?
Updated 2026-10-22T00:00:00.000Z
Quick answer
Open the page on viewhtmlonline and go to the Report tab. “Can bots read this?” shows for Googlebot, GPTBot, ClaudeBot, PerplexityBot and others whether robots.txt allows them.
Every site can publish a file at /robots.txt that tells bots what they may crawl. For example:
User-agent: GPTBot
Disallow: /
User-agent: *
Allow: /This asks OpenAI’s training bot to stay away and lets every other bot in.
Bots worth knowing
| Bot | Used for |
|---|---|
| Googlebot | Google Search |
| Bingbot | Bing and Copilot |
| GPTBot | OpenAI model training |
| OAI-SearchBot | ChatGPT search |
| ClaudeBot | Anthropic |
| PerplexityBot | Perplexity |
| Google-Extended | Gemini training (not Search) |
| CCBot | Common Crawl |
Check any page
Open the page on viewhtmlonline, switch to Report and look at Can bots read this?. It reads the site’s robots.txt, picks the rule that applies to each bot, and also tells you if the page has a noindex or nosnippet tag.
Questions people ask
Does blocking GPTBot remove my site from ChatGPT?
GPTBot is used for training. ChatGPT search uses OAI-SearchBot. Block or allow them separately, depending on what you want.
Is robots.txt a security measure?
No. It is a polite request. Well-behaved bots follow it, but it doesn’t stop anyone from reading a public page.