The Robots.txt Line That's Silently Blocking Salons and Clinics From Every AI Search Answer
A single disallow line in your robots.txt file can stop ChatGPT, Perplexity, and Google's AI Overview from ever reading your salon or clinic site, no matter how good your treatment pages are.
A client asks ChatGPT which clinic nearby still has a slot for a specific treatment this week. Four names come back. A fifth clinic, with faster response times and genuinely stronger reviews, never gets mentioned, not because its treatment pages are weak, but because its own robots.txt file told the model's crawler to stay out before it ever reached a single page.
Your Robots.txt File Decides Who Gets To Read You
Every website has a robots.txt file sitting at its root address, usually written years ago to tell Google and Bing which pages to crawl. Most salon and clinic sites have never been touched since launch. The problem is that newer crawlers such as GPTBot, ClaudeBot, PerplexityBot, and CCBot read that same file, and a line written for search engines back then can silently shut all four of them out today.
1. The Four Crawlers Worth Checking For
- GPTBot, which feeds ChatGPT's answers
- ClaudeBot, which feeds Claude's answers
- PerplexityBot, which feeds Perplexity's answers
- CCBot, which feeds the open training sets several AI search tools draw on
2. Where The Block Usually Comes From For Salons And Clinics
Nobody sits down and decides to block ChatGPT on purpose. The rule usually arrives through a site builder's hide from search engines setting switched on during setup and never revisited after launch, a leftover file carried over from a rebrand that was meant to stay private until it went live, or a booking platform subdomain, where your actual treatment menu and pricing often live, that carries its own separate robots.txt nobody at the salon has ever opened.
| What the file usually says | What it actually does |
|---|---|
| A generic rule naming only search engines like Googlebot and Bingbot | Normal housekeeping, leaves your treatment pages open to every crawler |
| A rule naming GPTBot followed by a blanket disallow of the whole site | Switched on by a site builder's hide from search engines setting, blocks ChatGPT from ever reading the site |
3. Checking Your Own Site Takes Two Minutes
Open your own site's address followed by slash robots.txt in a browser tab. Read through it for a line naming GPTBot, ClaudeBot, PerplexityBot, or CCBot. If any of those names sit under a rule that disallows the whole site, that crawler is turned away at the door, no matter how good the treatment page it would have read actually is. Then check your booking platform's own address the same way, since that is often where your real service menu and pricing sit, and it answers to its own robots.txt file, not yours.
A robots.txt file that blocks AI crawlers does not protect client privacy. It just removes you from the one channel increasingly deciding which salon or clinic gets named first.
ZENETERA
The Takeaway
Fixing this is rarely more than deleting or narrowing a handful of lines. It will not rank a weak page higher and it will not fix thin treatment descriptions. What it does is stop a technical accident from quietly cancelling out every other improvement you make for AI search, including named stylist pages, published pricing, and the reviews you already worked to collect.