Can AI Actually Read Your Website? 12 Things That Decide It
If ChatGPT returns your competitor and not you, the problem is almost always one of twelve specific things. They fall into three layers: can machines reach your content, can they understand your business, and can they find answers in it. The order matters, because a failure in the first layer makes every fix in the later ones pointless.
Most business owners find out they're invisible to AI search the same way: they ask ChatGPT about their own industry, a competitor comes back, and they don't. That moment is useful but frustrating, because it tells you there's a problem without telling you where.
Layer 1 — Can machines reach your content at all?
Everything else is theoretical until these three are right.
1. Content is in the HTML, not assembled by JavaScript
Google can usually read content that JavaScript builds after the page loads. Several AI crawlers handle it poorly or not at all. Sites built on certain frameworks or heavy page builders often look normal to people and empty to AI crawlers. If this is the problem, nothing else on this list helps until it is fixed, and the fix is a developer job.
2. robots.txt does not block AI crawlers
Plenty of sites block GPTBot, OAI-SearchBot, PerplexityBot, ClaudeBot or Google-Extended — sometimes deliberately, more often because a plugin added a blanket rule nobody reviewed. Blocking is a legitimate choice. Discovering it three years later is not.
3. No wall in front of the page
Cookie banners that hide content until dismissed, aggressive interstitials, age gates, region redirects. If a crawler hits a wall, it sees the wall.
Layer 2 — Can they understand what your business is?
4. Structured data exists and is valid
A service business needs LocalBusiness or ProfessionalService plus Organization at minimum, ideally Person for the owner and FAQPage where FAQs are visible. No schema at all is the single most common finding in the audits I run, and it has the widest gap between effort and payoff. Schema is you telling machines the facts directly instead of hoping they infer correctly.
5. Your business name is written identically everywhere
"Smith & Sons Plumbing", "Smith and Sons Plumbing Ltd" and "Smith Plumbing" are three entities to a machine. Every variant splits your signal.
6. Address and phone number are consistent
Same principle, quieter failure: a suite number present in one place and missing in another, a phone number formatted three ways, an old address still live in a directory you forgot about.
7. The homepage says what you do, where, and for whom — above the fold
"Excellence in every project since 2004" answers none of those. "Emergency plumbing and boiler repair across North Leeds, 24/7" answers all three. This feels like marketing rather than technical work, which is exactly why it gets skipped. A system summarising your business can only work with what you gave it.
8. Each service has its own page
One Services page listing eight things is one page competing for eight topics, and it loses all eight to competitors with dedicated pages. For AI search, a dedicated page is a coherent answer about one thing; a combined page is a fragment about everything.
Layer 3 — Can they find answers in your content?
9. Headings describe what is underneath them
"Our Approach" and "Why Choose Us" describe nothing. "How long does a bathroom installation take?" describes exactly what follows. Headings are how extraction systems navigate a page.
10. Questions are answered directly, before explaining
If the sentence after a question is "this depends on several factors", the answer is buried, and a competitor who wrote "most bathroom installations take five to seven working days" gets quoted instead. Answer first, context second.
11. Prices, timelines or ranges are stated somewhere
You don't need a full price list. But "from $X" or "typically two to four weeks" gives a system something concrete to include.
12. Your business appears somewhere other than your own website
Directories, review platforms, industry associations, local press, supplier listings, forum mentions. Fewer than five independent sources is thin. Zero means you exist only in your own account of yourself. This is the slowest thing to fix and often the most valuable.
What these twelve don't cover
These twelve decide whether your site is readable and understandable. They don't decide whether you are competitive: whether your content beats the alternatives a system chooses between, whether your topical coverage is deeper, whether your external reputation outweighs the businesses being recommended instead of you. That comparison needs a proper competitor analysis, and it is the part that is genuinely hard to do for yourself.
Frequently asked questions
Why can Google read my site when AI tools cannot?
Because some AI crawlers do not run JavaScript as well as Google does. If your content is assembled in the browser after the page loads, those crawlers see an empty shell. The other common cause is a robots.txt rule or security plugin that blocks AI crawlers without anyone deciding to.
Which AI crawlers should I allow in robots.txt?
The main ones are GPTBot and OAI-SearchBot (OpenAI), ChatGPT-User, PerplexityBot, ClaudeBot, Google-Extended and CCBot. Some businesses block these deliberately over training-data concerns, which is a legitimate choice — but it should be a deliberate decision, not a leftover plugin rule.
What schema markup does a small business need?
At minimum LocalBusiness or ProfessionalService, plus Organization. Ideally also Person for the owner and FAQPage wherever you have visible FAQs. Validate it, and treat errors as more serious than warnings, because an error usually means the whole block is ignored.
Why does my business name need to be identical everywhere?
Because variants split your signal. To a machine, "Smith & Sons Plumbing", "Smith and Sons Plumbing Ltd" and "Smith Plumbing" are three separate entities. Pick one canonical form and use it exactly across your website, Google Business Profile, social profiles and every directory.
Should I publish prices on my website?
You do not need a full price list, but stating something concrete like "from $350" or "typically two to four weeks" gives AI systems something specific to include when describing you. Businesses that state nothing get described in generalities, and generalities do not convert.
How many external mentions does a business need?
Fewer than five independent sources describing your business is thin. Zero means you exist only in your own account of yourself, and systems that cross-reference sources will either hedge or skip you. Directories, industry associations, local press and review platforms all count.
Want to know which layer is failing on your site?
I check all twelve on your website, compare you with the competitors AI tools name instead, and send a prioritised fix list.
Book a free consultation