Why can't ChatGPT see my website?
Short answer: something between ChatGPT and your pages is stopping it. Usually it's one of five things: a robots.txt rule that blocks OpenAI's search crawler, a firewall or bot check that turns it away, a broken HTTPS certificate, key text that only appears after JavaScript runs, or pages ChatGPT simply hasn't found. Each one is quick to test.
It matters because ChatGPT doesn't wait. When a customer asks it for a business like yours and it can't read your site, it describes you from old listings, or names a competitor whose site it could read.
You're not alone. In Preferly's study of 3,693 small and local business websites in 26 US cities, about 1 in 7 small business websites weren't fully open to AI crawlers, and most owners didn't choose that.
The five usual causes
1. robots.txt blocks OAI-SearchBot
OpenAI uses separate crawlers for separate jobs (OpenAI crawler docs). OAI-SearchBot decides whether you can appear in ChatGPT's search answers; sites that block it "will not be shown in ChatGPT search answers, though can still appear as navigational links." GPTBot is for training, and blocking it doesn't hide you from search. ChatGPT-User is the agent ChatGPT may send to a page when a user's question calls for it.
In our study, 3.1% of sites blocked some or all AI crawlers in robots.txt. OAI-SearchBot was blocked less often (1.0%) than GPTBot, OpenAI's training crawler (3.1%).
Fix: allow OAI-SearchBot in robots.txt. You can still block GPTBot if you don't want your content used for training. Our guide on letting AI crawlers into your site has the exact lines, and GPTBot vs OAI-SearchBot explains the split. OpenAI says robots.txt changes take about 24 hours to reach its search systems.
2. A firewall or bot check turns it away
This one hides more sites than robots.txt does. In our study, 5.8% of sites showed our clearly identified crawler a bot check instead of their homepage: Cloudflare on 3.0% of sites and SiteGround on 2.7%. 40% of the sites we analyzed ran behind Cloudflare. These checks come from hosting and security vendors, so most of those owners never decided anything about AI.
OpenAI's help page is clear that robots.txt isn't enough: you also need to "confirm that the website host or content delivery network allows traffic from OpenAI's published searchbot IP addresses" (OpenAI Help Center).
Fix: look at your host's or CDN's bot settings and allow the AI search crawlers you want to be found by. If you're on Cloudflare, see is Cloudflare blocking AI crawlers?
3. A broken HTTPS certificate
A person sees a warning page and can click through. A crawler usually just leaves. In our study, 5.0% of homepages didn't load for an automated visitor, and most of those (3.8% of all sites analyzed) had a certificate problem: one issued for a different name, an expired one, or a failed secure connection.
Fix: open your site at https:// with and without "www" and look for any warning. Your host can usually renew or reissue the certificate. More in how a broken certificate can hide you from AI.
4. Your key text only appears after JavaScript runs
Some site builders and booking widgets load hours, menus and prices with scripts. A December 2024 analysis by Vercel and MERJ found that none of the major AI crawlers it measured render JavaScript, including OpenAI's OAI-SearchBot, ChatGPT-User and GPTBot. They read the HTML the server sends.
Fix: in your browser, open "View page source" (not the inspector) and search for your phone number, hours and main services. If they aren't in the source, ask your web developer or builder's support how to put that text in the page itself.
5. ChatGPT hasn't found the page
A new site, a page nothing links to, or a question ChatGPT answered without searching can all leave you out. ChatGPT searches the web when it decides a question needs current information. You can also turn search on yourself and ask again.
Fix: link every important page from your homepage or menu, and get listed on the sites that link to businesses like yours. OpenAI also notes that placement in ChatGPT search "is not guaranteed", even for a site it can read.
How to test your site in two minutes
- Run our free AI crawler check. It makes the same two requests we used in the study (robots.txt, then your homepage) and shows which AI crawlers are blocked or turned away. No email needed.
- Open your homepage source and look for your key facts in plain text.
- Ask ChatGPT, with search on: "What does [your website address] say about opening hours?" If it can't open the page, one of the five causes above is the usual reason.
Being readable is the first step. Whether ChatGPT then recommends you depends on what your site and other sites say about you; why a business doesn't show up on ChatGPT covers that next step, and the full $99 AI visibility audit tests both at once: which AI crawlers can read your site, and what 10 AI models say about you.
Questions
Can ChatGPT see my website?
It can if its crawlers can load your pages and read the text. OpenAI says a site must allow OAI-SearchBot in robots.txt, and its host or CDN must allow OpenAI's published IP addresses, to be eligible for ChatGPT search results.
I blocked GPTBot. Does that hide me from ChatGPT?
Not from ChatGPT search. OpenAI says GPTBot and OAI-SearchBot are independent: blocking GPTBot opts your content out of model training, while OAI-SearchBot decides whether you can appear in ChatGPT's search answers.
How long after I fix robots.txt will ChatGPT see my site?
OpenAI says it can take about 24 hours from a robots.txt update for its search systems to adjust. Being crawled and then cited can take longer, and placement isn't guaranteed.
Does ChatGPT read JavaScript?
A December 2024 analysis by Vercel and MERJ found that none of the major AI crawlers it measured, including OpenAI's, render JavaScript. Put your key facts in the page's HTML so they don't depend on scripts.
Sources
3 AI models, 5 customer questions, about a minute. Or check whether AI crawlers can reach your site.
No email. It reads your robots.txt and homepage, the way AI crawlers do.