How can I check whether AI crawlers can access my site?

robots.txt is a public file at the root of your domain. Look for User-agent lines naming AI crawlers and any Disallow rules under them, and for broad rules under 'User-agent: *' that apply to every bot. Each AI company uses several agents with different jobs, so allowing one doesn't allow the others. For ChatGPT search, OAI-SearchBot is the one that matters, according to OpenAI.

The second check is easy to miss. Bot protection from CDNs and firewalls can return errors or challenge pages to AI crawlers even when robots.txt allows them. You can test this by requesting a page with the crawler's user agent, although some providers also verify the requesting IP address, so a test from your own machine may not match what the real crawler sees.

The AI Crawler Access Checker covers:

• robots.txt rules for GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended and other crawlers.
• Live server responses to each crawler's user agent, where one exists.

Finally, check that your content is in the HTML. A crawler that is allowed in but can't run JavaScript may still see an empty page.