Definition
Crawling is a bot downloading your page; indexing is the search engine storing it so it can be shown. Without both, AI cannot cite it.
AI with search can only cite what a crawler has been able to read and an index has stored. If a page is not indexed, loads its content only with JavaScript, returns errors or has the wrong canonical, no content or source work will help.
Check it before anything else: in Search Console, in robots.txt (what you let through to OAI-SearchBot and the others) and by reading the HTML a bot receives, not the one you see in your browser.
OpenAI’s crawler for ChatGPT search. Block it in robots.txt and your pages can be left out of its answers with sources.
1 min readMarkup, usually JSON-LD, that states explicitly what a page already shows: who you are, what you offer, who wrote it and when.
1 min readStart with a free review: three questions from your category on two AI platforms. No card required.
Get a free review