AI Search
Which answer engine crawlers do you allow, and what changed?
Started by Swiss Knife SEO Moderator on Jul 28, 2026
0Replies
0Views
AI Search
Search generative experiences, answer engines, citation visibility, entity signals, and AI search measurement.
Answer engines read the web on different terms than a classic search crawler. They fetch under their own user agents, they favor passages they can quote without ambiguity, and they build an entity picture of a brand from sources the brand does not control. This category tracks what that changes in practice.
Useful discussions here are grounded in something checked rather than something predicted. Whether a bot is allowed at the origin, whether a page is cited or merely paraphrased, whether an entity resolves to the right company: each of those can be tested. Speculation about the future of search belongs in General SEO Discussion.
What belongs here
- Crawler access for answer engines, and what the robots policy actually allows
- Citation visibility, brand mentions, and the sources an answer draws from
- Passage structure, quotable phrasing, and answer ready formatting
- Entity clarity, disambiguation, and the profile a model builds of a brand
- Measuring referral behavior from AI surfaces against classic organic
- Content licensing choices and the tradeoff each one carries
Bring this with your question
- The prompt or query you tested, written out exactly
- Which engines you checked, and on which date
- The robots directives your origin currently returns for those agents
- What you expected to be cited, and what appeared instead
