A growing share of people skip Google and ask ChatGPT or Perplexity directly: "Who's the best Meta Ads consultant for lead gen?" "How do I fix my Shopify tracking?" The AI writes an answer and cites a handful of websites. If your site isn't one of those sources, you're invisible in that conversation — no matter how well you rank on Google.
The good news: getting cited isn't magic. It comes down to whether the AI can reach your page, understand it, and trust it. This guide covers all three in eight practical steps. (For Google's version of this, see my guide to ranking in AI Overviews.)
The short answer
- Let the right bots in: allow OAI-SearchBot (ChatGPT search) and PerplexityBot in robots.txt.
- Get indexed in Bing as well as Google — ChatGPT search leans on it.
- Answer questions directly in plain HTML, with specific facts, statistics, and sources.
- Earn mentions on other trusted sites, keep pages fresh, and track your citations monthly.
How ChatGPT and Perplexity choose their sources
Both tools search the web in real time, read a shortlist of pages, and cite the ones that answer the question most clearly and credibly. The process looks like this:
- Retrieve: the AI runs one or more searches — ChatGPT through OpenAI's own crawler index (OAI-SearchBot) and search partners like Bing; Perplexity through its own crawler (PerplexityBot) and index.
- Read: it pulls the text from the top results. Pages it can't fetch or parse are skipped.
- Write and cite: it composes an answer and links the pages whose passages it actually used.
So there are three gates: can it find you (crawling and indexing), can it use you (clear, extractable content), and does it trust you (authority and mentions). Every step below targets one of those gates.
Step 1 — Allow the right AI crawlers
If the AI's crawler is blocked, you can't be cited — full stop. The confusing part is that each company runs several bots with different jobs. Here's what matters:
| User agent | Company | What it does | Block it? |
|---|---|---|---|
| OAI-SearchBot | OpenAI | Indexes pages for ChatGPT search answers | No — blocking removes you from ChatGPT search |
| GPTBot | OpenAI | Collects content for model training | Optional — doesn't affect ChatGPT search |
| ChatGPT-User | OpenAI | Fetches a page when a user asks ChatGPT to open it | No |
| PerplexityBot | Perplexity | Indexes pages for Perplexity answers | No |
| ClaudeBot | Anthropic | Crawls the web for Claude | Your choice |
| Bingbot | Microsoft | Bing index, also used by ChatGPT and Copilot | No |
A simple, citation-friendly robots.txt looks like this:
User-agent: *
Allow: /
User-agent: OAI-SearchBot
Allow: /
User-agent: PerplexityBot
Allow: /
Sitemap: https://yoursite.com/sitemap.xml
Also check your firewall or CDN (Cloudflare, hosting "bot protection"). Many sites block AI crawlers at the server level without realizing it, even when robots.txt allows them.
Step 2 — Get indexed in Bing, not just Google
ChatGPT search draws on Bing's index, so if Bing doesn't know your page exists, ChatGPT often won't either. Most site owners only ever set up Google Search Console. Fix that in ten minutes:
- Sign up for Bing Webmaster Tools (you can import your site straight from Google Search Console).
- Submit your
sitemap.xml. - Turn on IndexNow (many hosts and plugins support it) so new and updated pages are pushed to Bing instantly.
- Use the URL Inspection tool to confirm your key pages are indexed.
Step 3 — Put your content in plain HTML
AI crawlers generally read the raw HTML your server sends — OAI-SearchBot, for example, doesn't run JavaScript. If your text only appears after JavaScript loads (common with some page builders and single-page apps), the crawler may see an empty page. Check by viewing the page source (Ctrl+U) — if your main text isn't in there, fix the rendering before anything else. Static or server-rendered pages are the safest choice.
Step 4 — Write answers an AI can lift
AI tools cite passages, not pages — so every section should contain a clean, self-contained answer. The pattern I use on every article (including this one):
- Question-shaped headings that match how people ask ("How much does X cost?", "What is Y?").
- Answer in the first sentence under the heading, in bold if it's the key point. Then explain.
- Tables for comparisons and numbered lists for steps — both are easy for AI to extract.
- Define terms the first time you use them. AI favors passages that make sense on their own.
Step 5 — Add evidence: statistics, quotes, and sources
Specific facts and cited sources make your content more likely to appear in AI answers. The original research on Generative Engine Optimization (Aggarwal et al., KDD 2024) found that adding citations, quotations, and statistics boosted a page's visibility in AI-generated answers by up to 40%, and by up to 37% when tested on Perplexity itself. Results varied by topic, but the direction was clear: vague content loses to specific content.
In practice: replace "we get great results" with "648+ qualified leads at $4–$5 each". Link to your sources. Quote real experts or clients. Add dates to your numbers. (I go deeper on this in What is Generative Engine Optimization (GEO)?)
Step 6 — Earn mentions on sites AI already trusts
AI tools judge credibility partly by whether other trusted sources mention you. A brand that only talks about itself on its own website is a weak source. Build presence where AI looks:
- Industry roundups and "best of" lists — pitch to be included.
- Guest posts, podcasts, and interviews on respected sites in your niche.
- Reddit, Quora, and LinkedIn — genuinely helpful answers that mention your expertise get crawled and cited.
- Directories and review platforms (Clutch, G2, Google Business Profile) with consistent name and details.
- Consistent entity info: same name, title, and description everywhere, linked together with
sameAsin your schema.
Step 7 — Keep it fresh
AI answer engines favor current information, and Perplexity in particular leans toward recent pages. Pick your 5–10 most important pages and refresh them every 90 days: update numbers and examples, add anything new, and change the visible "last updated" date and the dateModified in your Article schema. A page that still says "2024" usually loses to one that says "2026".
Step 8 — Track your AI citations
You can't improve what you don't measure — and AI citations change month to month. A simple tracking routine:
- List 10–20 questions your ideal customers would ask an AI.
- Ask them monthly in ChatGPT (with search on) and Perplexity. Log whether you're cited, in what position, and which page.
- Check referral traffic in your analytics from
chatgpt.comandperplexity.ai— ChatGPT often addsutm_source=chatgpt.comto its links, which makes it easy to spot. - Note which competitors get cited instead of you, and study what their pages do better.
| Question asked | ChatGPT | Perplexity | Page cited |
|---|---|---|---|
| "Best [your service] for [your niche]" | Yes / No (position) | Yes / No (position) | yoursite.com/page |
| "How do I [problem you solve]?" | Yes / No (position) | Yes / No (position) | yoursite.com/page |
Example tracking sheet layout — fill it with your own questions and results.
Common mistakes to avoid
| Don't | Do |
|---|---|
| Block OAI-SearchBot while trying to block "AI training" | Block GPTBot if you want; keep OAI-SearchBot allowed |
| Only set up Google Search Console | Add Bing Webmaster Tools + IndexNow |
| Hide content behind JavaScript | Serve your main text in the HTML |
| Write vague, generic claims | Use specific numbers, quotes, and sources |
| Rely on llms.txt as a shortcut | Focus on crawlability, content, and mentions |
Key takeaways
- Three gates: reach (crawlers + indexing), use (clear content), trust (evidence + mentions).
- OAI-SearchBot and Bing are the keys to ChatGPT search; PerplexityBot to Perplexity.
- Specific facts, statistics, and sources measurably raise your chance of being cited.
- Refresh key pages every 90 days and track citations monthly.
Frequently asked questions
How does ChatGPT decide which websites to cite?
When ChatGPT searches the web, it retrieves pages through OpenAI's own crawler (OAI-SearchBot) and search partners such as Bing, then cites the pages that answer the question most clearly and credibly. Pages that are crawlable, directly answer the question, include specific facts and sources, and are mentioned by other trusted sites are the most likely to be cited.
Does blocking GPTBot remove my site from ChatGPT search?
No. GPTBot collects content for training OpenAI's models. ChatGPT search uses a separate crawler, OAI-SearchBot. You can block GPTBot and still appear in ChatGPT search, but blocking OAI-SearchBot removes you from ChatGPT search answers.
How long does it take to get cited by ChatGPT or Perplexity?
It varies, but new or updated pages often take several weeks to start appearing in AI answers, after they've been crawled and indexed. Perplexity tends to pick up fresh content faster than ChatGPT. Keep pages updated and track your target questions monthly.
Do I need an llms.txt file to get cited by AI?
No. llms.txt is an optional proposal, not a standard that ChatGPT, Perplexity, or Google require. It doesn't hurt to add one, but crawler access, indexing, clear content, and third-party mentions matter far more.
