What this page establishes
- AI answer engines assemble responses from passages of 74-148 words, not from whole pages, so the unit worth optimizing is the paragraph, not the article.
- The Princeton GEO study (ACM SIGKDD 2024, arXiv:2311.09735), testing roughly 10,000 queries across 9 datasets, found statistics moved AI visibility by up to 41% while keyword stuffing produced no benefit.
- Passages carrying 3 or more named entities or measurable facts per 100 words are cited at roughly 2.4 times the rate of vaguer prose, according to 2026 passage-retrieval research.
- Most AI crawlers — GPTBot, ClaudeBot, PerplexityBot — do not execute JavaScript, so a page rendered only client-side is invisible to them regardless of how well the content itself is written.
- robots.txt must explicitly allow the specific crawler user-agents AI companies publish; a generic Allow: / does not guarantee a named bot is welcome if a more specific rule blocks it elsewhere in the file.
- The clip test — can this paragraph be quoted verbatim with zero surrounding context and still make sense — is the single fastest way to audit existing content for citation readiness.
- llms.txt, a proposed but not yet universally adopted convention, offers a structured summary for AI crawlers; it supplements a page's actual HTML rather than replacing the requirement that the HTML itself be readable.
The passage is the unit of competition, not the page
Traditional SEO optimizes the page: title tag, meta description, heading structure, backlinks pointing at one URL. AI answer engines work differently at retrieval time — they break candidate pages into passages, score each passage independently against the query, and assemble an answer from the highest-scoring passages across potentially several different pages. A page can rank well in traditional search and still contribute nothing to an AI answer if none of its individual passages score well on their own.
This changes what "good content" means in practice. A 2,000-word article with a strong overall argument but no single self-contained paragraph is optimized for a human reading start to finish, not for a retrieval system pulling one passage out of context. 2026 research on passage-level retrieval found that cited passages typically run 74 to 148 words — short enough to be a tight paragraph, long enough to carry a complete thought.
The practical shift is writing each section to stand alone. A reader arriving at any single paragraph via an AI-generated citation, with zero surrounding context, should be able to understand the claim, its evidence, and its source from that paragraph alone.
Crawler access is the precondition nothing else matters without
None of the writing advice below helps if the crawler cannot read the page. Most AI crawlers — OpenAI's GPTBot and OAI-SearchBot, Anthropic's ClaudeBot, Perplexity's PerplexityBot — do not execute JavaScript, which means a single-page application that renders its content client-side is invisible to them even though it looks completely normal in a browser.
robots.txt is the second gate. Allowing crawlers requires explicitly naming the specific user-agents AI companies publish — GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, PerplexityBot, Perplexity-User, Google-Extended, CCBot, Applebot-Extended — because a generic User-agent: * / Allow: / can still be overridden by a more specific, more restrictive rule elsewhere in the same file, and default configurations in several popular platforms and firewalls block AI crawlers by default.
The clip test: auditing existing content for citation readiness
The fastest way to find weak passages in existing content is to isolate each paragraph and ask whether it would survive being quoted alone, with no surrounding sentences, no heading above it, and no article title for context. A paragraph that opens with "This approach works well" fails immediately — "this" refers to something in a previous sentence the retrieval system may never surface.
Running this audit prompt across an article's existing paragraphs before rewriting surfaces exactly which passages are actually eligible for citation today and which ones need restructuring, rather than rewriting the whole piece uniformly when only some sections are the problem.
Rewriting a passage to pass the clip test
Once a weak passage is identified, the rewrite has four concrete moves: state the answer in the first sentence, name the subject explicitly instead of using a pronoun, attach a specific fact with its source, and keep the whole passage under roughly 150 words so it reads as one complete, quotable unit.
The source material requirement is not optional for any paragraph carrying a number — without it, the rewrite optimizes for the shape of a citable passage while potentially introducing a fabricated fact, which defeats the purpose entirely.
Named facts per 100 words: the density research actually measured
2026 passage-retrieval research found that a passage naming 3 or more entities or measurable facts — organizations, dates, percentages, dollar amounts, product names, statutes — for every 100 words gets pulled into AI answers roughly 2.4 times as often as passages running thinner on specifics. This is a measurable, checkable property of a paragraph, unlike vaguer advice to "add credibility."
Note the constraint built into that last instruction: facts come from the supplied source material only. Asking a model to "add more facts" without a source attached is a direct invitation to invention, and a paragraph optimized for fact density with fabricated facts is worse than the original, unoptimized version.
Two-word phrases such as "significant improvement" or "many users" are the specific pattern worth searching a draft for before publishing, since both fail the density check and the honesty check simultaneously — they read as if they are conveying information while conveying none. Replacing "significant improvement" with an actual percentage and its source fixes both problems in one edit.
Headings as retrieval targets: write them as answers, not labels
An H2 heading functions as a signal to both traditional search crawlers and AI retrieval systems about what the section beneath it answers. A heading reading "More Information" or "Overview" carries no retrieval signal; a heading reading "How much does a Google Ads disapproval delay a campaign launch" tells a retrieval system exactly what question the section answers, in language close to how a person might actually ask it.
This is a low-cost, high-frequency fix: most sites have a handful of generic headings scattered through otherwise reasonable content, and correcting just those often meaningfully improves how a page maps to real queries without touching the body copy at all.
Structured data helps machines parse what a passage claims
FAQPage, Article, and HowTo schema markup do not directly cause AI citation, but they give crawlers an unambiguous, machine-readable signal about what a page's question-and-answer pairs actually are, reducing the chance of misinterpretation during the parsing stage that precedes retrieval scoring.
As with SEO schema generation generally, validate the output in Google's Rich Results Test afterward rather than trusting it by inspection — malformed JSON-LD fails silently for both traditional search and AI crawlers alike.
llms.txt: a supplement, not a substitute for readable HTML
llms.txt is a proposed convention — a plain-text file at a site's root offering a structured summary of the site's content for AI systems to reference. It is not yet a universally adopted standard the way robots.txt or sitemap.xml are, and no major AI company has publicly committed to treating it as authoritative in the way search engines treat a sitemap. Publishing one is low-cost and plausible-upside; it should never be treated as a replacement for making the actual page HTML readable and well-structured, which remains the requirement that does the real work.
Treat this as a genuinely optional addition rather than a priority — the crawler-access and passage-quality work above accounts for the overwhelming majority of whether a page gets cited, and llms.txt is a small, speculative bet layered on top of that foundation.
A related but distinct signal is Google's Search Generative Experience and AI Overviews, which currently draw primarily from the standard organic search index rather than a separate crawler or file — meaning conventional technical SEO (crawlability, indexability, structured data) already governs eligibility there more directly than any AI-specific convention does. The overlap between "good for AI Overviews" and "good for traditional SEO" is therefore substantial, even though the passage-level writing advice above still applies on top of that baseline.
Citations and quotations: the second- and third-strongest levers measured
Alongside statistics at +41%, the Princeton GEO study found that citing authoritative sources and including quotations from named experts both produced large positive effects on AI-assisted search visibility, with subjective impression — how favorably content was rated by the underlying evaluation — rising by up to 37% from position-adjusted improvements in these categories.
The instruction to flag rather than fabricate is the load-bearing part of this prompt. Citations are a genuine, evidence-backed lever for AI visibility, and a fabricated citation is also the fastest way to publish content that damages credibility the moment anyone checks it, which some readers and increasingly some AI systems themselves are beginning to do.
What GEO does not change: the underlying quality bar
Nothing in this research suggests a shortcut around writing genuinely useful, accurate content. The Princeton GEO study's clearest negative finding — that keyword stuffing produced no benefit whatsoever across roughly 10,000 tested queries — is a direct rebuttal to the idea that AI search visibility can be gamed through volume or repetition the way early-2000s search engine manipulation sometimes worked.
The practices that move AI visibility — specific statistics with sources, real citations, named-expert quotations, self-contained passages — are largely the same practices that make content genuinely useful to a human reader. GEO is less a separate discipline than an intensified, more mechanically checkable version of the writing quality that has always mattered, applied with specific attention to how retrieval systems currently work.
One measurable difference from traditional SEO writing advice: AI retrieval systems appear less tolerant of filler transitions and throat-clearing openers than human readers skimming for a heading, because a retrieval system scoring a passage against a query gains nothing from a sentence like "in this section, we'll explore" — it is pure overhead relative to the query match. Cutting these openers is a small, mechanical edit with an outsized effect on how tightly a passage maps to a specific question.
Brand mentions without a link still carry signal
AI answer engines sometimes mention a brand or reference a company's data without generating a clickable citation link, particularly in conversational interfaces like ChatGPT where the underlying sourcing is less visible than in a search-style interface like Perplexity or Google's AI Overviews. This does not mean the mention carries no value — brand recall from an AI-generated answer can influence a person's subsequent direct search or purchase decision even without a traceable click.
This audit is manual rather than promptable in the sense of automating the search itself, since it requires actually running queries against live AI products rather than asking a model to predict what it would say — the value is in observing real current behavior, not simulated behavior.
Track this quarterly rather than once. AI product behavior changes as underlying models update, as retrieval sources shift, and as competitors publish new content that outranks or out-cites what previously worked — a snapshot taken once and never revisited goes stale the same way an unmonitored keyword ranking does.
A verification pass for a page you want AI search to cite
Five checks, applied to a finished page. First, confirm server-side rendering with the GPTBot curl test above. Second, confirm robots.txt explicitly names the AI crawlers you want reading the page. Third, run the clip test on the 3-4 most important paragraphs — the ones most likely to answer a real query directly. Fourth, count named facts per 100 words in those same paragraphs, adding real, sourced specifics where density is low. Fifth, validate any FAQPage or Article schema in Google's Rich Results Test.
None of these checks require special tooling beyond a terminal, a browser, and the AI tool doing the drafting — the barrier to doing this work is mostly a matter of building it into a regular publishing checklist rather than treating it as a one-time audit.
A complete example: before and after on a real passage
Original passage, written for a human reader with full article context, which fails the clip test:
Rewritten to name the subject, state a fact with its source, and stand alone:
The rewrite states the claim in the first sentence, names the subject ("missed calls," not "it"), attaches a specific figure with a source category the model should be told to fill with a real citation rather than invent, and closes with an actionable, self-contained point — the shape 2026 passage-retrieval research associates with a meaningfully higher citation rate.
Quick answers
What is GEO and how is it different from SEO?
GEO, generative engine optimization, targets visibility in AI-generated answers rather than in a ranked list of blue links. The core difference is unit of competition: SEO optimizes the page, GEO optimizes the passage, since AI answer engines retrieve and cite individual paragraphs rather than whole articles. Many underlying practices — real statistics, clear structure, authoritative sources — help both.
Why isn't my content showing up in ChatGPT or Perplexity answers?
Check crawler access first: most AI crawlers do not execute JavaScript, so a page rendered only client-side is invisible regardless of content quality. Run curl with a GPTBot user-agent against your page and check whether real content returns. If access is confirmed, the next most common cause is passages that fail the clip test — too dependent on surrounding context to quote alone.
How long should a passage be to get cited by AI search?
74 to 148 words, based on 2026 passage-retrieval research on what cited passages typically measure. This maps roughly to one solid paragraph — long enough to state a claim and its evidence, short enough to be lifted whole into an answer without needing surrounding context to make sense.
Does adding statistics really help AI search visibility?
Yes, measurably — the Princeton GEO study (ACM SIGKDD 2024) found statistics moved visibility by up to 41% across roughly 10,000 tested queries, the single strongest lever the study measured. The statistic must be real and sourced; fabricating one to chase this effect defeats the purpose and creates a credibility risk.
Should I publish an llms.txt file?
It is low-cost and plausibly useful, but it is a proposed convention, not yet a universally adopted standard the way robots.txt is, and no major AI company has committed to treating it as authoritative. Publish one if time allows, but treat readable, well-structured page HTML as the priority that does the actual work.
Does keyword stuffing help get cited by AI search engines?
No — the Princeton GEO study found keyword stuffing produced no measurable benefit in AI visibility across roughly 10,000 queries tested. Repeating a keyword phrase does not increase fact density or passage self-containment, the properties that actually correlate with citation, so it is wasted effort that can also make prose read worse to a human.
Frequently asked questions
Which AI crawlers should I explicitly allow in robots.txt?
At minimum, GPTBot and OAI-SearchBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot (Perplexity), and Google-Extended (Google's AI training and Gemini access, separate from the standard Googlebot that handles traditional search indexing). Also worth including: CCBot (Common Crawl, which several AI systems train on), Applebot-Extended (Apple Intelligence), and Amazonbot. Each of these crawlers has a specific, documented user-agent string, and a robots.txt entry needs to name it exactly — a typo in the user-agent string means the rule silently does not apply to that crawler. Review the list periodically, since new AI crawlers have launched at a steady pace and the landscape is still young enough that comprehensive lists from a year ago are already missing recent entrants.
Is there a way to verify my content is actually being cited by AI search?
Verification is harder than it should be, because most AI answer engines do not publish citation logs the way Google Search Console reports impressions and clicks for traditional search. The closest available signals are manual spot-checks — running real queries related to your content through ChatGPT search, Perplexity, and Google's AI Overviews, and noting whether your site appears among the cited sources — plus emerging third-party tools that attempt to track AI citation patterns, though these tools vary in reliability and none has the authority of a first-party analytics platform. Referral traffic from AI platforms, where trackable in your web analytics, is a lagging but real indicator: an uptick in sessions arriving from chat.openai.com or perplexity.ai referral sources suggests citations are happening even without a direct citation log to confirm it.
Does having a large, well-established website help with AI citation the way domain authority helps traditional SEO?
Domain-level authority likely plays some role, since retrieval systems draw on training data and live retrieval that both correlate with a site's overall prominence and trustworthiness signals, similar in spirit to how traditional search weighs domain authority alongside individual page quality. But the Princeton GEO study's central finding was that page-level content changes moved visibility substantially — 22 to 41% depending on the method — which means even a smaller or newer site has real, measurable levers available at the individual-page level rather than needing to wait years to build the kind of domain authority traditional SEO sometimes requires. The passage-level nature of AI retrieval may actually favor smaller, highly specific sites in some cases, since a narrowly focused page with excellent passage structure competes directly against a broader authority site's less carefully structured section on the same narrow topic.
How is writing for AI search different from writing a good FAQ page?
A well-written FAQ page already does much of what GEO asks for — a direct question as the heading, a self-contained answer beneath it, ideally with a specific fact — which is part of why FAQPage schema and FAQ-formatted content perform reasonably well for AI citation without additional GEO-specific rework. The difference is that GEO principles apply to every passage on a page, not only to explicitly formatted Q&A sections. A blog post's body paragraphs, a product page's feature descriptions, and a landing page's benefit statements all benefit from the same self-containment and fact-density discipline that naturally shows up in a good FAQ, even though those sections are not formatted as questions and answers.
Will this advice go stale as AI search engines change their retrieval methods?
The specific passage-length range (74-148 words) and fact-density multiplier (roughly 2.4x) reflect research current as of 2026 and describe how today's retrieval-augmented systems work; retrieval architecture will keep evolving, and specific numbers may shift as models and retrieval pipelines change. What is unlikely to go stale is the underlying logic: crawler access remains a precondition regardless of retrieval method, and self-contained, specific, sourced writing serves human readers regardless of what technology surfaces it. Treat the specific numbers as the best current evidence and the underlying principles — accessibility, self-containment, specificity, sourcing — as the durable target to keep writing toward as the field develops.
Do I need to rewrite my entire site to be eligible for AI citation?
No — prioritize by traffic and intent rather than attempting a uniform rewrite. Start with pages that already answer a specific, well-defined question people search for, since these convert most efficiently into citable passages with the smallest editing effort. A page that is genuinely comprehensive but structured as one long undifferentiated argument needs more substantial restructuring than a page that already has clear subheadings and just needs individual paragraphs tightened to pass the clip test. A practical starting list: your most-visited how-to or explainer content, your FAQ pages, and any page already ranking on page one of traditional search for a question-shaped query, since these have already proven relevance and mainly need the passage-level polish described above rather than a ground-up rewrite.
Sources
- GEO: Generative Engine Optimization — Aggarwal et al., ACM SIGKDD, 2024.
- Overview of Google Crawlers and Fetchers — Google Search Central, 2025.
- GPTBot — OpenAI, 2025.
- Rich Results Test — Google Search Central, 2025.
Every figure on this page names its source and year in the sentence that uses it. Where no methodology was published, the claim is stated qualitatively instead of dressed up as data.
GEO and AEO get a full part of their own
Chapters 028 and 029 of the A-Z AI Prompt Encyclopedia cover generative search visibility and answer engine optimization in depth — 60 prompts built on the same evidence base as this page. Ebook $12.99, paperback $38.99.
Get the bookPublished 2026-09-19 · Last reviewed 2026-09-19 by Mark W. Lamplugh Jr., author of the A-Z AI Prompt Encyclopedia.