VercatusGet started
Grade AR-017Access and crawlers

When ChatGPT may show a blocked URL as a navigation link

OpenAI's publisher FAQ (updated 2026) says a page disallowed for OAI-SearchBot can still appear as a bare link and page title when OpenAI learns its URL from a third-party search provider or from links on other pages and judges it relevant (the FAQ also named ChatGPT Atlas, which OpenAI has since deprecated, with a shutdown date of 9 August 2026); to prevent that, the page needs a noindex robots meta tag, which OAI-SearchBot can only read if robots.txt lets it crawl the page. Summaries and snippets require OAI-SearchBot access, and ChatGPT adds utm_source=chatgpt.com to referral URLs.

Sources

  1. 1
    OpenAI Help Center · 2026Publishers and Developers FAQhelp.openai.com
  2. 2
    OpenAI · 2026Overview of OpenAI crawlersdevelopers.openai.com

AGrade A: official documentation or a standard. A grade describes the provenance of the sources above; it is not a probability that a change will work. The effect basis says how the size of the effect is known: measured by a study, taken from an industry report, only documented without a size, or not quantified.

Put this evidence to work

Related entries