How to Rank Higher in ChatGPT Search

The 10-step checklist

Do these in order. Steps 1 to 5 decide whether ChatGPT's search system can read your site. Steps 6 to 10 improve what it finds and show whether anything changed.

1. Read your robots.txt. Open yoursite.com/robots.txt and search for OAI-SearchBot and for a blanket User-agent: * with Disallow: /. A staging rule left on a live site can make the whole site invisible to crawlers.
2. Allow OAI-SearchBot. OpenAI documents it as the agent used to surface sites in ChatGPT's search features, and robots.txt applies to it. Sites that opt out do not appear in ChatGPT search answers, though they can still appear as plain navigational links.
3. Check your firewall and CDN. Bot protection can block a crawler that robots.txt allows. OpenAI recommends allowing OAI-SearchBot and requests from the IP ranges it publishes for that agent.
4. Decide on GPTBot separately. It collects content that may be used for training. Allowing or blocking it does not change search eligibility, because the settings are independent.
5. Wait about 24 hours. OpenAI says robots.txt changes can take about that long to affect search results.
6. Make key pages plain and public. They should return a normal response, need no login and carry their text in the HTML, not only in scripts.
7. Put the answer first. Open each section with its answer and a specific figure or condition, as explained in what is answer engine optimization.
8. Verify in your logs. Look for OAI-SearchBot requests. A user-agent string can be faked, so match IP addresses to the list OpenAI publishes before you trust it.
9. Test with real questions. Ask ChatGPT five questions your buyers use, with search on, and record whether you are named or linked. Repeat each three times.
10. Watch referrals. In June 2025 SEO consultant Glenn Gabe reported that links in ChatGPT's "More" section had started to carry utm_source=chatgpt; OpenAI had not documented it at that time. Confirm it in your own GA4 data.

A minimal robots.txt for the common case

If you want search visibility and do not want your content used for training:

User-agent: OAI-SearchBot
Allow: /

User-agent: GPTBot
Disallow: /

If you are happy with both, you need no rule at all, because crawling is allowed by default. Remember that ChatGPT-User handles user-requested visits, and OpenAI says robots.txt rules may not apply to it.

How to check your logs for the search bot

Your host or CDN keeps a record of every request. Ask your developer or host for a log export covering the last 14 days, then search it for the bot's name.

• What to look for. Lines where the user agent contains OAI-SearchBot, with the requested path and a status code of 200.
• What the status codes mean. A 200 means the page was served. A 403 or 429 means something is blocking or throttling it. A 301 chain to a login page means the content is gated.
• How to confirm it is genuine. A user agent can be copied by anyone. OpenAI publishes IP address lists for each of its agents, so compare the source addresses with the OAI-SearchBot list before you trust a line.
• How often to expect it. OpenAI gives no schedule. A single visit in two weeks does not mean you are being ignored, and no visits at all after a month with access open is worth a second look at your firewall.

If you cannot get logs, ask your host whether bot protection is on and which bots it blocks. Then check whether that tool lets you allow a named bot and an IP range, because the settings differ from product to product.

Symptoms and likely causes

Mistakes we would check first

• Blocking "AI bots" in one stroke. A single security setting that blocks all of them can remove you from search features you wanted.
• A leftover Disallow from staging. Compare your live robots.txt with the version your developer uses.
• Content behind a script. If the main text only appears after scripts run, a crawler may see an empty page.
• Several versions of the same page. Duplicate addresses dilute what a crawler can use. Pick one canonical address per page.
• Reading a bot's absence as a verdict. A crawler not visiting for a few days after a change is normal.

What the checklist will not do

It makes you eligible, which is the necessary part. OpenAI documents no formula for who is shown, and no promise to show any site that allows its crawler. Selection depends on systems you cannot see. Nobody can guarantee a citation or a position, and that applies to any agency that says otherwise.

If you want the wider strategy, including how model memory differs from search, read how to rank in ChatGPT. The LLM SEO explainer shows the other bots by company. For the audit done with you, our AI search optimization service includes this access check. Start with step 1 today and keep a copy of your old robots.txt before you change it.