LLMention
← All 40 checksAI Crawler Access

Homepage is marked noindex

One of 40 checks the scanner runs. This one is worth 2 points inside the AI Crawler Access dimension, which carries 16% of the total score.

Browse sections

What does this check look at?

The homepage has no meta robots directive containing noindex.

The directive is read out of the served HTML and nowhere else, and the pattern expects the name attribute to come before the content attribute: `<meta name="robots" content="noindex">` fails this check while `<meta content="noindex" name="robots">` passes it. An X-Robots-Tag: noindex response header is not read at all, because response headers are not part of the document this check is given.

How do I fix it?

  1. Remove noindex from the homepage so it can be retrieved.

Why is it worth 2 points?

Points are relative weights inside a dimension, and a dimension's weight decides how much of the total it can move. The reasoning for this dimension's weight is published rather than asserted:

DimensionAI Crawler Access — 16% of the total score
Points for this check2 of 23 in this dimension
Worth at most1.4 of the 100 points

Highest weight of the twelve. A page that is blocked or unreadable has no path to being cited, so it dominates the total.

Which dimension does this belong to?

AI Crawler Access — 16% of the total score, decided by 7 published rules.

If a crawler cannot read the page, nothing else on this list can matter. This is the only dimension where a failure makes the rest of the score moot.

None of the five guides covers this rule, which is why this page shows the fix in full rather than pointing at one.

What else is measured in this dimension?

How do I see my own result?

Run a scan on your own domain. The report lists every failed check with the evidence that produced it, so you can tell a real failure from a check that does not apply.

Run a free GEO audit on your own site →

The full method, including the dimensions that are deliberately weighted low and the parts of a picture a single-URL scan cannot see, is on the methodology page.

Questions about this rule

What does this check look at?

The homepage has no meta robots directive containing noindex.

Why does this dimension carry 16% of the score?

A page that is blocked or unreadable has no path to being cited, so it dominates the total.

Evidence and sources

GEO can boost visibility by up to 40% overall in generative engine responses, and in the paper's Table 1 the best of the tested methods improve on the no-optimization baseline by 41% and 28%. — Generative Engine Optimization, KDD 2024

This rule is applied by the scanner and published in the rule set it is read from, so the condition on this page is the condition the scan tests rather than a summary of it.

Primary sources