AI crawler declaration matrix

Why it is checked

Checks whether you have declared rules for AI crawlers in robots.txt, split into search, user-access and training — so YOU decide how AI may use your content.

How it counts

Optional. Passing can add up to 4 bonus points; all optional items together are capped at 10. Not having it never lowers your base score.

How results read

The wording below is exactly what a report shows for each result.

• Passed

  In this check, your site looks good on this point — no action needed.

• Declared · incomplete

  In this check, we found something that weakens this signal. It is not fatal, but fixing it makes your site easier for AI answer engines to use — see the suggested steps below.

• Not found · optional

  In this check, we found no explicit AI-crawler declarations (or robots.txt was unavailable, so we cannot tell). Declaring them separately lets you allow AI search while restricting training — a blanket block may also reduce how often AI answers cite you. Optional capability — whether to add it depends on your site's purpose; it does not affect your base score.

• Couldn't verify

  We could not determine this item in this check — the available evidence is not enough to tell why. No conclusion is drawn either way.