1. Technical readiness
Can the AI crawlers get in (robots rules for GPTBot, ClaudeBot, PerplexityBot, Google‑Extended, and the firewall in front of them)? Is there an llms.txt summary, a sitemap, structured data that says what and where you are, a clear title, description and headline, a page that loads light?
- method
- deterministic crawl
- weight
- 40%