AI Crawler User‑Agents and robots.txt

Reference matrix for allowing AI crawlers via robots.txt and sitemaps.