# alotoftools.com — allow all crawlers across all content User-agent: * Allow: / # Block Next.js internals, server APIs and non-content utility routes. # (robots.txt paths must be site-relative; the cms.alotoftools.com subdomain # is controlled by its own robots.txt, not this file.) Disallow: /api/ Disallow: /_next/ Disallow: /admin/ Disallow: /embed/ # Explicitly welcome AI / answer-engine crawlers (ChatGPT and other LLM # referrals already send real traffic). Same content rules as everyone else. User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: PerplexityBot User-agent: Google-Extended User-agent: CCBot Allow: / Disallow: /api/ Disallow: /_next/ Disallow: /admin/ Disallow: /embed/ # Sitemap location Sitemap: https://alotoftools.com/sitemap.xml