# Robots.txt for paint-vault.com # Crawlers légitimes User-agent: Googlebot User-agent: Bingbot User-agent: Slurp User-agent: DuckDuckBot Disallow: /api/ Disallow: /go/ Disallow: /lang/ Disallow: /*?*sort= Disallow: /*?*page= # AI / data-harvesting crawlers - no training on the database User-agent: GPTBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: anthropic-ai User-agent: CCBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: meta-externalagent User-agent: PerplexityBot User-agent: Omgilibot User-agent: Diffbot User-agent: Bytespider User-agent: Amazonbot Disallow: / # Commercial SEO / data harvesters - no crawl, no extraction User-agent: SemrushBot User-agent: AhrefsBot User-agent: dotbot User-agent: rogerbot User-agent: MJ12bot User-agent: DataForSeoBot User-agent: PetalBot User-agent: YandexBot User-agent: SeekportBot User-agent: BLEXBot Disallow: / # Tous les autres crawlers User-agent: * Crawl-delay: 10 Disallow: /api/ Disallow: /go/ Disallow: /lang/ Disallow: /*?*sort= Disallow: /*?*page= # Sitemaps Sitemap: https://www.paint-vault.com/sitemap.xml Sitemap: https://www.paint-vault.com/games/sitemap.xml