annales2maths.com
robots.txt

Robots Exclusion Standard data for annales2maths.com

Resource Scan

Scan Details

Site Domain annales2maths.com
Base Domain annales2maths.com
Scan Status Ok
Last Scan2025-12-27T03:51:04+00:00
Next Scan 2026-01-03T03:51:04+00:00

Last Scan

Scanned2025-12-27T03:51:04+00:00
URL https://annales2maths.com/robots.txt
Domain IPs 104.21.12.214, 172.67.167.184
Response IP 172.67.167.184
Found Yes
Hash 681837872c7e3c2f9d20e0297cef3fdbd09b15b664fcc5c5977210dea1c9d317
SimHash 4b30d8c8a633

Groups

*

Rule Path Comment
Disallow /wp-admin/ -
Disallow /wp-includes/ -
Disallow /wp-content/plugins/ -
Disallow /wp-content/themes/ -
Disallow /wp-login.php -
Disallow /xmlrpc.php -
Disallow /*? -
Disallow /?s= empêche l'indexation des pages de recherche WordPress
Disallow /feed/ -
Disallow /comments/feed/ -
Disallow /trackback/ -
Disallow */trackback/ -
Disallow /*/feed/$ -
Disallow /*/comments/feed/$ -
Disallow /category/*/* -
Disallow /comments/ -
Disallow /cgi-bin/ -
Allow /wp-content/uploads/ -

Other Records

Field Value Comment
crawl-delay 10 limite le nombre de requêtes pour les bots standards

googlebot-ads

Rule Path
Allow /ads.txt

googlebot

Rule Path
Disallow
Allow /

mediapartners-google

Rule Path
Disallow
Allow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.annales2maths.com/sitemap_index.xml

Comments

  • User-Agent: * (S'applique à tous les robots)
  • Spécifique pour Google AdSense (s'assure que Google peut lire ads.txt pour la diffusion d'annonces)
  • Autoriser Googlebot et Google AdSense
  • Interdiction explicite de certains bots connus pour scraper massivement
  • Déclaration de votre Sitemaps (très important pour le SEO)