astro.rtl.fr
robots.txt

Robots Exclusion Standard data for astro.rtl.fr

Resource Scan

Scan Details

Site Domain astro.rtl.fr
Base Domain rtl.fr
Scan Status Ok
Last Scan2025-09-15T16:38:08+00:00
Next Scan 2025-09-29T16:38:08+00:00

Last Scan

Scanned2025-09-15T16:38:08+00:00
URL https://astro.rtl.fr/robots.txt
Domain IPs 185.151.191.59, 2a0a:1580:2000:4f00::14
Response IP 185.151.191.59
Found Yes
Hash c4990594d1889ffb7aa1763dbc334afd736c090f4d116c992d5b6140af9b89fd
SimHash 38bcd822d177

Groups

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Comments

  • Disable OpenAI bots
  • Disable Google AI bot