merveilles.town
robots.txt

Robots Exclusion Standard data for merveilles.town

Resource Scan

Scan Details

Site Domain merveilles.town
Base Domain merveilles.town
Scan Status Ok
Last Scan2024-10-02T09:32:06+00:00
Next Scan 2024-10-03T09:32:06+00:00

Last Scan

Scanned2024-10-02T09:32:06+00:00
URL https://merveilles.town/robots.txt
Domain IPs 134.122.91.198, 2a03:b0c0:3:f0::75:9000
Response IP 134.122.91.198
Found Yes
Hash ffb72210f45aaea641801a71cbebb735aa45d6c040670fd7849055cb4941a0b9
SimHash aa749b85f362

Groups

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow /media_proxy/
Disallow /interact/

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file