bgme.me
robots.txt

Robots Exclusion Standard data for bgme.me

Resource Scan

Scan Details

Site Domain bgme.me
Base Domain bgme.me
Scan Status Ok
Last Scan2024-09-30T23:41:50+00:00
Next Scan 2024-10-01T23:41:50+00:00

Last Scan

Scanned2024-09-30T23:41:50+00:00
URL https://bgme.me/robots.txt
Domain IPs 23.88.105.145, 2a01:4f8:c0c:cdc1::1
Response IP 23.88.105.145
Found Yes
Hash d7521b176ff84abe1bc02d61b456deb8ddd232e46b8fa49886cb347d6ed20838
SimHash 8a549b857763

Groups

archive.org_bot

Rule Path
Disallow /media_proxy/
Disallow /interact/

*

Rule Path
Disallow /
Disallow /media_proxy/
Disallow /interact/

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file