bgme.bid
robots.txt

Robots Exclusion Standard data for bgme.bid

Resource Scan

Scan Details

Site Domain bgme.bid
Base Domain bgme.bid
Scan Status Ok
Last Scan2024-10-01T23:44:52+00:00
Next Scan 2024-10-02T23:44:52+00:00

Last Scan

Scanned2024-10-01T23:44:52+00:00
URL https://bgme.bid/robots.txt
Domain IPs 2406:da14:ab7:cd00:fff6:68fc:86cc:80ce, 57.181.166.2
Response IP 57.181.166.2
Found Yes
Hash d7521b176ff84abe1bc02d61b456deb8ddd232e46b8fa49886cb347d6ed20838
SimHash 8a549b857763

Groups

archive.org_bot

Rule Path
Disallow /media_proxy/
Disallow /interact/

*

Rule Path
Disallow /
Disallow /media_proxy/
Disallow /interact/

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file