be.auctions.godaddy.com
robots.txt

Robots Exclusion Standard data for be.auctions.godaddy.com

Resource Scan

Scan Details

Site Domain be.auctions.godaddy.com
Base Domain godaddy.com
Scan Status Ok
Last Scan2024-05-07T23:07:23+00:00
Next Scan 2024-06-06T23:07:23+00:00

Last Scan

Scanned2024-05-07T23:07:23+00:00
URL https://be.auctions.godaddy.com/robots.txt
Domain IPs 23.52.171.208, 23.52.171.235
Response IP 23.52.171.208
Found Yes
Hash ae4f8204edf31ba4756143deea0477b08201967e32a54936fbd172537e751c4d
SimHash ad18dec083f3

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 60

fasterfox

Rule Path
Disallow /

Comments

  • robots.txt