signup.com
robots.txt

Robots Exclusion Standard data for signup.com

Resource Scan

Scan Details

Site Domain signup.com
Base Domain signup.com
Scan Status Ok
Last Scan2024-04-24T04:29:43+00:00
Next Scan 2024-05-01T04:29:43+00:00

Last Scan

Scanned2024-04-24T04:29:43+00:00
URL https://signup.com/robots.txt
Domain IPs 18.213.14.125, 54.92.229.71
Response IP 18.213.14.125
Found Yes
Hash 4faed9fcefffc6eb4978b84160f66db830f7dbe3023b1ac71f759ffa5bb2c99c
SimHash e8112b06e264

Groups

*

Rule Path
Disallow /signup/
Disallow /activity/
Disallow /main/
Disallow /admin/
Disallow /payment
Disallow /Dashboard

Other Records

Field Value
crawl-delay 5

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • this is for these wonderful people opensiteexplorer.org/dotbot; help@moz.com