rootsweb.com
robots.txt

Robots Exclusion Standard data for rootsweb.com

Resource Scan

Scan Details

Site Domain rootsweb.com
Base Domain rootsweb.com
Scan Status Ok
Last Scan2024-11-13T19:50:55+00:00
Next Scan 2024-11-20T19:50:55+00:00

Last Scan

Scanned2024-11-13T19:50:55+00:00
URL https://rootsweb.com/robots.txt
Domain IPs 104.18.0.50, 104.18.1.50
Response IP 104.18.1.50
Found Yes
Hash cc1211bb998820695423682a97d6cba95af2a076e06a9ff32c0ef5065c6c5111
SimHash ee1c98f0e3e2

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

freefind

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5