findtherun.com
robots.txt

Robots Exclusion Standard data for findtherun.com

Resource Scan

Scan Details

Site Domain findtherun.com
Base Domain findtherun.com
Scan Status Ok
Last Scan2024-11-03T13:10:59+00:00
Next Scan 2024-12-03T13:10:59+00:00

Last Scan

Scanned2024-11-03T13:10:59+00:00
URL https://findtherun.com/robots.txt
Redirect https://www.findtherun.com/robots.txt
Redirect Domain www.findtherun.com
Redirect Base findtherun.com
Domain IPs 216.24.57.1
Redirect IPs 216.24.57.252, 216.24.57.4
Response IP 216.24.57.252
Found Yes
Hash 7fe29396c4701afe99ad88840bd4cf7a959a9c8891a1050979f19cb4aecbd339
SimHash 6808de3282f3

Groups

*

Rule Path
Allow /
Disallow /privacy
Disallow /terms-of-service

meta-externalagent

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.findtherun.com/sitemap.xml