pikespeakmarathon.org
robots.txt

Robots Exclusion Standard data for pikespeakmarathon.org

Resource Scan

Scan Details

Site Domain pikespeakmarathon.org
Base Domain pikespeakmarathon.org
Scan Status Ok
Last Scan2024-10-20T19:19:33+00:00
Next Scan 2024-11-19T19:19:33+00:00

Last Scan

Scanned2024-10-20T19:19:33+00:00
URL https://pikespeakmarathon.org/robots.txt
Redirect https://www.pikespeakmarathon.org/robots.txt
Redirect Domain www.pikespeakmarathon.org
Redirect Base pikespeakmarathon.org
Domain IPs 104.21.29.92, 172.67.148.183, 2606:4700:3030::6815:1d5c, 2606:4700:3030::ac43:94b7
Redirect IPs 104.21.29.92, 172.67.148.183, 2606:4700:3030::6815:1d5c, 2606:4700:3030::ac43:94b7
Response IP 172.67.148.183
Found Yes
Hash 195abfc6425678c58cc097357a3b6d4b7476f30e42133ea4bf94e432c422621f
SimHash 91548c372bd3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /slider-home.html
Disallow /lightning-strike.html
Disallow /registration.html
Disallow /new-for-2022.html
Disallow /press-releases.html
Disallow /race-info.html
Disallow /elite-competitors.html
Disallow /plan.html
Disallow /2021-results--photos.html
Disallow /get-involved.html
Disallow /awards--prize-money.html
Disallow /covid-2021.html
Disallow /news.html
Disallow /covid-info.html
Disallow /confirmation-lists.html
Disallow /404.html
Disallow /thank-you.html
Disallow /page-template.html
Disallow /website-notes.html
Disallow /playground.html

Other Records

Field Value
sitemap https://www.pikespeakmarathon.org/sitemap.xml