usa.run
robots.txt

Robots Exclusion Standard data for usa.run

Resource Scan

Scan Details

Site Domain usa.run
Base Domain usa.run
Scan Status Ok
Last Scan2025-04-12T23:26:02+00:00
Next Scan 2025-04-19T23:26:02+00:00

Last Scan

Scanned2025-04-12T23:26:02+00:00
URL https://usa.run/robots.txt
Domain IPs 104.21.29.98, 172.67.148.189, 2606:4700:3031::ac43:94bd, 2606:4700:3036::6815:1d62
Response IP 104.21.29.98
Found Yes
Hash cad67aedcc0fb84896a1cb3076e202cb7259e61f5a479c906ffc6c5a264c6938
SimHash c0088af4d8c0

Groups

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow RoadBlock.html
Disallow LinkClick.aspx
Disallow Error500.html
Disallow MeteredMessage.html
Disallow Merchandise.asp
Disallow /submit/race/*
Disallow /submit/club/*
Disallow /submit/request-a-recheck/*
Disallow /04/*
Disallow /05/*
Disallow /06/*
Disallow /07/*
Disallow /08/*
Disallow /crs/*
Disallow /HostedFlyer/*
Disallow /HostedRaces/*
Disallow /HostedResults/*.*
Disallow /Newsletter/*.*
Disallow /SleighBellRun/*.*
Disallow /applic03/*.*
Disallow /articles/*.*
Disallow /cannonballrun/*.*
Disallow /friend2friend/*.*
Disallow /jeph/*.*
Disallow /moorestown/*.*
Disallow /photos03/*.*
Disallow /r2rhm/*.*
Disallow /res03/*.*
Disallow /rtw/*.*
Disallow /run2read/*.*
Disallow /tcon5k/*.*
Disallow /toadtrot/*.*
Disallow ShowResults.asp
Disallow /WebForward/*
Disallow *.aspx
Disallow *.asp
Disallow /Forum/*.*
Disallow /Info/*.*
Disallow /Mail/*.*
Disallow /Photo/*.*
Disallow /Results/*.*
Disallow /Race/100K.aspx
Disallow /Race/100Mile.aspx
Disallow /Race/1Mile.aspx
Disallow /Race/50Mile.aspx
Disallow /Race/BulkSubmit.aspx
Disallow /Race/ContributorDetail.aspx
Disallow /Race/ContributorSummary.aspx
Disallow /Race/FourthOfJuly.aspx
Disallow /Race/Help.aspx
Disallow /Race/Hosting*.*
Disallow /Race/Inaugural.aspx
Disallow /Race/LaborDay.aspx
Disallow /Race/MapShot.aspx
Disallow /Race/Memorialday.aspx
Disallow /Race/Online*.*
Disallow /Race/SubmittalFeeder.aspx
Disallow /Race/SubmittalQueue.aspx
Disallow /submit/update/race/*
Disallow /submit/update/club/*

Other Records

Field Value
crawl-delay 15

Comments

  • robots.txt for http://runningintheusa.com/