parkrun.com
robots.txt
Robots Exclusion Standard data for parkrun.com
Resource Scan
Scan Details
| Site Domain | parkrun.com |
| Base Domain | parkrun.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-18T05:36:24+00:00 |
| Next Scan | 2024-12-17T05:36:24+00:00 |
Last Successful Scan
| Scanned | 2023-11-01T04:01:50+00:00 |
| URL | https://parkrun.com/robots.txt |
| Redirect | https://www.parkrun.com:443/robots.txt |
| Redirect Domain | www.parkrun.com |
| Redirect Base | parkrun.com |
| Domain IPs | 18.202.76.11, 34.246.72.240, 52.214.70.36 |
| Redirect IPs | 18.202.76.11, 34.246.72.240, 52.214.70.36 |
| Response IP | 34.246.72.240 |
| Found | Yes |
| Hash | 8520dd65667f6d77cbfa431597a5621e623c80d0ddbe67acfaad784805aff9eb |
| SimHash | e81281190a56 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /*news$ |
| Allow | /*news/$ |
| Allow | /*course$ |
| Allow | /*course/$ |
| Allow | /*aboutus$ |
| Allow | /*aboutus/$ |
| Allow | /*home$ |
| Allow | /*home/$ |
| Allow | /*volunteer$ |
| Allow | /*volunteer/$ |
| Allow | /*photos$ |
| Allow | /*photos/$ |
| Allow | /*links$ |
| Allow | /*links/$ |
| Allow | /*results/latestresults/$ |
| Disallow | /parkrunner |
| Disallow | /parkrunner/* |
| Disallow | /*/parkrunner/* |
| Disallow | /results/athleteresultshistory/ |
| Disallow | /*freedom$ |
| Disallow | /*freedom/$ |
| Disallow | /*/futureroster |
| Disallow | /*results$ |
| Disallow | /*results/$ |
| Disallow | /*athleteeventresultshistory$ |
| Disallow | /athleteeventresultshistory |
| Disallow | /athleteresultshistory |
| Disallow | /athleteresultshistory/ |
| Disallow | /*wincounts$ |
| Disallow | /*agecategoryrecords$ |
| Disallow | /*agecategoryrecords/$ |
| Disallow | /*mixedleague$ |
| Disallow | /*mixedleague/$ |
| Disallow | /*maleleague$ |
| Disallow | /*maleleague/$ |
| Disallow | /*femaleleague$ |
| Disallow | /*femaleleague/$ |
| Disallow | /*malePointstable$ |
| Disallow | /*femalePointstable$ |
| Disallow | /*femalePointstable/$ |
| Disallow | /femalepointstable/$ |
| Disallow | /*clubhistory? |
| Disallow | /*clubhistory$ |
| Disallow | /*clubhistory/$ |
| Disallow | /*agecategorytable? |
| Disallow | /*agecategorytable$ |
| Disallow | /*agecategorytable/$ |
| Disallow | /*eventhistory$ |
| Disallow | /*eventhistory/$ |
| Disallow | /*agegradedleague$ |
| Disallow | /*agegradedleague/$ |
| Disallow | /*mixedleague$ |
| Disallow | /*mixedleague/$ |
| Disallow | /*search$ |
| Disallow | /*search/$ |
| Disallow | /*weeklyresults$ |
| Disallow | /*weeklyresults/$ |
| Disallow | /*sub20women/$ |
| Disallow | /*sub20women$ |
| Disallow | /*sub17men/$ |
| Disallow | /*sub17men$ |
| Disallow | /*topagegrade/$ |
| Disallow | /*topagegrade$ |
| Disallow | /*femalepointstable/$ |
| Disallow | /*femalepointstable$ |
| Disallow | /*fastest500/$ |
| Disallow | /*fastest500$ |
| Disallow | /*firstfinishers/$ |
| Disallow | /*firstfinishers$ |
| Disallow | /*newcategoryrecords/$ |
| Disallow | /*newcategoryrecords$ |
| Disallow | /*courserecords/$ |
| Disallow | /*courserecords$ |
| Disallow | /*mostevents/$ |
| Disallow | /*mostevents$ |
| Disallow | /*100clubbers/$ |
| Disallow | /*100clubbers$ |
| Disallow | /*mostfirstfinishes/$ |
| Disallow | /*mostfirstfinishes$ |
| Disallow | /*? |
| Disallow | /runner/mylinks$ |
| Disallow | /runner/freedom$ |
| Disallow | /runner/UKbarcode$ |
| Disallow | /runner/ukbarcode$ |
| Disallow | /runner/Update$ |
| Disallow | /runner/Update/UK$ |
| Disallow | /runner/update/uk$ |
| Disallow | /runner/clubmembership$ |
| Disallow | /runner/clubmembership/UK$ |
| Disallow | /runner/setupresultstext$ |
| Disallow | /runner/partner/pruhealth$ |
| Disallow | /Runner/mylinks$ |
| Disallow | /runner$ |
| Disallow | /profile |
| Disallow | /profile/* |
| Disallow | /thankyou/ |
| Disallow | /thankyou |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments