athletic.net
robots.txt

Robots Exclusion Standard data for athletic.net

Resource Scan

Scan Details

Site Domain athletic.net
Base Domain athletic.net
Scan Status Ok
Last Scan2025-11-09T16:58:13+00:00
Next Scan 2025-11-16T16:58:13+00:00

Last Scan

Scanned2025-11-09T16:58:13+00:00
URL https://athletic.net/robots.txt
Redirect https://www.athletic.net/robots.txt
Redirect Domain www.athletic.net
Redirect Base athletic.net
Domain IPs 104.20.16.136, 172.66.166.6, 2606:4700:10::6814:1088, 2606:4700:10::ac42:a606
Redirect IPs 104.20.16.136, 172.66.166.6, 2606:4700:10::6814:1088, 2606:4700:10::ac42:a606
Response IP 104.20.16.136
Found Yes
Hash 29dae75082ce560f30196f29b4091f76006f86576de7c21206961a3b5a181184
SimHash ac1528386e94

Groups

msiecrawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /Admin/
Disallow /admin/
Disallow /Account/
Disallow /account/
Disallow /User/
Disallow /user/
Disallow /Edit/
Disallow /edit/
Disallow /Partner/
Disallow /partner/
Disallow /post/
Disallow /crosscountry/results/team.aspx
Disallow /crosscountry/results/season.aspx
Disallow /crosscountry/division.aspx
Disallow /Partner/PrepSportswear/
Disallow /trackandfield/print/
Disallow /TrackAndField/Print/
Disallow /trackandfield/report/
Disallow /TrackAndField/Report/
Disallow /trackandfield/school_new.aspx
Disallow /trackandfield/meet/teamresults.aspx
Disallow /TrackAndField/Meet/TeamResults.aspx
Disallow /TrackAndField/State/
Disallow /trackandfield/state/
Disallow /CrossCountry/State/
Disallow /crosscountry/state/
Disallow /Secure/
Disallow /secure/
Disallow /home/
Disallow /search.aspx
Disallow /Search.aspx
Disallow /CrossCountry/Results/CourseHistory.aspx
Disallow /crosscountry/results/coursehistory.aspx
Disallow /Help/BannedIP