spref.com
robots.txt
Robots Exclusion Standard data for spref.com
Resource Scan
Scan Details
| Site Domain | spref.com |
| Base Domain | spref.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-12-03T12:08:52+00:00 |
| Next Scan | 2026-02-01T12:08:52+00:00 |
Last Successful Scan
| Scanned | 2025-09-11T12:28:25+00:00 |
| URL | http://spref.com/robots.txt |
| Redirect | https://www.sports-reference.com/robots.txt |
| Redirect Domain | www.sports-reference.com |
| Redirect Base | sports-reference.com |
| Domain IPs | 3.213.150.21, 34.205.163.65, 54.164.63.54 |
| Redirect IPs | 104.18.18.43, 104.18.19.43, 2606:4700::6812:122b, 2606:4700::6812:132b |
| Response IP | 104.18.19.43 |
| Found | Yes |
| Hash | f281b66a4d963fac44c2f807726194b81d08ea735faa5302630da7c3e9a855c1 |
| SimHash | 783240738b13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bb/ |
| Disallow | /olympics/athlete_search.cgi |
| Disallow | /cfb/search.cgi |
| Disallow | /cbb/search.cgi |
| Disallow | /cbb/boxscores/index.cgi?* |
| Disallow | /cbb/players/*/splits/*/?* |
| Disallow | /cbb/players/*/splits/*?* |
| Disallow | /cbb/players/*/splits/* |
| Disallow | /cbb/players/*/splits* |
| Disallow | /cfb/boxscores/index.cgi?* |
| Disallow | /cfb/players/*/splits/*/?* |
| Disallow | /cfb/players/*/splits/*?* |
| Disallow | /cfb/players/*/splits/* |
| Disallow | /cfb/players/*/splits* |
| Disallow | /cfb/schools/*/*/splits/*/?* |
| Disallow | /cfb/schools/*/*/splits/*?* |
| Disallow | /cfb/schools/*/*/splits/* |
| Disallow | /cfb/schools/*/*/splits* |
| Disallow | /cfb/req/ |
| Disallow | /cfb/short/ |
| Disallow | /cfb/nocdn/ |
| Disallow | /cbb/req/ |
| Disallow | /cbb/short/ |
| Disallow | /cbb/nocdn/ |