topendsports.com
robots.txt
Robots Exclusion Standard data for topendsports.com
Resource Scan
Scan Details
| Site Domain | topendsports.com |
| Base Domain | topendsports.com |
| Scan Status | Ok |
| Last Scan | 2024-11-08T14:19:58+00:00 |
| Next Scan | 2024-11-15T14:19:58+00:00 |
Last Scan
| Scanned | 2024-11-08T14:19:58+00:00 |
| URL | https://topendsports.com/robots.txt |
| Redirect | https://www.topendsports.com/robots.txt |
| Redirect Domain | www.topendsports.com |
| Redirect Base | topendsports.com |
| Domain IPs | 104.21.51.210, 172.67.186.88, 2606:4700:3030::ac43:ba58, 2606:4700:3035::6815:33d2 |
| Redirect IPs | 104.21.51.210, 172.67.186.88, 2606:4700:3030::ac43:ba58, 2606:4700:3035::6815:33d2 |
| Response IP | 172.67.186.88 |
| Found | Yes |
| Hash | 25c3082f472fe5860a3b716044b455d654a91a6270e0a5e96d99e593d6acaef0 |
| SimHash | 2d5c4b0003e3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /ratings/ |
| Disallow | /*.pdf$ |
| Disallow | /*.zip$ |
| Disallow | /*.xls$ |
| Disallow | /*.xlsx$ |
| Disallow | /newsletter/download- |
| Disallow | /testing/team-beeptest/download.htm |
| Disallow | /downloads.htm |
| Disallow | /newsletter/confirmed.htm |
| Disallow | /testing/images/btest2.mp3 |