soccerstats.com
robots.txt
Robots Exclusion Standard data for soccerstats.com
Resource Scan
Scan Details
Site Domain | soccerstats.com |
Base Domain | soccerstats.com |
Scan Status | Ok |
Last Scan | 2024-11-12T12:07:27+00:00 |
Next Scan | 2024-11-19T12:07:27+00:00 |
Last Scan
Scanned | 2024-11-12T12:07:27+00:00 |
URL | https://soccerstats.com/robots.txt |
Domain IPs | 104.21.35.27, 172.67.212.72, 2606:4700:3031::6815:231b, 2606:4700:3037::ac43:d448 |
Response IP | 104.21.35.27 |
Found | Yes |
Hash | 1a78c7aa70aaf5e8662e1377165a3a25607480c3a84a4b86b180a935de9d1924 |
SimHash | 29301fc4a192 |
Groups
*
Rule | Path |
---|---|
Disallow | /*1000 |
Disallow | /*.gif$ |
Disallow | /*.jpg$ |
Disallow | /*.png$ |
Disallow | /*.php$ |
Disallow | /2k* |
Disallow | /cdn-cgi/ |
Disallow | /error.htm |
Disallow | /index.html |
Disallow | /members.asp |
Disallow | /js/* |
Disallow | /*_200 |
Disallow | /*_201 |
Other Records
Field | Value |
---|---|
sitemap | https://www.soccerstats.com/spsitemapssl.xml |