sportspyder.com
robots.txt
Robots Exclusion Standard data for sportspyder.com
Resource Scan
Scan Details
| Site Domain | sportspyder.com |
| Base Domain | sportspyder.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T15:47:24+00:00 |
| Next Scan | 2024-09-27T15:47:24+00:00 |
Last Scan
| Scanned | 2024-09-20T15:47:24+00:00 |
| URL | https://sportspyder.com/robots.txt |
| Domain IPs | 64.246.135.100 |
| Response IP | 64.246.135.100 |
| Found | Yes |
| Hash | fd284eba45f7ae4dccf9f6e6c0c518bda54481f99021a13065a8e80384117cab |
| SimHash | 89385230cabb |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | */articles/ |
| Disallow | /shop/ |
| Disallow | /api/ |
| Disallow | /all.html |
| Disallow | /buy.html |
| Disallow | *? |
Other Records
| Field | Value |
|---|---|
| sitemap | https://sportspyder.com/sitemap.xml |