prestosports.com
robots.txt
Robots Exclusion Standard data for prestosports.com
Resource Scan
Scan Details
| Site Domain | prestosports.com |
| Base Domain | prestosports.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-01T04:03:02+00:00 |
| Next Scan | 2024-12-30T04:03:02+00:00 |
Last Successful Scan
| Scanned | 2023-06-01T22:34:14+00:00 |
| URL | https://prestosports.com/robots.txt |
| Domain IPs | 104.18.200.53, 104.18.201.53, 104.18.202.53, 104.18.203.53, 104.18.204.53, 2606:4700::6812:c835, 2606:4700::6812:c935, 2606:4700::6812:ca35, 2606:4700::6812:cb35, 2606:4700::6812:cc35 |
| Response IP | 104.18.204.53 |
| Found | Yes |
| Hash | 5384c90a8f1903a1e18b6ec686452644462cf557df08cadced82f4127e1e6a72 |
| SimHash | 6875d002ceb9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /_private/ |
| Disallow | /_vti_bin/ |
| Disallow | /_vti_cnf/ |
| Disallow | /_vti_log/ |
| Disallow | /_vti_pvt/ |
| Disallow | /_vti_txt/ |
| Disallow | /reports/ |
| Disallow | /admin/ |
| Disallow | /action/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Comments