pplmotorhomes.com
robots.txt
Robots Exclusion Standard data for pplmotorhomes.com
Resource Scan
Scan Details
| Site Domain | pplmotorhomes.com |
| Base Domain | pplmotorhomes.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-22T15:36:03+00:00 |
| Next Scan | 2024-08-20T15:36:03+00:00 |
Last Successful Scan
| Scanned | 2024-01-01T15:34:36+00:00 |
| URL | https://pplmotorhomes.com/robots.txt |
| Redirect | https://www.pplmotorhomes.com/robots.txt |
| Redirect Domain | www.pplmotorhomes.com |
| Redirect Base | pplmotorhomes.com |
| Domain IPs | 52.40.25.65 |
| Redirect IPs | 2600:1413:b000:6::17d5:2bc6, 2600:1413:b000:6::17d5:2bd4, 96.17.96.14, 96.17.96.27 |
| Response IP | 23.54.118.52 |
| Found | Yes |
| Hash | c7dc986c6cd36b9cf4f2c92ab2ee8ec08ac2c1893972e6e9b140c1b61251536a |
| SimHash | e9b4ca3acb35 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /api |
| Disallow | /cart |
| Disallow | /checkout |
| Disallow | /myaccount |
| Disallow | /user |
| Disallow | /resources |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Comments