dealerrater.com
robots.txt
Robots Exclusion Standard data for dealerrater.com
Resource Scan
Scan Details
Site Domain | dealerrater.com |
Base Domain | dealerrater.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-09T13:19:11+00:00 |
Next Scan | 2024-08-07T13:19:11+00:00 |
Last Successful Scan
Scanned | 2023-01-08T02:36:17+00:00 |
URL | https://dealerrater.com/robots.txt |
Redirect | https://www.dealerrater.com/robots.txt |
Redirect Domain | www.dealerrater.com |
Redirect Base | dealerrater.com |
Domain IPs | 13.35.8.13, 13.35.8.67, 13.35.8.73, 13.35.8.98 |
Redirect IPs | 13.35.8.13, 13.35.8.67, 13.35.8.73, 13.35.8.98 |
Response IP | 13.35.8.13 |
Found | Yes |
Hash | be4e653e8d3541203ff6b704d4d92cddd835ec8bafc122e94cba7a0ab74071cd |
SimHash | 5259c966c373 |
Groups
*
Rule | Path |
---|---|
Disallow | /dealer/print.aspx |
Disallow | /dealer/report.aspx |
Disallow | /dealer/respond.aspx |
Disallow | /dealer/filtered-reviews.aspx |
Disallow | /redirect.aspx |
Disallow | /login/ |
Disallow | /login* |
Disallow | /register/* |
Disallow | /consumer/forgotPassword/ |
Disallow | /ajax/ |
Disallow | /dealer/for-sale.aspx |
Disallow | /classifieds/leads-contact.aspx |
Disallow | /os/ |
Disallow | /error |
Disallow | /error.aspx |
Disallow | /consumer/writereviews/* |
Disallow | /directory/z/* |
Disallow | /classifieds/search/z/* |
Disallow | /sales2/* |
Disallow | *_ni%3D2* |
Other Records
Field | Value |
---|---|
sitemap | https://www.dealerrater.com/sitemap.xml |