superchevy.com
robots.txt
Robots Exclusion Standard data for superchevy.com
Resource Scan
Scan Details
Site Domain | superchevy.com |
Base Domain | superchevy.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-08T12:02:29+00:00 |
Next Scan | 2024-12-07T12:02:29+00:00 |
Last Successful Scan
Scanned | 2023-08-16T10:31:14+00:00 |
URL | https://superchevy.com/robots.txt |
Redirect | http://www.superchevy.com/robots.txt |
Redirect Domain | www.superchevy.com |
Redirect Base | superchevy.com |
Domain IPs | 54.192.150.105, 54.192.150.123, 54.192.150.34, 54.192.150.58 |
Redirect IPs | 184.50.85.147, 96.17.180.19 |
Response IP | 23.52.171.216 |
Found | Yes |
Hash | 9b92d204ffde355b86a79e50b7304f30a0dc40ee062d696280c794c13e1624cc |
SimHash | 4811c0447c55 |
Groups
*
Rule | Path |
---|---|
Disallow | /bin/ |
Disallow | /redir/ |
Disallow | /controls/ |
Disallow | /srv/ |
Disallow | /ni/ |
Disallow | /profile/ |
Disallow | /nofollow/ |
Disallow | /*? |
Disallow | /popup/ |
Disallow | /dropdownxml/ |
Disallow | /login/ |
Disallow | /logout/ |
Disallow | /ajax/* |
Disallow | /*loadmore/* |
Allow | /*.js?* |
Allow | /*.css?* |
Other Records
Field | Value |
---|---|
sitemap | http://www.superchevy.com/sitemap.xml |
sitemap | http://www.sitemapsim.com/superchevy.com-adam.xml |
sitemap | http://www.superchevy.com/superchevy.com-adam-news.xml |