ct-auto.com
robots.txt
Robots Exclusion Standard data for ct-auto.com
Resource Scan
Scan Details
| Site Domain | ct-auto.com |
| Base Domain | ct-auto.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 3/10/2025, 1:18:47 AM |
| Next Scan | 5/9/2025, 1:18:47 AM |
Last Successful Scan
| Scanned | 12/18/2024, 12:54:50 AM |
| URL | https://ct-auto.com/robots.txt |
| Redirect | https://www.ct-auto.com/robots.txt |
| Redirect Domain | www.ct-auto.com |
| Redirect Base | ct-auto.com |
| Domain IPs | 104.21.25.70, 172.67.133.197, 2606:4700:3031::ac43:85c5, 2606:4700:3036::6815:1946 |
| Redirect IPs | 104.21.25.70, 172.67.133.197, 2606:4700:3031::ac43:85c5, 2606:4700:3036::6815:1946 |
| Response IP | 172.67.133.197 |
| Found | Yes |
| Hash | 4121bdf0d0111ad3a6596538278a0a5b527f6f67ce63ebd4afe8beff59b40c2d |
| SimHash | 7926d93d2701 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | / |
adsbot-google
facebookexternalhit
| Rule | Path |
|---|---|
| Disallow | /Global.asax |
| Disallow | /images/ |
| Disallow | /includes/ |
| Disallow | /lib/ |
| Disallow | /obj/ |
| Disallow | /scripts/ |
| Disallow | /js/ |
| Disallow | /style/ |
| Disallow | /stylesheet/ |
| Disallow | /App_Data/ |
| Disallow | /bin/ |
| Disallow | /0/ |
| Disallow | /1/ |
| Disallow | /2/aspx/ |
| Disallow | /2/bootstrap/ |
| Disallow | /2/css/ |
| Disallow | /2/images/ |
| Disallow | /2/includes/ |
| Disallow | /2/js/ |
| Disallow | /2/Common/VDP_Print.aspx |
| Disallow | /custom_pages/ |
| Disallow | /customer/ |
| Disallow | /dealer/ |
| Disallow | /ucf/ |
| Disallow | */old/ |
| Disallow | */mobile/old/ |
| Disallow | *.asmx |
| Disallow | /Dealer-Websites/_genericGrayV5.2/ |
| Disallow | /privacy.aspx |
| Disallow | /thumb.aspx |
| Disallow | /requestreview |
| Disallow | */thankureview.aspx |
| Disallow | */unhappyreview.aspx |
| Disallow | /Robots.aspx |
| Disallow | /PredictiveTyper.aspx |
| Disallow | /AFVideoXML.aspx |
| Disallow | /PredictiveTyper.aspx |
| Disallow | /inventory.aspx?S=* |
| Disallow | /inventory.aspx |
Warnings
- 1 invalid line.