autotropolis.com
robots.txt

Robots Exclusion Standard data for autotropolis.com

Resource Scan

Scan Details

Site Domain autotropolis.com
Base Domain autotropolis.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-06-04T17:14:16+00:00
Next Scan 2024-09-02T17:14:16+00:00

Last Successful Scan

Scanned2023-07-18T16:08:03+00:00
URL http://autotropolis.com/robots.txt
Redirect https://www.autobytel.com/robots.txt
Redirect Domain www.autobytel.com
Redirect Base autobytel.com
Domain IPs 209.67.155.5
Redirect IPs 13.107.213.59, 13.107.246.59, 2620:1ec:46::59, 2620:1ec:bdf::59
Response IP 13.107.213.59
Found Yes
Hash 0c8236d2e4a6b5e6f8bbb999c3f34f6b6ef9f528b41603f3911e3a3f44b8d5a2
SimHash 48006c606b9b

Groups

*

Rule Path
Disallow /new-car-test-drive-sp/
Disallow /new-car-test-drive-review/
Disallow /kbb-review/
Disallow /edmunds-review/
Disallow /virtual-brochure/
Disallow /widgets/
Disallow /used-car-finder/?make
Disallow /used-car-finder/vehicle-details/
Disallow /api/
Disallow /kelley-blue-book/

npbot

Rule Path
Disallow /

societyrobot

Rule Path
Disallow /

charlotte

Rule Path
Disallow /