autohelperbot.com
robots.txt
Robots Exclusion Standard data for autohelperbot.com
Resource Scan
Scan Details
Site Domain | autohelperbot.com |
Base Domain | autohelperbot.com |
Scan Status | Ok |
Last Scan | 2025-07-15T06:38:43+00:00 |
Next Scan | 2025-08-14T06:38:43+00:00 |
Last Scan
Scanned | 2025-07-15T06:38:43+00:00 |
URL | https://autohelperbot.com/robots.txt |
Domain IPs | 104.26.6.8, 104.26.7.8, 172.67.70.159 |
Response IP | 104.26.7.8 |
Found | Yes |
Hash | 2fc36f36c1cbb82a3d7fc2f504272e5ee4edd430e51dbbc11288801cd8be0f1c |
SimHash | f57fb6b227b2 |
Groups
*
Rule | Path |
---|---|
Disallow | /login/ |
Disallow | /carfax/ |
Disallow | /autocheck/ |
Disallow | /windowsticker/ |
Disallow | /car_img_popup/ |
Disallow | /car-img/ |
Disallow | /*?sort= |
Disallow | /*%26sort%3D |
Disallow | /*?direction= |
Disallow | /*%26direction%3D |
Disallow | /get-popular-lots/* |
Disallow | /get-similar-sales/* |
Disallow | /get-similar-active/* |
Disallow | /en/login/ |
Disallow | /en/carfax/ |
Disallow | /en/autocheck/ |
Disallow | /en/windowsticker/ |
Disallow | /en/car_img_popup/ |
Disallow | /en/car-img/ |
Disallow | /en/*?sort= |
Disallow | /en/*%26sort%3D |
Disallow | /en/*?direction= |
Disallow | /en/*%26direction%3D |
Disallow | /en/get-popular-lots/* |
Disallow | /en/get-similar-sales/* |
Disallow | /en/get-similar-active/* |
Disallow | /uk/login/ |
Disallow | /uk/carfax/ |
Disallow | /uk/autocheck/ |
Disallow | /uk/windowsticker/ |
Disallow | /uk/car_img_popup/ |
Disallow | /uk/car-img/ |
Disallow | /uk/*?sort= |
Disallow | /uk/*%26sort%3D |
Disallow | /uk/*?direction= |
Disallow | /uk/*%26direction%3D |
Disallow | /uk/get-popular-lots/* |
Disallow | /uk/get-similar-sales/* |
Disallow | /uk/get-similar-active/* |
Other Records
Field | Value |
---|---|
sitemap | https://autohelperbot.com/sitemap.xml |
Warnings
- `host` is not a known field.