cleverlayover.com
robots.txt
Robots Exclusion Standard data for cleverlayover.com
Resource Scan
Scan Details
Site Domain | cleverlayover.com |
Base Domain | cleverlayover.com |
Scan Status | Ok |
Last Scan | 2025-03-26T17:32:17+00:00 |
Next Scan | 2025-04-25T17:32:17+00:00 |
Last Scan
Scanned | 2025-03-26T17:32:17+00:00 |
URL | https://cleverlayover.com/robots.txt |
Domain IPs | 104.21.61.167, 172.67.212.44, 2606:4700:3033::ac43:d42c, 2606:4700:3037::6815:3da7 |
Response IP | 172.67.212.44 |
Found | Yes |
Hash | afea464a6e8840d7bd9e8a5c11e04d27f3c36d3eec3f07461c698b331ba7b3db |
SimHash | 5b101cd40f52 |
Groups
*
Rule | Path |
---|---|
Disallow | /redirect.php |
Disallow | /comparison.php |
Disallow | /compare_hotels.php |
Disallow | /compare_many.php |
Disallow | /purchase.php |
Disallow | /compare_car_results.php |
Disallow | /car_redirect.php |
Disallow | /car_results.php |
Disallow | /car_initiate.php |
Disallow | /compare_cars.php |