lexus.ae
robots.txt
Robots Exclusion Standard data for lexus.ae
Resource Scan
Scan Details
Site Domain | lexus.ae |
Base Domain | lexus.ae |
Scan Status | Ok |
Last Scan | 2024-09-15T08:49:35+00:00 |
Next Scan | 2024-10-15T08:49:35+00:00 |
Last Scan
Scanned | 2024-09-15T08:49:35+00:00 |
URL | https://lexus.ae/robots.txt |
Redirect | https://www.lexus.ae/robots.txt |
Redirect Domain | www.lexus.ae |
Redirect Base | lexus.ae |
Domain IPs | 20.233.234.22 |
Redirect IPs | 2600:1413:b000:6::17d5:2bc7, 2600:1413:b000:6::17d5:2bde, 96.17.96.17, 96.17.96.18 |
Response IP | 23.44.5.16 |
Found | Yes |
Hash | 9381cc5e086d5b4df729e227b143281ac6f00ec1b5ea847b2c85e0da75312fd2 |
SimHash | a0155840c592 |
Groups
*
Rule | Path |
---|---|
Disallow | */cookie-policy/ |
Disallow | */terms-and-conditions/ |
Disallow | */privacy-and-legal/ |
Disallow | */testDrive/* |
Disallow | */testdrive/* |
Disallow | */details/* |
Disallow | */genericEnquiry/* |
Disallow | */genericenquiry/* |
Disallow | */modelEligibility/* |
Disallow | */modeleligibility/* |
Disallow | */configure/* |
Disallow | */Article/* |
Disallow | */article/* |
Disallow | */?model=* |
Disallow | *modelGrade%3D* |
Other Records
Field | Value |
---|---|
sitemap | https://www.lexus.ae/sitemap-en.xml |
sitemap | https://www.lexus.ae/sitemap-ar.xml |