automall.ae
robots.txt
Robots Exclusion Standard data for automall.ae
Resource Scan
Scan Details
Site Domain | automall.ae |
Base Domain | automall.ae |
Scan Status | Ok |
Last Scan | 2024-11-12T06:42:35+00:00 |
Next Scan | 2024-11-19T06:42:35+00:00 |
Last Scan
Scanned | 2024-11-12T06:42:35+00:00 |
URL | https://www.automall.ae/robots.txt |
Domain IPs | 2600:1413:b000:6::17d5:2bc7, 2600:1413:b000:6::17d5:2bde, 96.17.96.17, 96.17.96.18 |
Response IP | 23.44.4.144 |
Found | Yes |
Hash | 18b6120ba059923e314c51119dd0708ada2905628efde9647f068f34669bfe15 |
SimHash | a01556408ab2 |
Groups
*
Rule | Path |
---|---|
Disallow | */cookie-policy/ |
Disallow | */terms-and-conditions/ |
Disallow | */privacy-and-legal/ |
Disallow | */testDrive/* |
Disallow | */testdrive/* |
Disallow | */details/* |
Disallow | */genericEnquiry/* |
Disallow | */genericenquiry/* |
Disallow | */modelEligibility/* |
Disallow | */modeleligibility/* |
Disallow | */configure/* |
Disallow | */Article/* |
Disallow | */article/* |
Disallow | *?make=* |
Disallow | *?year=* |
Disallow | *?mileague=* |
Disallow | *?color=* |
Disallow | *?bodyType=* |
Disallow | *?engineSize=* |
Disallow | *?model=* |
Disallow | *modelGrade%3D* |
Other Records
Field | Value |
---|---|
sitemap | https://www.automall.ae/sitemap-en.xml |
sitemap | https://www.automall.ae/sitemap-ar.xml |