automall.ae
robots.txt
Robots Exclusion Standard data for automall.ae
Resource Scan
Scan Details
| Site Domain | automall.ae |
| Base Domain | automall.ae |
| Scan Status | Ok |
| Last Scan | 2024-10-08T06:40:56+00:00 |
| Next Scan | 2024-10-15T06:40:56+00:00 |
Last Scan
| Scanned | 2024-10-08T06:40:56+00:00 |
| URL | https://www.automall.ae/robots.txt |
| Domain IPs | 2600:1413:b000:6::17d5:2bc7, 2600:1413:b000:6::17d5:2bde, 96.17.96.17, 96.17.96.18 |
| Response IP | 104.88.70.98 |
| Found | Yes |
| Hash | 18b6120ba059923e314c51119dd0708ada2905628efde9647f068f34669bfe15 |
| SimHash | a01556408ab2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */cookie-policy/ |
| Disallow | */terms-and-conditions/ |
| Disallow | */privacy-and-legal/ |
| Disallow | */testDrive/* |
| Disallow | */testdrive/* |
| Disallow | */details/* |
| Disallow | */genericEnquiry/* |
| Disallow | */genericenquiry/* |
| Disallow | */modelEligibility/* |
| Disallow | */modeleligibility/* |
| Disallow | */configure/* |
| Disallow | */Article/* |
| Disallow | */article/* |
| Disallow | *?make=* |
| Disallow | *?year=* |
| Disallow | *?mileague=* |
| Disallow | *?color=* |
| Disallow | *?bodyType=* |
| Disallow | *?engineSize=* |
| Disallow | *?model=* |
| Disallow | *modelGrade%3D* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.automall.ae/sitemap-en.xml |
| sitemap | https://www.automall.ae/sitemap-ar.xml |