gap.ae
robots.txt
Robots Exclusion Standard data for gap.ae
Resource Scan
Scan Details
| Site Domain | gap.ae |
| Base Domain | gap.ae |
| Scan Status | Ok |
| Last Scan | 2024-11-12T06:45:06+00:00 |
| Next Scan | 2024-11-19T06:45:06+00:00 |
Last Scan
| Scanned | 2024-11-12T06:45:06+00:00 |
| URL | https://gap.ae/robots.txt |
| Redirect | https://www.gap.ae/robots.txt |
| Redirect Domain | www.gap.ae |
| Redirect Base | gap.ae |
| Domain IPs | 104.26.6.174, 104.26.7.174, 172.67.73.253, 2606:4700:20::681a:6ae, 2606:4700:20::681a:7ae, 2606:4700:20::ac43:49fd |
| Redirect IPs | 13.225.4.100, 13.225.4.18, 13.225.4.30, 13.225.4.81 |
| Response IP | 13.225.4.18 |
| Found | Yes |
| Hash | fcf98bb558de7bf3c9c0d177d9cda5b78e67766bcc4854e02dbd6df4a0e9177f |
| SimHash | ef7dd1186d12 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cart |
| Disallow | /login |
| Disallow | /orders |
| Disallow | /checkouts/ |
| Disallow | /checkout |
| Disallow | *?banner |
| Disallow | /*search?q=* |
| Disallow | *?limit=* |
| Disallow | *%26sort%3D* |
| Disallow | /carts |
| Disallow | /account |
| Disallow | /pages/ |
| Disallow | /pages-mobile/ |
| Disallow | /*pid%3D* |
| Disallow | /*size%3D* |
| Disallow | *?sizesInStock* |
| Disallow | *%26isInStockDeliveryMethod%3D* |
| Disallow | *%26sizesInStock%3D* |
| Disallow | *%26price%3D* |
| Disallow | *smartFilter%3D* |
| Disallow | *priceType%3Dfull* |
| Disallow | *?channel_code=* |
| Disallow | *?discountPercent=* |
| Disallow | *?price=* |
| Disallow | *?pid=* |
| Disallow | *?_csrf=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.gap.ae/sitemap_index.xml |