gap.ae
robots.txt
Robots Exclusion Standard data for gap.ae
Resource Scan
Scan Details
Site Domain | gap.ae |
Base Domain | gap.ae |
Scan Status | Ok |
Last Scan | 2024-06-24T13:36:16+00:00 |
Next Scan | 2024-07-01T13:36:16+00:00 |
Last Scan
Scanned | 2024-06-24T13:36:16+00:00 |
URL | https://gap.ae/robots.txt |
Redirect | https://www.gap.ae/robots.txt |
Redirect Domain | www.gap.ae |
Redirect Base | gap.ae |
Domain IPs | 104.16.48.160, 104.17.207.209, 2606:4700::6810:30a0, 2606:4700::6811:cfd1 |
Redirect IPs | 13.33.183.105, 13.33.183.124, 13.33.183.16, 13.33.183.66 |
Response IP | 13.225.4.18 |
Found | Yes |
Hash | cef2a3d91467bb13132adcff3f6f283268699ed476527a9b6c75cc7a468168f4 |
SimHash | ec755b143552 |
Groups
*
Rule | Path |
---|---|
Disallow | /cart |
Disallow | /login |
Disallow | /orders |
Disallow | /checkouts/ |
Disallow | /checkout |
Disallow | *?banner |
Disallow | /*search?q=* |
Disallow | *?limit=* |
Disallow | *%26sort%3D* |
Disallow | /carts |
Disallow | /account |
Disallow | /pages/ |
Disallow | /pages-mobile/ |