dubaidutyfree.com
robots.txt
Robots Exclusion Standard data for dubaidutyfree.com
Resource Scan
Scan Details
| Site Domain | dubaidutyfree.com |
| Base Domain | dubaidutyfree.com |
| Scan Status | Ok |
| Last Scan | 2024-10-20T04:17:14+00:00 |
| Next Scan | 2024-11-19T04:17:14+00:00 |
Last Scan
| Scanned | 2024-10-20T04:17:14+00:00 |
| URL | https://www.dubaidutyfree.com/robots.txt |
| Domain IPs | 184.29.88.22 |
| Response IP | 184.29.88.22 |
| Found | Yes |
| Hash | 31dc11e170a1df0f0801682ff4eea9e5f39db3d7810cda4e8497f0371fb04b10 |
| SimHash | 4d501846e952 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cart |
| Disallow | /en/cart |
| Disallow | /zh_CN/cart |
| Disallow | /checkout |
| Disallow | /en/checkout |
| Disallow | /zh_CN/checkout |
| Disallow | /profile |
| Disallow | /en/profile |
| Disallow | /zh_CN/profile |
| Disallow | /searchresults |
| Disallow | /en/searchresults |
| Disallow | /zh_CN/searchresults |
| Disallow | /confirmation |
| Disallow | /en/confirmation |
| Disallow | /zh_CN/confirmation |
| Disallow | /wishlist_settings |
| Disallow | /en/wishlist_settings |
| Disallow | /zh_CN/wishlist_settings |
| Disallow | /wishlist |
| Disallow | /en/wishlist |
| Disallow | /zh_CN/wishlist |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dubaidutyfree.com/sitemap.xml |