visitdubai.com
robots.txt
Robots Exclusion Standard data for visitdubai.com
Resource Scan
Scan Details
Site Domain | visitdubai.com |
Base Domain | visitdubai.com |
Scan Status | Ok |
Last Scan | 2024-11-08T12:05:39+00:00 |
Next Scan | 2024-11-22T12:05:39+00:00 |
Last Scan
Scanned | 2024-11-08T12:05:39+00:00 |
URL | https://visitdubai.com/robots.txt |
Redirect | https://www.visitdubai.com/robots.txt |
Redirect Domain | www.visitdubai.com |
Redirect Base | visitdubai.com |
Domain IPs | 23.215.7.20, 23.215.7.5, 2600:1413:b000:1b::17d7:705, 2600:1413:b000:1b::17d7:714 |
Redirect IPs | 23.215.7.20, 23.215.7.5, 2600:1413:b000:1b::17d7:705, 2600:1413:b000:1b::17d7:714 |
Response IP | 23.44.4.145 |
Found | Yes |
Hash | 8e68f2f4484db49888e059b72ce87d34993146b926bbac0b3c2aee734c5b818d |
SimHash | abd02177acd4 |
Groups
*
Rule | Path |
---|---|
Disallow | /bin/ |
Disallow | /xsl/ |
Disallow | *?utm |
Disallow | /temp/ |
Disallow | *?DTCM |
Disallow | *?tags |
Disallow | *?perz |
Disallow | /admin/ |
Disallow | /views/ |
Disallow | /login/ |
Disallow | /en-au/ |
Disallow | /en-hk/ |
Disallow | /en-in/ |
Disallow | /en-my/ |
Disallow | /en-sg/ |
Disallow | /en-us/ |
Disallow | /en-za/ |
Disallow | *?gclid |
Disallow | *?dclid |
Disallow | /upload/ |
Disallow | /*?tag=* |
Disallow | *?gclsrc |
Disallow | /layouts/ |
Disallow | /sitecore/ |
Disallow | /App_Data/ |
Disallow | /*?print=* |
Disallow | *?category |
Disallow | /%22mailto%3A%3A* |
Disallow | /App_Config/ |
Disallow | /sc7/hotels/ |
Disallow | /App_Browsers/ |
Disallow | /sitecore_files/ |
Disallow | /chrome-headless/ |
Disallow | /*?redirect_url=* |
Disallow | /sitecore%20modules/ |
Disallow | /*?missingtranslation=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.visitdubai.com/sitemap.xml |