dubaitourism.gov.ae
robots.txt
Robots Exclusion Standard data for dubaitourism.gov.ae
Resource Scan
Scan Details
| Site Domain | dubaitourism.gov.ae |
| Base Domain | dubaitourism.gov.ae |
| Scan Status | Ok |
| Last Scan | 2024-11-05T03:22:15+00:00 |
| Next Scan | 2024-11-19T03:22:15+00:00 |
Last Scan
| Scanned | 2024-11-05T03:22:15+00:00 |
| URL | https://dubaitourism.gov.ae/robots.txt |
| Redirect | https://www.dubaidet.gov.ae/robots.txt |
| Redirect Domain | www.dubaidet.gov.ae |
| Redirect Base | dubaidet.gov.ae |
| Domain IPs | 104.88.71.25, 104.88.71.57, 2600:1413:b000:1b::17d7:705, 2600:1413:b000:1b::17d7:714 |
| Redirect IPs | 23.215.7.20, 23.215.7.5, 2600:1413:b000:1b::17d7:705, 2600:1413:b000:1b::17d7:714 |
| Response IP | 23.32.29.8 |
| Found | Yes |
| Hash | 27d842e7a6cf68bcf539bdf7b9aa501ef8363f201ed26e95ac3b391a1f8ea76c |
| SimHash | aa902c6504d0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bin/ |
| Disallow | /xsl/ |
| Disallow | /temp/ |
| Disallow | /admin/ |
| Disallow | /views/ |
| Disallow | /upload/ |
| Disallow | /layouts/ |
| Disallow | /sitecore/ |
| Disallow | /App_Data/ |
| Disallow | /App_Config/ |
| Disallow | /App_Browsers/ |
| Disallow | /sitecore_files/ |
| Disallow | /chrome-headless/ |
| Disallow | /sitecore%20modules/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dubaidet.gov.ae/sitemap.xml |