investindubai.gov.ae
robots.txt
Robots Exclusion Standard data for investindubai.gov.ae
Resource Scan
Scan Details
Site Domain | investindubai.gov.ae |
Base Domain | investindubai.gov.ae |
Scan Status | Ok |
Last Scan | 2024-09-18T06:09:09+00:00 |
Next Scan | 2024-10-02T06:09:09+00:00 |
Last Scan
Scanned | 2024-09-18T06:09:09+00:00 |
URL | https://investindubai.gov.ae/robots.txt |
Redirect | https://www.investindubai.gov.ae/robots.txt |
Redirect Domain | www.investindubai.gov.ae |
Redirect Base | investindubai.gov.ae |
Domain IPs | 23.215.7.20, 23.215.7.5, 2600:1413:b000:1b::17d7:705, 2600:1413:b000:1b::17d7:714 |
Redirect IPs | 23.215.7.20, 23.215.7.5, 2600:1413:b000:1b::17d7:705, 2600:1413:b000:1b::17d7:714 |
Response IP | 23.32.29.105 |
Found | Yes |
Hash | f68dbc9a1a571d9006575abf3310247d7db325068dd0647d5952bfc62f542adb |
SimHash | 2a800c6506d1 |
Groups
*
Rule | Path |
---|---|
Disallow | /bin/ |
Disallow | /xsl/ |
Disallow | /temp/ |
Disallow | /admin/ |
Disallow | /views/ |
Disallow | /upload/ |
Disallow | /layouts/ |
Disallow | /sitecore/ |
Disallow | /App_Data/ |
Disallow | /App_Config/ |
Disallow | /App_Browsers/ |
Disallow | /sitecore_files/ |
Disallow | /chrome-headless/ |
Disallow | /sitecore%20modules/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.investindubai.gov.ae/sitemap.xml |