dmcc.ae
robots.txt

Robots Exclusion Standard data for dmcc.ae

Resource Scan

Scan Details

Site Domain dmcc.ae
Base Domain dmcc.ae
Scan Status Ok
Last Scan2024-10-21T17:15:05+00:00
Next Scan 2024-11-20T17:15:05+00:00

Last Scan

Scanned2024-10-21T17:15:05+00:00
URL https://dmcc.ae/robots.txt
Domain IPs 199.60.103.158, 199.60.103.58
Response IP 199.60.103.58
Found Yes
Hash d5aced38951a01ac6ac3a4ac0f95e7c24654818f2f4c58a0d5d2426d7704bbe5
SimHash baf8cc20c7b2

Groups

*

Rule Path
Disallow /sample-*
Disallow /blog/tag/living-in-dubai
Disallow /blog/tag/general
Disallow /events-registrations-0
Disallow /events-registrations
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

httrack

Rule Path
Disallow /
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*