difc.ae
robots.txt

Robots Exclusion Standard data for difc.ae

Resource Scan

Scan Details

Site Domain difc.ae
Base Domain difc.ae
Scan Status Ok
Last Scan2024-09-26T03:29:06+00:00
Next Scan 2024-10-26T03:29:06+00:00

Last Scan

Scanned2024-09-26T03:29:06+00:00
URL https://difc.ae/robots.txt
Redirect https://www.difc.ae/robots.txt
Redirect Domain www.difc.ae
Redirect Base difc.ae
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.241, 76.76.21.98
Response IP 76.76.21.164
Found Yes
Hash 500b0ee8773d7aab106c24fe2994c92ea561f2dbbd72a5c2d5e2338160747521
SimHash 60002da0c9b2

Groups

*

Rule Path
Disallow /sitecore
Disallow /sitecore/modules

Other Records

Field Value
sitemap https://www.difc.ae/sitemap.xml

Comments

  • Algolia-Crawler-Verif: 62132C95F3D6FBFC