dubaipost.ae
robots.txt

Robots Exclusion Standard data for dubaipost.ae

Resource Scan

Scan Details

Site Domain dubaipost.ae
Base Domain dubaipost.ae
Scan Status Ok
Last Scan2024-11-14T07:46:19+00:00
Next Scan 2024-11-21T07:46:19+00:00

Last Scan

Scanned2024-11-14T07:46:19+00:00
URL https://dubaipost.ae/robots.txt
Redirect https://www.dubaipost.ae/robots.txt
Redirect Domain www.dubaipost.ae
Redirect Base dubaipost.ae
Domain IPs 3.250.251.107
Redirect IPs 2600:9000:271a:2000:5:b14b:8c80:93a1, 2600:9000:271a:200:5:b14b:8c80:93a1, 2600:9000:271a:3a00:5:b14b:8c80:93a1, 2600:9000:271a:4c00:5:b14b:8c80:93a1, 2600:9000:271a:7800:5:b14b:8c80:93a1, 2600:9000:271a:8a00:5:b14b:8c80:93a1, 2600:9000:271a:9000:5:b14b:8c80:93a1, 2600:9000:271a:a800:5:b14b:8c80:93a1, 3.165.82.112, 3.165.82.18, 3.165.82.28, 3.165.82.78
Response IP 3.165.82.18
Found Yes
Hash 70d0677476b497464149f261b6b5273640ffbb386e84b7f88b94ae5ae093bb9b
SimHash ee1003578536

Groups

*

Rule Path
Disallow /res/html
Disallow /captcha
Disallow /logger
Disallow /happiness-meter
Allow /

Other Records

Field Value
sitemap https://www.dubaipost.ae/ar/generic-sitemaps-arabic-1.450?ot=ot.AjaxPageLayout
sitemap https://www.dubaipost.ae/ar/generic-sitemaps-english-1.465?ot=ot.AjaxPageLayout
sitemap https://www.dubaipost.ae/sitemaps/ar/index.xml
sitemap https://www.dubaipost.ae/sitemaps/en/index.xml

Comments

  • HTTPS www.dubaipost.ae
  • Sitemaps
  • Disallow: /ar/search-7.111
  • Disallow: /en/search-7.122