dotalkhaleej.com
robots.txt

Robots Exclusion Standard data for dotalkhaleej.com

Resource Scan

Scan Details

Site Domain dotalkhaleej.com
Base Domain dotalkhaleej.com
Scan Status Ok
Last Scan2024-11-14T00:27:13+00:00
Next Scan 2024-11-21T00:27:13+00:00

Last Scan

Scanned2024-11-14T00:27:13+00:00
URL https://dotalkhaleej.com/robots.txt
Redirect https://news.dotalkhalij.com/robots.txt
Redirect Domain news.dotalkhalij.com
Redirect Base dotalkhalij.com
Domain IPs 104.21.31.184, 172.67.179.38, 2606:4700:3030::6815:1fb8, 2606:4700:3036::ac43:b326
Redirect IPs 104.26.10.76, 104.26.11.76, 172.67.73.30, 2606:4700:20::681a:a4c, 2606:4700:20::681a:b4c, 2606:4700:20::ac43:491e
Response IP 172.67.73.30
Found Yes
Hash d6c8a7310ea96c663e47788c09fc6a8b13aebb6121bcd774ae3ca8bfa37ba7da
SimHash efb99880df52

Groups

*

Rule Path
Disallow /panel
Disallow /cron
Disallow /ajax
Disallow /widgets_factory
Disallow /auth
Disallow /login
Disallow /register
Disallow /style
Disallow /printit
Disallow /emailthis
Disallow /outside

Other Records

Field Value
sitemap https://dotgulf.com/sitemap.xml
sitemap https://dotgulf.com/sitemap.xml?format=google_news