khaleejtimes.ae
robots.txt

Robots Exclusion Standard data for khaleejtimes.ae

Resource Scan

Scan Details

Site Domain khaleejtimes.ae
Base Domain khaleejtimes.ae
Scan Status Ok
Last Scan2024-11-03T05:52:46+00:00
Next Scan 2024-11-10T05:52:46+00:00

Last Scan

Scanned2024-11-03T05:52:46+00:00
URL https://khaleejtimes.ae/robots.txt
Redirect https://www.khaleejtimes.com/arabic/robots.txt
Redirect Domain www.khaleejtimes.com
Redirect Base khaleejtimes.com
Domain IPs 134.122.110.207
Redirect IPs 107.154.77.234
Response IP 107.154.77.234
Found Yes
Hash 2ba90c075c20b630a3da0ddae6e46bc0e8e4b44769aa4450dd933e661ae5c248
SimHash 4918c913c393

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.khaleejtimes.com/arabic/news_sitemap.xml
sitemap https://www.khaleejtimes.com/arabic/sitemap.xml