dunya.com
robots.txt

Robots Exclusion Standard data for dunya.com

Resource Scan

Scan Details

Site Domain dunya.com
Base Domain dunya.com
Scan Status Ok
Last Scan2024-06-15T02:49:58+00:00
Next Scan 2024-06-22T02:49:58+00:00

Last Scan

Scanned2024-06-15T02:49:58+00:00
URL https://dunya.com/robots.txt
Redirect https://www.dunya.com/robots.txt
Redirect Domain www.dunya.com
Redirect Base dunya.com
Domain IPs 195.142.135.35
Redirect IPs 195.142.135.35
Response IP 195.142.135.35
Found Yes
Hash 4cfe3842f2711296d6d7b156bb5d68816a484bc0bb2554d3c9c2836d494b0a28
SimHash 684cc9550713

Groups

*

Rule Path
Allow /
Disallow /ara/*

Other Records

Field Value
sitemap https://www.dunya.com/sitemap
sitemap https://www.dunya.com/sitemap/index
sitemap https://www.dunya.com/newsmap
sitemap https://www.dunya.com/sitemap/index/articles
sitemap https://www.dunya.com/sitemap/categories