dimaakhbar.com
robots.txt

Robots Exclusion Standard data for dimaakhbar.com

Resource Scan

Scan Details

Site Domain dimaakhbar.com
Base Domain dimaakhbar.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-02T07:22:45+00:00
Next Scan 2024-12-02T07:22:45+00:00

Last Successful Scan

Scanned2024-10-04T04:50:04+00:00
URL https://dimaakhbar.com/robots.txt
Redirect https://www.dimaakhbar.com/robots.txt
Redirect Domain www.dimaakhbar.com
Redirect Base dimaakhbar.com
Domain IPs 216.239.32.21, 216.239.38.21
Redirect IPs 216.239.32.21, 216.239.38.21
Response IP 216.239.32.21
Found Yes
Hash faaf69d80cb76b7fca5375da29f1929e2cff4e8c06197a8ab32542810642b0cf
SimHash 4a1c94724f51

Groups

*

Rule Path
Disallow /p/privacy-policy.html
Disallow /p/contact.html
Disallow /search
Allow /
Allow /ads.txt

Other Records

Field Value
sitemap https://www.dimaakhbar.com/sitemap.xml
sitemap https://www.dimaakhbar.com/feeds/posts/default
sitemap https://www.dimaakhbar.com/atom.xml?redirect=false&start-index=1&max-results=500
sitemap https://www.dimaakhbar.com/atom.xml?redirect=false&start-index=501&max-results=500
sitemap https://www.dimaakhbar.com/atom.xml?redirect=false&start-index=1001&max-results=500
sitemap https://www.dimaakhbar.com/sitemap-pages.xml