hmnewsbd.com
robots.txt

Robots Exclusion Standard data for hmnewsbd.com

Resource Scan

Scan Details

Site Domain hmnewsbd.com
Base Domain hmnewsbd.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-02T23:17:00+00:00
Next Scan 2026-01-31T23:17:00+00:00

Last Successful Scan

Scanned2023-04-14T15:35:01+00:00
URL https://hmnewsbd.com/robots.txt
Redirect https://www.hmnewsbd.com/robots.txt
Redirect Domain www.hmnewsbd.com
Redirect Base hmnewsbd.com
Domain IPs 104.21.6.46, 172.67.154.234, 2606:4700:3030::ac43:9aea, 2606:4700:3034::6815:62e
Redirect IPs 104.21.6.46, 172.67.154.234, 2606:4700:3030::ac43:9aea, 2606:4700:3034::6815:62e
Response IP 172.67.154.234
Found Yes
Hash 44d46d55688e185bf76a24c72e554d08d9f81e325db305651b97108acd88accb
SimHash e914d715f7d3

Groups

*

Rule Path
Disallow /search
Disallow /category/
Disallow /tag/
Allow /

Other Records

Field Value
sitemap https://www.hmnewsbd.com/atom.xml?redirect=false&start-index=1&max-results=500