edge.bu.ac.bd
robots.txt

Robots Exclusion Standard data for edge.bu.ac.bd

Resource Scan

Scan Details

Site Domain edge.bu.ac.bd
Base Domain bu.ac.bd
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-06T09:21:11+00:00
Next Scan 2026-01-04T09:21:11+00:00

Last Successful Scan

Scanned2025-05-17T00:57:51+00:00
URL https://edge.bu.ac.bd/robots.txt
Domain IPs 103.157.135.180
Response IP 103.157.135.180
Found Yes
Hash e06eb512db862261d76b2f9c961c425192762161fbd8333ba686f49262614e87
SimHash a8105b206362

Groups

*

Rule Path
Disallow /

Comments

  • www.robotstxt.org/
  • DisAllow crawling of all content except one