dainikamadershomoy.com
robots.txt

Robots Exclusion Standard data for dainikamadershomoy.com

Resource Scan

Scan Details

Site Domain dainikamadershomoy.com
Base Domain dainikamadershomoy.com
Scan Status Ok
Last Scan2024-05-23T03:39:48+00:00
Next Scan 2024-05-30T03:39:48+00:00

Last Scan

Scanned2024-05-23T03:39:48+00:00
URL https://dainikamadershomoy.com/robots.txt
Domain IPs 103.29.180.14
Response IP 103.29.180.14
Found Yes
Hash 1a5434213174654abcdeb99ac04a4aac7ea5a4da9de14212d7c3efbb4e17f486
SimHash 2854d3204711

Groups

*

Rule Path
Disallow /view.dainikamadershomoy.com/
Disallow /amp.dainikamadershomoy.com/
Disallow /api.dainikamadershomoy.com/
Disallow /admin.dainikamadershomoy.com/
Disallow /404
Disallow /files/
Disallow /archive/

Comments

  • www.robotstxt.org/
  • Allow crawling of all content