bdstorynet.com
robots.txt

Robots Exclusion Standard data for bdstorynet.com

Resource Scan

Scan Details

Site Domain bdstorynet.com
Base Domain bdstorynet.com
Scan Status Ok
Last Scan2024-09-22T14:39:39+00:00
Next Scan 2024-09-29T14:39:39+00:00

Last Scan

Scanned2024-09-22T14:39:39+00:00
URL https://bdstorynet.com/robots.txt
Redirect https://www.bdstorynet.com/robots.txt
Redirect Domain www.bdstorynet.com
Redirect Base bdstorynet.com
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 2404:6800:4003:c02::79, 74.125.68.121
Response IP 142.251.175.121
Found Yes
Hash d9c8b71fad92d2b51670c6997fc4f1fc896e8aac7cdca3f79839d13193321fc2
SimHash 69009052ce93

Groups

*

Rule Path
Allow /search
Allow /

Other Records

Field Value
sitemap https://www.bdstorynet.com/atom.xml?redirect=false&start-index=1&max-results=500