biostec.org
robots.txt

Robots Exclusion Standard data for biostec.org

Resource Scan

Scan Details

Site Domain biostec.org
Base Domain biostec.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2025-11-21T09:20:35+00:00
Next Scan 2026-01-20T09:20:35+00:00

Last Successful Scan

Scanned2025-08-31T08:58:51+00:00
URL https://biostec.org/robots.txt
Redirect https://www.biostec.org/robots.txt
Redirect Domain www.biostec.org
Redirect Base biostec.org
Domain IPs 104.21.21.116, 172.67.198.78, 2606:4700:3032::ac43:c64e, 2606:4700:3036::6815:1574
Redirect IPs 104.21.21.116, 172.67.198.78, 2606:4700:3032::ac43:c64e, 2606:4700:3036::6815:1574
Response IP 104.21.21.116
Found Yes
Hash dc2f08337f914b83104b1cc09a2e273eec7d4003cc6fd7046411db9500c6056f
SimHash 6550dc546711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10