Log In Sign Up

thinkbiotech.com
robots.txt

Robots Exclusion Standard data for thinkbiotech.com

Resource Scan

Scan Details

Site Domain thinkbiotech.com
Base Domain thinkbiotech.com
Scan Status Ok
Last Scan2025-08-12T23:31:49+00:00
Next Scan 2025-09-11T23:31:49+00:00

Last Scan

Scanned2025-08-12T23:31:49+00:00
URL https://thinkbiotech.com/robots.txt
Domain IPs 104.21.10.158, 172.67.131.140, 2606:4700:3030::ac43:838c, 2606:4700:3033::6815:a9e
Response IP 104.21.10.158
Found Yes
Hash 7b8bb237a55b2a729a62b52b98d40a44be32188bc0033b03afa064af161b02ab
SimHash 73f6c7d2489d

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4
Back to top

Comments

  • ACAP version=1.0
  • All robots will spider the domain
  • All robots will spider the domain
  • User-agent: *
Back to top

Warnings

  • `acap-crawler` is not a known field.
Back to top