blueskybio.com
robots.txt

Robots Exclusion Standard data for blueskybio.com

Resource Scan

Scan Details

Site Domain blueskybio.com
Base Domain blueskybio.com
Scan Status Ok
Last Scan2024-06-13T05:39:33+00:00
Next Scan 2024-07-13T05:39:33+00:00

Last Scan

Scanned2024-06-13T05:39:33+00:00
URL https://blueskybio.com/robots.txt
Domain IPs 104.26.10.114, 104.26.11.114, 172.67.75.165, 2606:4700:20::681a:a72, 2606:4700:20::681a:b72, 2606:4700:20::ac43:4ba5
Response IP 104.26.11.114
Found Yes
Hash d37fe9c0e8a950ffad6f04af282e734d5e9dd17537a96b8c8fcdd32ccca89fa0
SimHash 28041d24a351

Groups

*

Rule Path
Allow /
Disallow /functions/

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

amazonbot

Rule Path
Disallow /store/
Disallow /bsplicense/
Disallow /caffeine/
Disallow /css/
Disallow /files/
Disallow /functions/
Disallow /images/
Disallow /js/
Disallow /livehelp/
Disallow /update/
Disallow /vendor/

amazon-kendra

Rule Path
Allow /pages/

Other Records

Field Value
sitemap https://blueskybio.com/sitemap.xml