genscript.com
robots.txt

Robots Exclusion Standard data for genscript.com

Resource Scan

Scan Details

Site Domain genscript.com
Base Domain genscript.com
Scan Status Ok
Last Scan2026-01-30T07:25:44+00:00
Next Scan 2026-03-01T07:25:44+00:00

Last Scan

Scanned2026-01-30T07:25:44+00:00
URL https://genscript.com/robots.txt
Redirect https://www.genscript.com/robots.txt
Redirect Domain www.genscript.com
Redirect Base genscript.com
Domain IPs 142.215.186.249
Redirect IPs 172.66.40.91, 172.66.43.165, 2606:4700:3108::ac42:285b, 2606:4700:3108::ac42:2ba5
Response IP 172.66.40.91
Found Yes
Hash 8c46823b3f894d0163485a1cf9708170761d5ee99b812d0929be15e7c36c6336
SimHash ce3cd660ee1a

Groups

*

Rule Path
Disallow /cgi-bin/promotion/
Disallow /ssl-bin/order_product
Disallow /cms/tmp/
Disallow /tmp/
Disallow /cms/
Disallow /app/
Disallow /document/
Disallow /document/manu_workorder/
Disallow /product_001/genome/
Disallow /punchout/
Disallow /login/
Disallow /signup/
Disallow /search
Disallow /customer/
Disallow /ajax/
Disallow /happy-easter-special-offer.html
Disallow /happy-easter-special-offer.html?src=mostpopular

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

turnitin

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60