stockfresh.com
robots.txt

Robots Exclusion Standard data for stockfresh.com

Resource Scan

Scan Details

Site Domain stockfresh.com
Base Domain stockfresh.com
Scan Status Ok
Last Scan2024-05-11T21:28:51+00:00
Next Scan 2024-06-10T21:28:51+00:00

Last Scan

Scanned2024-05-11T21:28:51+00:00
URL https://stockfresh.com/robots.txt
Domain IPs 104.26.0.172, 104.26.1.172, 172.67.75.42, 2606:4700:20::681a:1ac, 2606:4700:20::681a:ac, 2606:4700:20::ac43:4b2a
Response IP 104.26.0.172
Found Yes
Hash 27a1f63c18021f356801c381482262ac65f0f35256758c1fa535205f5decb1e4
SimHash 4551c942c793

Groups

*

Rule Path
Allow /
Disallow /lightbox
Disallow /similars
Disallow /series
Disallow /cart
Disallow /advanced_search

*

Rule Path
Disallow

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /