gunosy.com
robots.txt

Robots Exclusion Standard data for gunosy.com

Resource Scan

Scan Details

Site Domain gunosy.com
Base Domain gunosy.com
Scan Status Ok
Last Scan2024-11-02T19:32:37+00:00
Next Scan 2024-11-16T19:32:37+00:00

Last Scan

Scanned2024-11-02T19:32:37+00:00
URL https://gunosy.com/robots.txt
Domain IPs 3.165.82.122, 3.165.82.18, 3.165.82.24, 3.165.82.8
Response IP 3.165.82.8
Found Yes
Hash 49f4e49541185ab8749afb5a26a3471e45940c5071ed1a4ea0837ba3f8940171
SimHash 729d7944a592

Groups

ccbot

Rule Path
Disallow /articles/

chatgpt-user

Rule Path
Disallow /articles/

gptbot

Rule Path
Disallow /articles/

google-extended

Rule Path
Disallow /articles/

icc-crawler

Rule Path
Disallow /articles/

anthropic-ai

Rule Path
Disallow /articles/

claudebot

Rule Path
Disallow /articles/

claude-web

Rule Path
Disallow /articles/

applebot-extended

Rule Path
Disallow /articles/

cohere-ai

Rule Path
Disallow /articles/

omgili

Rule Path
Disallow /articles/

omgilibot

Rule Path
Disallow /articles/

perplexitybot

Rule Path
Disallow /articles/

perplexity-ai

Rule Path
Disallow /articles/

Other Records

Field Value
sitemap https://gunosy.com/sitemap.xml