sendenkaigi.com
robots.txt

Robots Exclusion Standard data for sendenkaigi.com

Resource Scan

Scan Details

Site Domain sendenkaigi.com
Base Domain sendenkaigi.com
Scan Status Ok
Last Scan2025-11-20T17:22:14+00:00
Next Scan 2025-12-20T17:22:14+00:00

Last Scan

Scanned2025-11-20T17:22:14+00:00
URL https://sendenkaigi.com/robots.txt
Redirect https://www.sendenkaigi.com:443/robots.txt
Redirect Domain www.sendenkaigi.com
Redirect Base sendenkaigi.com
Domain IPs 3.112.158.51, 54.65.50.174
Redirect IPs 13.35.238.110, 13.35.238.113, 13.35.238.14, 13.35.238.51
Response IP 13.35.238.110
Found Yes
Hash 2dd2341a2c3bc47741a68727054b05b0e3713494e7de323051aebe8426dff221
SimHash 3015ab09a786

Groups

*

Rule Path
Disallow /*.csv$

ccbot

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

gptbot

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

chatgpt-user

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

google-extended

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

anthropic-ai

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

cohere-ai

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

omgili

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

omgilibot

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

icc-crawler

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

applebot-extended

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

claudebot

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

claude-web

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

claude-searchbot

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

claude-user

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

perplexitybot

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

perplexity-ai

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

perplexity-user

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

bytespider

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

diffbot

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

facebookbot

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

oai-searchbot

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

mj12bot

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

piplbot

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

meta-externalagent

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

timpibot

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

webzio

Rule Path
Disallow /marketing/media/
Disallow /creative/media/

webzio-extended

Rule Path
Disallow /marketing/media/