shopbiz.jp
robots.txt

Robots Exclusion Standard data for shopbiz.jp

Resource Scan

Scan Details

Site Domain shopbiz.jp
Base Domain shopbiz.jp
Scan Status Ok
Last Scan2024-06-04T01:14:30+00:00
Next Scan 2024-07-04T01:14:30+00:00

Last Scan

Scanned2024-06-04T01:14:30+00:00
URL https://www.shopbiz.jp/robots.txt
Redirect https://messe.nikkei.co.jp:443/robots.txt
Redirect Domain messe.nikkei.co.jp
Redirect Base nikkei.co.jp
Domain IPs 18.181.141.8, 54.238.162.239
Redirect IPs 108.157.254.110, 108.157.254.124, 108.157.254.33, 108.157.254.69, 2600:9000:2753:4600:19:a077:7f40:93a1, 2600:9000:2753:6600:19:a077:7f40:93a1, 2600:9000:2753:6c00:19:a077:7f40:93a1, 2600:9000:2753:7000:19:a077:7f40:93a1, 2600:9000:2753:a00:19:a077:7f40:93a1, 2600:9000:2753:a400:19:a077:7f40:93a1, 2600:9000:2753:ac00:19:a077:7f40:93a1, 2600:9000:2753:c800:19:a077:7f40:93a1
Response IP 108.157.254.69
Found Yes
Hash dec8fcfb56eb0bb55068826a0984a41593b4c47ae7837f7d25b5106b7cd46a9c
SimHash 1ab44968a123

Groups

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /