thinktoyama.jp
robots.txt

Robots Exclusion Standard data for thinktoyama.jp

Resource Scan

Scan Details

Site Domain thinktoyama.jp
Base Domain thinktoyama.jp
Scan Status Ok
Last Scan2024-10-20T04:33:10+00:00
Next Scan 2024-11-19T04:33:10+00:00

Last Scan

Scanned2024-10-20T04:33:10+00:00
URL https://thinktoyama.jp/robots.txt
Redirect https://www.thinktoyama.jp/robots.txt
Redirect Domain www.thinktoyama.jp
Redirect Base thinktoyama.jp
Domain IPs 52.68.3.99
Redirect IPs 52.68.3.99
Response IP 52.68.3.99
Found Yes
Hash 2d14cba2298e1812ae137641c4b221b1800a0f590c16d426b7d625403fdcaea2
SimHash 5115407eff9a

Groups

archive.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

duckduckgo-favicons-bot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

ias-sg

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

serendeputybot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

superfeedr

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

woorank

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /