grape-shop.jp
robots.txt
Robots Exclusion Standard data for grape-shop.jp
Resource Scan
Scan Details
Site Domain | grape-shop.jp |
Base Domain | grape-shop.jp |
Scan Status | Ok |
Last Scan | 2024-11-14T01:24:39+00:00 |
Next Scan | 2024-12-14T01:24:39+00:00 |
Last Scan
Scanned | 2024-11-14T01:24:39+00:00 |
URL | https://grape-shop.jp/robots.txt |
Redirect | https://www.grape-shop.jp/robots.txt |
Redirect Domain | www.grape-shop.jp |
Redirect Base | grape-shop.jp |
Domain IPs | 153.125.132.71, 2401:2500:10a:2000:153:125:132:71 |
Redirect IPs | 153.125.132.71, 2401:2500:10a:2000:153:125:132:71 |
Response IP | 153.125.132.71 |
Found | Yes |
Hash | 4dfcc49016eb8a5efd73c07ace30d0f3175ed4325baddd6729ca45b3a3b3b326 |
SimHash | 99149a48ee98 |
Groups
twitterbot
coccocbot-web
pinterestbot
linespider
mj12bot
baiduspider
cincraw
petalbot
yandexbot
dotbot
dataforseobot
semrushbot
ahrefsbot
blexbot
entferbot
wellknownbot
obot
duckduckgo-favicons-bot
duckduckbot-https
mail.ru_bot
megaindex.ru
adsbot
inetdex-bot
neevabot
yeti
fluid
yak
ahrefssiteaudit
barkrowler
tpradstxtcrawler
icc-crawler
ev-crawler
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | / |