surfsnow.jp
robots.txt

Robots Exclusion Standard data for surfsnow.jp

Resource Scan

Scan Details

Site Domain surfsnow.jp
Base Domain surfsnow.jp
Scan Status Ok
Last Scan2024-09-21T08:30:34+00:00
Next Scan 2024-09-28T08:30:34+00:00

Last Scan

Scanned2024-09-21T08:30:34+00:00
URL https://surfsnow.jp/robots.txt
Domain IPs 13.225.4.24, 13.225.4.39, 13.225.4.70, 13.225.4.83
Response IP 13.225.4.24
Found Yes
Hash b77d7fb085cc7ba582e2b6ad9bd6e2827abe6652d7df936c9b01063e96002f80
SimHash 5895f571ae90

Groups

*

Rule Path
Disallow /admin/
Disallow /rsv-admin/
Disallow /sp/my/index/
Disallow /sp/my/ticket/
Disallow /sp/my/smalif/
Disallow /sp/my/favorite/
Disallow /review/my/smalif/
Disallow /review/my/ticket/
Disallow /review/my/favorite/
Disallow /review/alert/
Disallow /mailmaga/
Disallow /snolog/

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

proximic

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

mappy

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

integralads

Rule Path
Disallow /

jet-bot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

newspaper

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

webdatastats

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

www.logicad.com

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

guzzlehttp

Rule Path
Disallow /

loilonote

Rule Path
Disallow /

discordbot

Rule Path
Disallow /

dcrawl

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

embedly

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

solofield

Rule Path
Disallow /

trendsmapresolver

Rule Path
Disallow /

linkfluence.com

Rule Path
Disallow /

mwfeedparser

Rule Path
Disallow /

shortlinktranslate

Rule Path
Disallow /

make-fetch-happen

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

minipass-fetch

Rule Path
Disallow /

admantx.com

Rule Path
Disallow /

scrapy.org

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

obot

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

clark-crawler

Rule Path
Disallow /

nutch

Rule Path
Disallow /

node-fetch

Rule Path
Disallow /

nuclei

Rule Path
Disallow /

Comments

  • å
  • 旧管理画面/旧予約管理画面のアクセスを拒否
  • マイページ画面のアクセスを拒否
  • 投稿警告画面のアクセスを拒否
  • 旧メルマガのアクセスを拒否
  • 旧snologのアクセスを拒否
  • 不正クローラ、å
  • bing と yandex の indexがå
  • User-Agent: yandex
  • Disallow: /

Warnings

  • 3 invalid lines.