Log In Sign Up

snabi.jp
robots.txt

Robots Exclusion Standard data for snabi.jp

Resource Scan

Scan Details

Site Domain snabi.jp
Base Domain snabi.jp
Scan Status Ok
Last Scan2024-09-20T00:19:53+00:00
Next Scan 2024-10-20T00:19:53+00:00

Last Scan

Scanned2024-09-20T00:19:53+00:00
URL https://snabi.jp/robots.txt
Domain IPs 108.156.133.129, 108.156.133.37, 108.156.133.57, 108.156.133.76
Response IP 108.156.133.57
Found Yes
Hash 7b2a012e115baeaf0fbb95e72bee4e9c0d200432d78a327003ebe296144e7fd8
SimHash a2177f856766

Groups

bingbot

Rule Path
Disallow /ikou/stations/
Disallow /keizoku/type_a/stations/
Disallow /keizoku/type_b/stations/
Disallow /*blog_articles

seekport crawler

Rule Path
Disallow /
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
Back to top