Log In Sign Up

sotoasobi.net
robots.txt

Robots Exclusion Standard data for sotoasobi.net

Resource Scan

Scan Details

Site Domain sotoasobi.net
Base Domain sotoasobi.net
Scan Status Ok
Last Scan2024-11-14T02:58:12+00:00
Next Scan 2024-11-21T02:58:12+00:00

Last Scan

Scanned2024-11-14T02:58:12+00:00
URL https://sotoasobi.net/robots.txt
Domain IPs 35.75.105.140, 54.168.48.56
Response IP 35.75.105.140
Found Yes
Hash 9f17db34d0d599185c981adb0d57943fbb446125b57b215bcd89d70323dfc2b2
SimHash b2dd0b0fe6d0

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /new_admin/
Disallow /reserves/
Disallow /comp/
Disallow /mp/
Disallow /mypage/
Disallow /login/
Disallow /members/
Disallow /make_ld/
Disallow /auth/
Disallow /watched_service/
Disallow /password_resets/
Disallow /activity/*/blog?page=*
Disallow /review/*
Disallow /service/*/top
Disallow /service/*/guide
Disallow /service/*/news
Disallow /service/*/comment
Disallow /service/*/particular
Disallow /course/*/top
Disallow /course/*/tel
Disallow /api
Disallow /cross_*
Disallow /leisure/*/top
Disallow /search/
Disallow /*/search
Disallow /activity/*/qa
Back to top

Other Records

Field Value
sitemap https://sotoasobi.net/sitemaps/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top