Log In Sign Up

sugutama.jp
robots.txt

Robots Exclusion Standard data for sugutama.jp

Resource Scan

Scan Details

Site Domain sugutama.jp
Base Domain sugutama.jp
Scan Status Ok
Last Scan2024-11-09T09:00:56+00:00
Next Scan 2024-11-16T09:00:56+00:00

Last Scan

Scanned2024-11-09T09:00:56+00:00
URL https://sugutama.jp/robots.txt
Redirect https://www.netmile.co.jp/sugutama/robots.txt
Redirect Domain www.netmile.co.jp
Redirect Base netmile.co.jp
Domain IPs 104.17.106.10, 104.17.107.10
Redirect IPs 104.18.24.222, 104.18.25.222
Response IP 104.18.25.222
Found Yes
Hash 4894544ac5ab737cc38762a2149f16110c441b8a6f6664935600fbe643c485e2
SimHash eaa50c056550

Groups

*

Rule Path
Disallow /lm/
Disallow /mypage
Disallow /api/
Disallow /healthcheck
Back to top

Other Records

Field Value
sitemap https://www.netmile.co.jp/sugutama/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top