academy.drone.rakuten.co.jp
robots.txt

Robots Exclusion Standard data for academy.drone.rakuten.co.jp

Resource Scan

Scan Details

Site Domain academy.drone.rakuten.co.jp
Base Domain rakuten.co.jp
Scan Status Ok
Last Scan2024-04-14T18:41:33+00:00
Next Scan 2024-05-14T18:41:33+00:00

Last Scan

Scanned2024-04-14T18:41:33+00:00
URL https://academy.drone.rakuten.co.jp/robots.txt
Domain IPs 133.237.60.127
Response IP 133.237.60.127
Found Yes
Hash ebe7c0fc23ba8a9c080d16a9ee417603deb6db2a8162be8c1d3220ec0d5815a4
SimHash c2510925eb17

Groups

*

Rule Path
Disallow /beginner/
Disallow /interview/
Disallow /joseikin/
Disallow /marutsubame/
Disallow /campaign/
Disallow /pdf/viewer.html?file=introduction.pdf
Disallow /pdf/viewer.html?file=inspection.pdf
Disallow /pdf/viewer.html?file=introduction.pdf

Comments

  • å
  • 指定したディレクトリ以下をクロール禁止
  • PDF
  • クロールを許可するディレクトリを指定
  • パスが長い方が優å
  • Allow: /farm/app/growthHistory/
  • User-agent: *
  • Sitemap: https://academy.drone.rakuten.co.jp/sitemap.xml

Warnings

  • 2 invalid lines.