okmusic.jp
robots.txt

Robots Exclusion Standard data for okmusic.jp

Resource Scan

Scan Details

Site Domain okmusic.jp
Base Domain okmusic.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-06T07:25:50+00:00
Next Scan 2024-12-05T07:25:50+00:00

Last Successful Scan

Scanned2024-05-10T06:49:55+00:00
URL https://okmusic.jp/robots.txt
Domain IPs 35.73.223.89, 54.199.190.211
Response IP 54.199.190.211
Found Yes
Hash 8f3adc0cd29389d18fecbabe5b4e408875e1ba8e7256adc0ecc5b72219346066
SimHash b2854d8d6770

Groups

*

Rule Path
Disallow /artists/*/follow_parts.js
Disallow /news/*/review_ajax.js

petalbot

Rule Path
Disallow /

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /