Log In Sign Up

studyplus.jp
robots.txt

Robots Exclusion Standard data for studyplus.jp

Resource Scan

Scan Details

Site Domain studyplus.jp
Base Domain studyplus.jp
Scan Status Ok
Last Scan2024-11-12T18:47:40+00:00
Next Scan 2024-11-19T18:47:40+00:00

Last Scan

Scanned2024-11-12T18:47:40+00:00
URL https://studyplus.jp/robots.txt
Redirect https://www.studyplus.jp/robots.txt
Redirect Domain www.studyplus.jp
Redirect Base studyplus.jp
Domain IPs 3.165.102.114, 3.165.102.120, 3.165.102.25, 3.165.102.47
Redirect IPs 18.180.198.163, 54.92.16.164
Response IP 18.180.198.163
Found Yes
Hash 66da0b3c967269a36708e94729a56f2eb0b780c581fb1f35932dacc64e071140
SimHash a20d0c8f75d1

Groups

*

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.studyplus.jp/sitemap/articles.xml.gz
sitemap https://www.studyplus.jp/sitemap/colleges.xml.gz
Back to top

Comments

  • See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top