stij.org
robots.txt

Robots Exclusion Standard data for stij.org

Resource Scan

Scan Details

Site Domain stij.org
Base Domain stij.org
Scan Status Ok
Last Scan2025-05-22T05:34:05+00:00
Next Scan 2025-05-29T05:34:05+00:00

Last Scan

Scanned2025-05-22T05:34:05+00:00
URL https://stij.org/robots.txt
Domain IPs 162.241.224.107
Response IP 162.241.224.107
Found Yes
Hash 4eb19123fe5e9dd9e457c6ed050b5fc82b5092c88ced405020c96fe3f6aeb28a
SimHash 40f7efc7c372

Groups

ia_archiver

Product Comment
ia_archiver Web Achive's UA
Rule Path
Disallow /himekami/

libwww-perl

Product Comment
libwww-perl Web Achive's UA
Rule Path
Disallow /himekami/

*

Product Comment
* all robots
Rule Path
Disallow /stats/

*

Product Comment
* all robots
Rule Path
Disallow /cgi-bin/

*

Product Comment
* all robots
Rule Path
Disallow /p/

*

Product Comment
* all robots
Rule Path
Disallow /pay/

*

Product Comment
* all robots
Rule Path
Disallow /himekami/reader/

*

Product Comment
* all robots
Rule Path
Disallow /himekami/das/

*

Product Comment
* all robots
Rule Path
Disallow /himekami/pdf/

*

Product Comment
* all robots
Rule Path
Disallow /himekami/

*

Product Comment
* all robots
Rule Path
Disallow /pod/

googlebot-image

Rule Path
Disallow /drink/img/

Comments

  • http://www.stij.org/
  • Web Archive