jut-su.today
robots.txt

Robots Exclusion Standard data for jut-su.today

Resource Scan

Scan Details

Site Domain jut-su.today
Base Domain jut-su.today
Scan Status Ok
Last Scan2024-11-08T16:22:35+00:00
Next Scan 2024-11-15T16:22:35+00:00

Last Scan

Scanned2024-11-08T16:22:35+00:00
URL https://jut-su.today/robots.txt
Domain IPs 104.21.14.217, 172.67.160.153, 2606:4700:3033::6815:ed9, 2606:4700:3034::ac43:a099
Response IP 172.67.160.153
Found Yes
Hash 3e9b4c95cba467398fb0a0cb689a5010cc77800e66a41bd38fa392871b5a4693
SimHash d915ac53e432

Groups

ia_archiver

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

*

Rule Path
Allow /*.js
Allow /*.css
Allow /engine/classes/js/
Allow /engine/classes/min/index.php
Allow /engine/data/emoticons/
Disallow /engine/*
Disallow */page/*/
Disallow */page/
Disallow /emoticon/
Disallow /emoticon/*
Disallow */emoticon/
Disallow /user/*
Disallow /?*
Disallow /engine/go.php
Disallow /user/
Disallow /*orderdesc
Disallow /*orderdesc*
Disallow /orderdesc/*
Disallow /orderdesc
Disallow */characters
Disallow */peoples
Disallow /lastnews/*
Disallow /catalog/*
Disallow /newposts/*
Disallow /xfsearch/*
Disallow /selections/*
Disallow /rules.html
Disallow /registration.html
Disallow /statistics.html
Disallow /rulescom.html
Disallow /lastviewed.tpl
Disallow /vip.tpl
Disallow /top.tpl
Disallow /allnews.tpl
Disallow /genres.tpl
Disallow /playlists.tpl
Disallow /youwatch.tpl
Disallow /index.php?do=*
Disallow /*print
Disallow /*print%3A*
Disallow /*rss.xml
Disallow /addnews.html
Disallow /favorites/*
Disallow /review/
Disallow /xfsearch/
Disallow /review/*
Disallow /mylists/*
Disallow /character/
Disallow /character/*
Disallow /people/
Disallow /people/*
Disallow /actor/
Disallow /collections/*
Disallow /year/*
Disallow */page/*
Disallow /actor/*
Disallow */characters
Disallow */peoples
Disallow /f/*
Disallow /f/
Disallow /%26*

yandex

Rule Path
Allow /*.js
Allow /*.css
Allow /engine/classes/js/
Allow /engine/classes/min/index.php
Allow /engine/data/emoticons/
Disallow /engine/*
Disallow */page/*/
Disallow */page/
Disallow /emoticon/
Disallow /emoticon/*
Disallow */emoticon/
Disallow /?*
Disallow /engine/go.php
Disallow /user/
Disallow /user/*
Disallow /*orderdesc
Disallow /*orderdesc*
Disallow /orderdesc/*
Disallow /orderdesc
Disallow /lastnews/*
Disallow /catalog/*
Disallow /xfsearch/*
Disallow /newposts/*
Disallow /selections/*
Disallow /rules.html
Disallow /statistics.html
Disallow /registration.html
Disallow /rulescom.html
Disallow /lastviewed.tpl
Disallow /vip.tpl
Disallow /top.tpl
Disallow /allnews.tpl
Disallow /genres.tpl
Disallow /playlists.tpl
Disallow /youwatch.tpl
Disallow /collections/*
Disallow /year/*
Disallow /index.php?do=*
Disallow /*print
Disallow /xfsearch/
Disallow /*print%3A*
Disallow /*rss.xml
Disallow /addnews.html
Disallow /favorites/*
Disallow /mylists/*
Disallow /review/
Disallow /review/*
Disallow /character/
Disallow /character/*
Disallow /people/
Disallow /people/*
Disallow */characters
Disallow */peoples
Disallow /actor/
Disallow */page/*
Disallow /actor/*
Disallow /f/*
Disallow /f/
Disallow /%26*

googlebot

Rule Path
Allow /*.js
Allow /*.css
Allow /engine/classes/js/
Allow /engine/classes/min/index.php
Allow /engine/data/emoticons/
Disallow /engine/*
Disallow */page/*/
Disallow */page/
Disallow /emoticon/
Disallow /emoticon/*
Disallow */emoticon/
Disallow /?*
Disallow /engine/go.php
Disallow /user/
Disallow /user/*
Disallow /*orderdesc
Disallow /*orderdesc
Disallow /*orderdesc*
Disallow /orderdesc/*
Disallow /orderdesc
Disallow /lastnews/*
Disallow /xfsearch/*
Disallow /catalog/*
Disallow */characters
Disallow */peoples
Disallow /newposts/*
Disallow /xfsearch/
Disallow /selections/*
Disallow /rules.html
Disallow /registration.html
Disallow /rulescom.html
Disallow /lastviewed.tpl
Disallow /allnews.tpl
Disallow /vip.tpl
Disallow /year/*
Disallow /collections/*
Disallow /top.tpl
Disallow /genres.tpl
Disallow /playlists.tpl
Disallow /youwatch.tpl
Disallow /statistics.html
Disallow /index.php?do=*
Disallow /*print
Disallow /*print%3A*
Disallow /*rss.xml
Disallow /addnews.html
Disallow /favorites/*
Disallow /mylists/*
Disallow /review/
Disallow /review/*
Disallow /character/
Disallow */page/*
Disallow /character/*
Disallow /people/
Disallow /people/*
Disallow /actor/
Disallow /actor/*
Disallow /f/*
Disallow /f/
Disallow /%26*

Other Records

Field Value
sitemap https://jut-su.today/sitemap.xml

Warnings

  • `host` is not a known field.