web.d-library.jp
robots.txt

Robots Exclusion Standard data for web.d-library.jp

Resource Scan

Scan Details

Site Domain web.d-library.jp
Base Domain d-library.jp
Scan Status Ok
Last Scan2024-06-01T04:08:32+00:00
Next Scan 2024-07-01T04:08:32+00:00

Last Scan

Scanned2024-06-01T04:08:32+00:00
URL https://web.d-library.jp/robots.txt
Domain IPs 13.107.246.73
Response IP 13.107.246.59
Found Yes
Hash 030d73cbed86459be01ca01cbb7aada520672a7c23e52fb15f3e2bbb0b4a47b8
SimHash 5c6eb0d275c6

Groups

googlebot

Rule Path
Disallow /
Disallow /test_20181106/g0101/top/
Disallow /fuguaisyusei1217/g0101/top/
Disallow /nul4/g0101/top/
Disallow /honnomori/g0101/top/
Disallow /trc1/g0101/top/
Disallow /trc_sc/g0101/top/
Disallow /try1/g0101/top/
Disallow /try2/g0101/top/
Disallow /try3/g0101/top/
Disallow /dboard/g0101/top/
Disallow /sensho/g0101/top/
Disallow /mtsa/g0101/top/
Disallow /sample/g0101/top/
Disallow /dnp1/g0101/top/
Disallow /ishikari_libs/g0101/top/
Disallow /test001/g0101/top/
Disallow /demo1/g0101/top/
Disallow /demo2/g0101/top/
Disallow /inagilib/g0101/top/
Disallow /sandafs/g0101/top/
Disallow /the_picture_bookdom/g0101/top/
Disallow /cafelab_test/g0101/top/
Disallow /TRC_DL/g0101/top/
Disallow /cafelab/g0101/top/
Disallow /ggg/g0101/top/
Disallow /dlschool/g0101/top/
Disallow /kmsi_demo/g0101/top/
Disallow /nexs_demo/g0101/top/
Disallow /demo3/g0101/top/
Disallow /dnptest2018/g0101/top/
Disallow /nul1/g0101/top/
Disallow /manual/g0101/top/
Disallow /nul2/g0101/top/
Disallow /cnts_chk_lib/g0101/top/
Disallow /nul5/g0101/top/
Disallow /zdelete/g0101/top/
Disallow /zdelete2/g0101/top/
Disallow /virtuallib/g0101/top/
Disallow /epub/g0101/top/
Disallow /seiwa/g0101/top/
Disallow /kawaton/g0101/top/
Disallow /suzugaku/g0101/top/
Disallow /test_20181106/
Disallow /fuguaisyusei1217/
Disallow /nul4/
Disallow /honnomori/
Disallow /trc1/
Disallow /trc_sc/
Disallow /try1/
Disallow /try2/
Disallow /try3/
Disallow /dboard/
Disallow /sensho/
Disallow /mtsa/
Disallow /sample/
Disallow /dnp1/
Disallow /ishikari_libs/
Disallow /test001/
Disallow /demo1/
Disallow /demo2/
Disallow /inagilib/
Disallow /sandafs/
Disallow /the_picture_bookdom/
Disallow /cafelab_test/
Disallow /TRC_DL/
Disallow /cafelab/
Disallow /ggg/
Disallow /dlschool/
Disallow /kmsi_demo/
Disallow /nexs_demo/
Disallow /demo3/
Disallow /dnptest2018/
Disallow /nul1/
Disallow /manual/
Disallow /nul2/
Disallow /cnts_chk_lib/
Disallow /nul5/
Disallow /zdelete/
Disallow /zdelete2/
Disallow /virtuallib/
Disallow /epub/
Disallow /seiwa/
Disallow /kawaton/
Disallow /suzugaku/
Allow /hakusan/
Allow /takahagi/
Allow /moroyama/
Allow /kawaguchi/
Allow /kasumi/
Allow /koto/
Allow /*/g0101/top/
Allow /*/g0108/guide/

Other Records

Field Value
crawl-delay 180

msnbot

Rule Path
Disallow /
Disallow /test_20181106/g0101/top/
Disallow /fuguaisyusei1217/g0101/top/
Disallow /nul4/g0101/top/
Disallow /honnomori/g0101/top/
Disallow /trc1/g0101/top/
Disallow /trc_sc/g0101/top/
Disallow /try1/g0101/top/
Disallow /try2/g0101/top/
Disallow /try3/g0101/top/
Disallow /dboard/g0101/top/
Disallow /sensho/g0101/top/
Disallow /mtsa/g0101/top/
Disallow /sample/g0101/top/
Disallow /dnp1/g0101/top/
Disallow /ishikari_libs/g0101/top/
Disallow /test001/g0101/top/
Disallow /demo1/g0101/top/
Disallow /demo2/g0101/top/
Disallow /inagilib/g0101/top/
Disallow /sandafs/g0101/top/
Disallow /the_picture_bookdom/g0101/top/
Disallow /cafelab_test/g0101/top/
Disallow /TRC_DL/g0101/top/
Disallow /cafelab/g0101/top/
Disallow /ggg/g0101/top/
Disallow /dlschool/g0101/top/
Disallow /kmsi_demo/g0101/top/
Disallow /nexs_demo/g0101/top/
Disallow /demo3/g0101/top/
Disallow /dnptest2018/g0101/top/
Disallow /nul1/g0101/top/
Disallow /manual/g0101/top/
Disallow /nul2/g0101/top/
Disallow /cnts_chk_lib/g0101/top/
Disallow /nul5/g0101/top/
Disallow /zdelete/g0101/top/
Disallow /zdelete2/g0101/top/
Disallow /virtuallib/g0101/top/
Disallow /epub/g0101/top/
Disallow /seiwa/g0101/top/
Disallow /kawaton/g0101/top/
Disallow /suzugaku/g0101/top/
Disallow /test_20181106/
Disallow /fuguaisyusei1217/
Disallow /nul4/
Disallow /honnomori/
Disallow /trc1/
Disallow /trc_sc/
Disallow /try1/
Disallow /try2/
Disallow /try3/
Disallow /dboard/
Disallow /sensho/
Disallow /mtsa/
Disallow /sample/
Disallow /dnp1/
Disallow /ishikari_libs/
Disallow /test001/
Disallow /demo1/
Disallow /demo2/
Disallow /inagilib/
Disallow /sandafs/
Disallow /the_picture_bookdom/
Disallow /cafelab_test/
Disallow /TRC_DL/
Disallow /cafelab/
Disallow /ggg/
Disallow /dlschool/
Disallow /kmsi_demo/
Disallow /nexs_demo/
Disallow /demo3/
Disallow /dnptest2018/
Disallow /nul1/
Disallow /manual/
Disallow /nul2/
Disallow /cnts_chk_lib/
Disallow /nul5/
Disallow /zdelete/
Disallow /zdelete2/
Disallow /virtuallib/
Disallow /epub/
Disallow /seiwa/
Disallow /kawaton/
Disallow /suzugaku/
Allow /hakusan/
Allow /takahagi/
Allow /moroyama/
Allow /kawaguchi/
Allow /kasumi/
Allow /koto/
Allow /*/g0101/top/
Allow /*/g0108/guide/

Other Records

Field Value
crawl-delay 180

bingbot

Rule Path
Disallow /
Disallow /test_20181106/g0101/top/
Disallow /fuguaisyusei1217/g0101/top/
Disallow /nul4/g0101/top/
Disallow /honnomori/g0101/top/
Disallow /trc1/g0101/top/
Disallow /trc_sc/g0101/top/
Disallow /try1/g0101/top/
Disallow /try2/g0101/top/
Disallow /try3/g0101/top/
Disallow /dboard/g0101/top/
Disallow /sensho/g0101/top/
Disallow /mtsa/g0101/top/
Disallow /sample/g0101/top/
Disallow /dnp1/g0101/top/
Disallow /ishikari_libs/g0101/top/
Disallow /test001/g0101/top/
Disallow /demo1/g0101/top/
Disallow /demo2/g0101/top/
Disallow /inagilib/g0101/top/
Disallow /sandafs/g0101/top/
Disallow /the_picture_bookdom/g0101/top/
Disallow /cafelab_test/g0101/top/
Disallow /TRC_DL/g0101/top/
Disallow /cafelab/g0101/top/
Disallow /ggg/g0101/top/
Disallow /dlschool/g0101/top/
Disallow /kmsi_demo/g0101/top/
Disallow /nexs_demo/g0101/top/
Disallow /demo3/g0101/top/
Disallow /dnptest2018/g0101/top/
Disallow /nul1/g0101/top/
Disallow /manual/g0101/top/
Disallow /nul2/g0101/top/
Disallow /cnts_chk_lib/g0101/top/
Disallow /nul5/g0101/top/
Disallow /zdelete/g0101/top/
Disallow /zdelete2/g0101/top/
Disallow /virtuallib/g0101/top/
Disallow /epub/g0101/top/
Disallow /seiwa/g0101/top/
Disallow /kawaton/g0101/top/
Disallow /suzugaku/g0101/top/
Disallow /test_20181106/
Disallow /fuguaisyusei1217/
Disallow /nul4/
Disallow /honnomori/
Disallow /trc1/
Disallow /trc_sc/
Disallow /try1/
Disallow /try2/
Disallow /try3/
Disallow /dboard/
Disallow /sensho/
Disallow /mtsa/
Disallow /sample/
Disallow /dnp1/
Disallow /ishikari_libs/
Disallow /test001/
Disallow /demo1/
Disallow /demo2/
Disallow /inagilib/
Disallow /sandafs/
Disallow /the_picture_bookdom/
Disallow /cafelab_test/
Disallow /TRC_DL/
Disallow /cafelab/
Disallow /ggg/
Disallow /dlschool/
Disallow /kmsi_demo/
Disallow /nexs_demo/
Disallow /demo3/
Disallow /dnptest2018/
Disallow /nul1/
Disallow /manual/
Disallow /nul2/
Disallow /cnts_chk_lib/
Disallow /nul5/
Disallow /zdelete/
Disallow /zdelete2/
Disallow /virtuallib/
Disallow /epub/
Disallow /seiwa/
Disallow /kawaton/
Disallow /suzugaku/
Allow /hakusan/
Allow /takahagi/
Allow /moroyama/
Allow /kawaguchi/
Allow /kasumi/
Allow /koto/
Allow /*/g0101/top/
Allow /*/g0108/guide/

Other Records

Field Value
crawl-delay 180

y!j

Rule Path
Disallow /
Disallow /test_20181106/g0101/top/
Disallow /fuguaisyusei1217/g0101/top/
Disallow /nul4/g0101/top/
Disallow /honnomori/g0101/top/
Disallow /trc1/g0101/top/
Disallow /trc_sc/g0101/top/
Disallow /try1/g0101/top/
Disallow /try2/g0101/top/
Disallow /try3/g0101/top/
Disallow /dboard/g0101/top/
Disallow /sensho/g0101/top/
Disallow /mtsa/g0101/top/
Disallow /sample/g0101/top/
Disallow /dnp1/g0101/top/
Disallow /ishikari_libs/g0101/top/
Disallow /test001/g0101/top/
Disallow /demo1/g0101/top/
Disallow /demo2/g0101/top/
Disallow /inagilib/g0101/top/
Disallow /sandafs/g0101/top/
Disallow /the_picture_bookdom/g0101/top/
Disallow /cafelab_test/g0101/top/
Disallow /TRC_DL/g0101/top/
Disallow /cafelab/g0101/top/
Disallow /ggg/g0101/top/
Disallow /dlschool/g0101/top/
Disallow /kmsi_demo/g0101/top/
Disallow /nexs_demo/g0101/top/
Disallow /demo3/g0101/top/
Disallow /dnptest2018/g0101/top/
Disallow /nul1/g0101/top/
Disallow /manual/g0101/top/
Disallow /nul2/g0101/top/
Disallow /cnts_chk_lib/g0101/top/
Disallow /nul5/g0101/top/
Disallow /zdelete/g0101/top/
Disallow /zdelete2/g0101/top/
Disallow /virtuallib/g0101/top/
Disallow /epub/g0101/top/
Disallow /seiwa/g0101/top/
Disallow /kawaton/g0101/top/
Disallow /suzugaku/g0101/top/
Disallow /test_20181106/
Disallow /fuguaisyusei1217/
Disallow /nul4/
Disallow /honnomori/
Disallow /trc1/
Disallow /trc_sc/
Disallow /try1/
Disallow /try2/
Disallow /try3/
Disallow /dboard/
Disallow /sensho/
Disallow /mtsa/
Disallow /sample/
Disallow /dnp1/
Disallow /ishikari_libs/
Disallow /test001/
Disallow /demo1/
Disallow /demo2/
Disallow /inagilib/
Disallow /sandafs/
Disallow /the_picture_bookdom/
Disallow /cafelab_test/
Disallow /TRC_DL/
Disallow /cafelab/
Disallow /ggg/
Disallow /dlschool/
Disallow /kmsi_demo/
Disallow /nexs_demo/
Disallow /demo3/
Disallow /dnptest2018/
Disallow /nul1/
Disallow /manual/
Disallow /nul2/
Disallow /cnts_chk_lib/
Disallow /nul5/
Disallow /zdelete/
Disallow /zdelete2/
Disallow /virtuallib/
Disallow /epub/
Disallow /seiwa/
Disallow /kawaton/
Disallow /suzugaku/
Allow /hakusan/
Allow /takahagi/
Allow /moroyama/
Allow /kawaguchi/
Allow /kasumi/
Allow /koto/
Allow /*/g0101/top/
Allow /*/g0108/guide/

Other Records

Field Value
crawl-delay 180

*

Rule Path
Disallow /