web.d-library.jp
robots.txt
Robots Exclusion Standard data for web.d-library.jp
Resource Scan
Scan Details
| Site Domain | web.d-library.jp |
| Base Domain | d-library.jp |
| Scan Status | Ok |
| Last Scan | 2024-10-29T04:23:55+00:00 |
| Next Scan | 2024-11-28T04:23:55+00:00 |
Last Scan
| Scanned | 2024-10-29T04:23:55+00:00 |
| URL | https://web.d-library.jp/robots.txt |
| Domain IPs | 13.107.246.59 |
| Response IP | 13.107.246.59 |
| Found | Yes |
| Hash | 030d73cbed86459be01ca01cbb7aada520672a7c23e52fb15f3e2bbb0b4a47b8 |
| SimHash | 5c6eb0d275c6 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /test_20181106/g0101/top/ |
| Disallow | /fuguaisyusei1217/g0101/top/ |
| Disallow | /nul4/g0101/top/ |
| Disallow | /honnomori/g0101/top/ |
| Disallow | /trc1/g0101/top/ |
| Disallow | /trc_sc/g0101/top/ |
| Disallow | /try1/g0101/top/ |
| Disallow | /try2/g0101/top/ |
| Disallow | /try3/g0101/top/ |
| Disallow | /dboard/g0101/top/ |
| Disallow | /sensho/g0101/top/ |
| Disallow | /mtsa/g0101/top/ |
| Disallow | /sample/g0101/top/ |
| Disallow | /dnp1/g0101/top/ |
| Disallow | /ishikari_libs/g0101/top/ |
| Disallow | /test001/g0101/top/ |
| Disallow | /demo1/g0101/top/ |
| Disallow | /demo2/g0101/top/ |
| Disallow | /inagilib/g0101/top/ |
| Disallow | /sandafs/g0101/top/ |
| Disallow | /the_picture_bookdom/g0101/top/ |
| Disallow | /cafelab_test/g0101/top/ |
| Disallow | /TRC_DL/g0101/top/ |
| Disallow | /cafelab/g0101/top/ |
| Disallow | /ggg/g0101/top/ |
| Disallow | /dlschool/g0101/top/ |
| Disallow | /kmsi_demo/g0101/top/ |
| Disallow | /nexs_demo/g0101/top/ |
| Disallow | /demo3/g0101/top/ |
| Disallow | /dnptest2018/g0101/top/ |
| Disallow | /nul1/g0101/top/ |
| Disallow | /manual/g0101/top/ |
| Disallow | /nul2/g0101/top/ |
| Disallow | /cnts_chk_lib/g0101/top/ |
| Disallow | /nul5/g0101/top/ |
| Disallow | /zdelete/g0101/top/ |
| Disallow | /zdelete2/g0101/top/ |
| Disallow | /virtuallib/g0101/top/ |
| Disallow | /epub/g0101/top/ |
| Disallow | /seiwa/g0101/top/ |
| Disallow | /kawaton/g0101/top/ |
| Disallow | /suzugaku/g0101/top/ |
| Disallow | /test_20181106/ |
| Disallow | /fuguaisyusei1217/ |
| Disallow | /nul4/ |
| Disallow | /honnomori/ |
| Disallow | /trc1/ |
| Disallow | /trc_sc/ |
| Disallow | /try1/ |
| Disallow | /try2/ |
| Disallow | /try3/ |
| Disallow | /dboard/ |
| Disallow | /sensho/ |
| Disallow | /mtsa/ |
| Disallow | /sample/ |
| Disallow | /dnp1/ |
| Disallow | /ishikari_libs/ |
| Disallow | /test001/ |
| Disallow | /demo1/ |
| Disallow | /demo2/ |
| Disallow | /inagilib/ |
| Disallow | /sandafs/ |
| Disallow | /the_picture_bookdom/ |
| Disallow | /cafelab_test/ |
| Disallow | /TRC_DL/ |
| Disallow | /cafelab/ |
| Disallow | /ggg/ |
| Disallow | /dlschool/ |
| Disallow | /kmsi_demo/ |
| Disallow | /nexs_demo/ |
| Disallow | /demo3/ |
| Disallow | /dnptest2018/ |
| Disallow | /nul1/ |
| Disallow | /manual/ |
| Disallow | /nul2/ |
| Disallow | /cnts_chk_lib/ |
| Disallow | /nul5/ |
| Disallow | /zdelete/ |
| Disallow | /zdelete2/ |
| Disallow | /virtuallib/ |
| Disallow | /epub/ |
| Disallow | /seiwa/ |
| Disallow | /kawaton/ |
| Disallow | /suzugaku/ |
| Allow | /hakusan/ |
| Allow | /takahagi/ |
| Allow | /moroyama/ |
| Allow | /kawaguchi/ |
| Allow | /kasumi/ |
| Allow | /koto/ |
| Allow | /*/g0101/top/ |
| Allow | /*/g0108/guide/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 180 |
msnbot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /test_20181106/g0101/top/ |
| Disallow | /fuguaisyusei1217/g0101/top/ |
| Disallow | /nul4/g0101/top/ |
| Disallow | /honnomori/g0101/top/ |
| Disallow | /trc1/g0101/top/ |
| Disallow | /trc_sc/g0101/top/ |
| Disallow | /try1/g0101/top/ |
| Disallow | /try2/g0101/top/ |
| Disallow | /try3/g0101/top/ |
| Disallow | /dboard/g0101/top/ |
| Disallow | /sensho/g0101/top/ |
| Disallow | /mtsa/g0101/top/ |
| Disallow | /sample/g0101/top/ |
| Disallow | /dnp1/g0101/top/ |
| Disallow | /ishikari_libs/g0101/top/ |
| Disallow | /test001/g0101/top/ |
| Disallow | /demo1/g0101/top/ |
| Disallow | /demo2/g0101/top/ |
| Disallow | /inagilib/g0101/top/ |
| Disallow | /sandafs/g0101/top/ |
| Disallow | /the_picture_bookdom/g0101/top/ |
| Disallow | /cafelab_test/g0101/top/ |
| Disallow | /TRC_DL/g0101/top/ |
| Disallow | /cafelab/g0101/top/ |
| Disallow | /ggg/g0101/top/ |
| Disallow | /dlschool/g0101/top/ |
| Disallow | /kmsi_demo/g0101/top/ |
| Disallow | /nexs_demo/g0101/top/ |
| Disallow | /demo3/g0101/top/ |
| Disallow | /dnptest2018/g0101/top/ |
| Disallow | /nul1/g0101/top/ |
| Disallow | /manual/g0101/top/ |
| Disallow | /nul2/g0101/top/ |
| Disallow | /cnts_chk_lib/g0101/top/ |
| Disallow | /nul5/g0101/top/ |
| Disallow | /zdelete/g0101/top/ |
| Disallow | /zdelete2/g0101/top/ |
| Disallow | /virtuallib/g0101/top/ |
| Disallow | /epub/g0101/top/ |
| Disallow | /seiwa/g0101/top/ |
| Disallow | /kawaton/g0101/top/ |
| Disallow | /suzugaku/g0101/top/ |
| Disallow | /test_20181106/ |
| Disallow | /fuguaisyusei1217/ |
| Disallow | /nul4/ |
| Disallow | /honnomori/ |
| Disallow | /trc1/ |
| Disallow | /trc_sc/ |
| Disallow | /try1/ |
| Disallow | /try2/ |
| Disallow | /try3/ |
| Disallow | /dboard/ |
| Disallow | /sensho/ |
| Disallow | /mtsa/ |
| Disallow | /sample/ |
| Disallow | /dnp1/ |
| Disallow | /ishikari_libs/ |
| Disallow | /test001/ |
| Disallow | /demo1/ |
| Disallow | /demo2/ |
| Disallow | /inagilib/ |
| Disallow | /sandafs/ |
| Disallow | /the_picture_bookdom/ |
| Disallow | /cafelab_test/ |
| Disallow | /TRC_DL/ |
| Disallow | /cafelab/ |
| Disallow | /ggg/ |
| Disallow | /dlschool/ |
| Disallow | /kmsi_demo/ |
| Disallow | /nexs_demo/ |
| Disallow | /demo3/ |
| Disallow | /dnptest2018/ |
| Disallow | /nul1/ |
| Disallow | /manual/ |
| Disallow | /nul2/ |
| Disallow | /cnts_chk_lib/ |
| Disallow | /nul5/ |
| Disallow | /zdelete/ |
| Disallow | /zdelete2/ |
| Disallow | /virtuallib/ |
| Disallow | /epub/ |
| Disallow | /seiwa/ |
| Disallow | /kawaton/ |
| Disallow | /suzugaku/ |
| Allow | /hakusan/ |
| Allow | /takahagi/ |
| Allow | /moroyama/ |
| Allow | /kawaguchi/ |
| Allow | /kasumi/ |
| Allow | /koto/ |
| Allow | /*/g0101/top/ |
| Allow | /*/g0108/guide/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 180 |
bingbot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /test_20181106/g0101/top/ |
| Disallow | /fuguaisyusei1217/g0101/top/ |
| Disallow | /nul4/g0101/top/ |
| Disallow | /honnomori/g0101/top/ |
| Disallow | /trc1/g0101/top/ |
| Disallow | /trc_sc/g0101/top/ |
| Disallow | /try1/g0101/top/ |
| Disallow | /try2/g0101/top/ |
| Disallow | /try3/g0101/top/ |
| Disallow | /dboard/g0101/top/ |
| Disallow | /sensho/g0101/top/ |
| Disallow | /mtsa/g0101/top/ |
| Disallow | /sample/g0101/top/ |
| Disallow | /dnp1/g0101/top/ |
| Disallow | /ishikari_libs/g0101/top/ |
| Disallow | /test001/g0101/top/ |
| Disallow | /demo1/g0101/top/ |
| Disallow | /demo2/g0101/top/ |
| Disallow | /inagilib/g0101/top/ |
| Disallow | /sandafs/g0101/top/ |
| Disallow | /the_picture_bookdom/g0101/top/ |
| Disallow | /cafelab_test/g0101/top/ |
| Disallow | /TRC_DL/g0101/top/ |
| Disallow | /cafelab/g0101/top/ |
| Disallow | /ggg/g0101/top/ |
| Disallow | /dlschool/g0101/top/ |
| Disallow | /kmsi_demo/g0101/top/ |
| Disallow | /nexs_demo/g0101/top/ |
| Disallow | /demo3/g0101/top/ |
| Disallow | /dnptest2018/g0101/top/ |
| Disallow | /nul1/g0101/top/ |
| Disallow | /manual/g0101/top/ |
| Disallow | /nul2/g0101/top/ |
| Disallow | /cnts_chk_lib/g0101/top/ |
| Disallow | /nul5/g0101/top/ |
| Disallow | /zdelete/g0101/top/ |
| Disallow | /zdelete2/g0101/top/ |
| Disallow | /virtuallib/g0101/top/ |
| Disallow | /epub/g0101/top/ |
| Disallow | /seiwa/g0101/top/ |
| Disallow | /kawaton/g0101/top/ |
| Disallow | /suzugaku/g0101/top/ |
| Disallow | /test_20181106/ |
| Disallow | /fuguaisyusei1217/ |
| Disallow | /nul4/ |
| Disallow | /honnomori/ |
| Disallow | /trc1/ |
| Disallow | /trc_sc/ |
| Disallow | /try1/ |
| Disallow | /try2/ |
| Disallow | /try3/ |
| Disallow | /dboard/ |
| Disallow | /sensho/ |
| Disallow | /mtsa/ |
| Disallow | /sample/ |
| Disallow | /dnp1/ |
| Disallow | /ishikari_libs/ |
| Disallow | /test001/ |
| Disallow | /demo1/ |
| Disallow | /demo2/ |
| Disallow | /inagilib/ |
| Disallow | /sandafs/ |
| Disallow | /the_picture_bookdom/ |
| Disallow | /cafelab_test/ |
| Disallow | /TRC_DL/ |
| Disallow | /cafelab/ |
| Disallow | /ggg/ |
| Disallow | /dlschool/ |
| Disallow | /kmsi_demo/ |
| Disallow | /nexs_demo/ |
| Disallow | /demo3/ |
| Disallow | /dnptest2018/ |
| Disallow | /nul1/ |
| Disallow | /manual/ |
| Disallow | /nul2/ |
| Disallow | /cnts_chk_lib/ |
| Disallow | /nul5/ |
| Disallow | /zdelete/ |
| Disallow | /zdelete2/ |
| Disallow | /virtuallib/ |
| Disallow | /epub/ |
| Disallow | /seiwa/ |
| Disallow | /kawaton/ |
| Disallow | /suzugaku/ |
| Allow | /hakusan/ |
| Allow | /takahagi/ |
| Allow | /moroyama/ |
| Allow | /kawaguchi/ |
| Allow | /kasumi/ |
| Allow | /koto/ |
| Allow | /*/g0101/top/ |
| Allow | /*/g0108/guide/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 180 |
y!j
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /test_20181106/g0101/top/ |
| Disallow | /fuguaisyusei1217/g0101/top/ |
| Disallow | /nul4/g0101/top/ |
| Disallow | /honnomori/g0101/top/ |
| Disallow | /trc1/g0101/top/ |
| Disallow | /trc_sc/g0101/top/ |
| Disallow | /try1/g0101/top/ |
| Disallow | /try2/g0101/top/ |
| Disallow | /try3/g0101/top/ |
| Disallow | /dboard/g0101/top/ |
| Disallow | /sensho/g0101/top/ |
| Disallow | /mtsa/g0101/top/ |
| Disallow | /sample/g0101/top/ |
| Disallow | /dnp1/g0101/top/ |
| Disallow | /ishikari_libs/g0101/top/ |
| Disallow | /test001/g0101/top/ |
| Disallow | /demo1/g0101/top/ |
| Disallow | /demo2/g0101/top/ |
| Disallow | /inagilib/g0101/top/ |
| Disallow | /sandafs/g0101/top/ |
| Disallow | /the_picture_bookdom/g0101/top/ |
| Disallow | /cafelab_test/g0101/top/ |
| Disallow | /TRC_DL/g0101/top/ |
| Disallow | /cafelab/g0101/top/ |
| Disallow | /ggg/g0101/top/ |
| Disallow | /dlschool/g0101/top/ |
| Disallow | /kmsi_demo/g0101/top/ |
| Disallow | /nexs_demo/g0101/top/ |
| Disallow | /demo3/g0101/top/ |
| Disallow | /dnptest2018/g0101/top/ |
| Disallow | /nul1/g0101/top/ |
| Disallow | /manual/g0101/top/ |
| Disallow | /nul2/g0101/top/ |
| Disallow | /cnts_chk_lib/g0101/top/ |
| Disallow | /nul5/g0101/top/ |
| Disallow | /zdelete/g0101/top/ |
| Disallow | /zdelete2/g0101/top/ |
| Disallow | /virtuallib/g0101/top/ |
| Disallow | /epub/g0101/top/ |
| Disallow | /seiwa/g0101/top/ |
| Disallow | /kawaton/g0101/top/ |
| Disallow | /suzugaku/g0101/top/ |
| Disallow | /test_20181106/ |
| Disallow | /fuguaisyusei1217/ |
| Disallow | /nul4/ |
| Disallow | /honnomori/ |
| Disallow | /trc1/ |
| Disallow | /trc_sc/ |
| Disallow | /try1/ |
| Disallow | /try2/ |
| Disallow | /try3/ |
| Disallow | /dboard/ |
| Disallow | /sensho/ |
| Disallow | /mtsa/ |
| Disallow | /sample/ |
| Disallow | /dnp1/ |
| Disallow | /ishikari_libs/ |
| Disallow | /test001/ |
| Disallow | /demo1/ |
| Disallow | /demo2/ |
| Disallow | /inagilib/ |
| Disallow | /sandafs/ |
| Disallow | /the_picture_bookdom/ |
| Disallow | /cafelab_test/ |
| Disallow | /TRC_DL/ |
| Disallow | /cafelab/ |
| Disallow | /ggg/ |
| Disallow | /dlschool/ |
| Disallow | /kmsi_demo/ |
| Disallow | /nexs_demo/ |
| Disallow | /demo3/ |
| Disallow | /dnptest2018/ |
| Disallow | /nul1/ |
| Disallow | /manual/ |
| Disallow | /nul2/ |
| Disallow | /cnts_chk_lib/ |
| Disallow | /nul5/ |
| Disallow | /zdelete/ |
| Disallow | /zdelete2/ |
| Disallow | /virtuallib/ |
| Disallow | /epub/ |
| Disallow | /seiwa/ |
| Disallow | /kawaton/ |
| Disallow | /suzugaku/ |
| Allow | /hakusan/ |
| Allow | /takahagi/ |
| Allow | /moroyama/ |
| Allow | /kawaguchi/ |
| Allow | /kasumi/ |
| Allow | /koto/ |
| Allow | /*/g0101/top/ |
| Allow | /*/g0108/guide/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 180 |
*
| Rule | Path |
|---|---|
| Disallow | / |