d-library.jp
robots.txt
Robots Exclusion Standard data for d-library.jp
Resource Scan
Scan Details
Site Domain | d-library.jp |
Base Domain | d-library.jp |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-11-13T23:15:15+00:00 |
Next Scan | 2024-12-13T23:15:15+00:00 |
Last Successful Scan
Scanned | 2024-09-22T22:57:45+00:00 |
URL | https://www.d-library.jp/robots.txt |
Redirect | https://web.d-library.jp/robots.txt |
Redirect Domain | web.d-library.jp |
Redirect Base | d-library.jp |
Domain IPs | 13.78.59.106 |
Redirect IPs | 13.107.246.58 |
Response IP | 13.107.246.73 |
Found | Yes |
Hash | 030d73cbed86459be01ca01cbb7aada520672a7c23e52fb15f3e2bbb0b4a47b8 |
SimHash | 5c6eb0d275c6 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | / |
Disallow | /test_20181106/g0101/top/ |
Disallow | /fuguaisyusei1217/g0101/top/ |
Disallow | /nul4/g0101/top/ |
Disallow | /honnomori/g0101/top/ |
Disallow | /trc1/g0101/top/ |
Disallow | /trc_sc/g0101/top/ |
Disallow | /try1/g0101/top/ |
Disallow | /try2/g0101/top/ |
Disallow | /try3/g0101/top/ |
Disallow | /dboard/g0101/top/ |
Disallow | /sensho/g0101/top/ |
Disallow | /mtsa/g0101/top/ |
Disallow | /sample/g0101/top/ |
Disallow | /dnp1/g0101/top/ |
Disallow | /ishikari_libs/g0101/top/ |
Disallow | /test001/g0101/top/ |
Disallow | /demo1/g0101/top/ |
Disallow | /demo2/g0101/top/ |
Disallow | /inagilib/g0101/top/ |
Disallow | /sandafs/g0101/top/ |
Disallow | /the_picture_bookdom/g0101/top/ |
Disallow | /cafelab_test/g0101/top/ |
Disallow | /TRC_DL/g0101/top/ |
Disallow | /cafelab/g0101/top/ |
Disallow | /ggg/g0101/top/ |
Disallow | /dlschool/g0101/top/ |
Disallow | /kmsi_demo/g0101/top/ |
Disallow | /nexs_demo/g0101/top/ |
Disallow | /demo3/g0101/top/ |
Disallow | /dnptest2018/g0101/top/ |
Disallow | /nul1/g0101/top/ |
Disallow | /manual/g0101/top/ |
Disallow | /nul2/g0101/top/ |
Disallow | /cnts_chk_lib/g0101/top/ |
Disallow | /nul5/g0101/top/ |
Disallow | /zdelete/g0101/top/ |
Disallow | /zdelete2/g0101/top/ |
Disallow | /virtuallib/g0101/top/ |
Disallow | /epub/g0101/top/ |
Disallow | /seiwa/g0101/top/ |
Disallow | /kawaton/g0101/top/ |
Disallow | /suzugaku/g0101/top/ |
Disallow | /test_20181106/ |
Disallow | /fuguaisyusei1217/ |
Disallow | /nul4/ |
Disallow | /honnomori/ |
Disallow | /trc1/ |
Disallow | /trc_sc/ |
Disallow | /try1/ |
Disallow | /try2/ |
Disallow | /try3/ |
Disallow | /dboard/ |
Disallow | /sensho/ |
Disallow | /mtsa/ |
Disallow | /sample/ |
Disallow | /dnp1/ |
Disallow | /ishikari_libs/ |
Disallow | /test001/ |
Disallow | /demo1/ |
Disallow | /demo2/ |
Disallow | /inagilib/ |
Disallow | /sandafs/ |
Disallow | /the_picture_bookdom/ |
Disallow | /cafelab_test/ |
Disallow | /TRC_DL/ |
Disallow | /cafelab/ |
Disallow | /ggg/ |
Disallow | /dlschool/ |
Disallow | /kmsi_demo/ |
Disallow | /nexs_demo/ |
Disallow | /demo3/ |
Disallow | /dnptest2018/ |
Disallow | /nul1/ |
Disallow | /manual/ |
Disallow | /nul2/ |
Disallow | /cnts_chk_lib/ |
Disallow | /nul5/ |
Disallow | /zdelete/ |
Disallow | /zdelete2/ |
Disallow | /virtuallib/ |
Disallow | /epub/ |
Disallow | /seiwa/ |
Disallow | /kawaton/ |
Disallow | /suzugaku/ |
Allow | /hakusan/ |
Allow | /takahagi/ |
Allow | /moroyama/ |
Allow | /kawaguchi/ |
Allow | /kasumi/ |
Allow | /koto/ |
Allow | /*/g0101/top/ |
Allow | /*/g0108/guide/ |
Other Records
Field | Value |
---|---|
crawl-delay | 180 |
msnbot
Rule | Path |
---|---|
Disallow | / |
Disallow | /test_20181106/g0101/top/ |
Disallow | /fuguaisyusei1217/g0101/top/ |
Disallow | /nul4/g0101/top/ |
Disallow | /honnomori/g0101/top/ |
Disallow | /trc1/g0101/top/ |
Disallow | /trc_sc/g0101/top/ |
Disallow | /try1/g0101/top/ |
Disallow | /try2/g0101/top/ |
Disallow | /try3/g0101/top/ |
Disallow | /dboard/g0101/top/ |
Disallow | /sensho/g0101/top/ |
Disallow | /mtsa/g0101/top/ |
Disallow | /sample/g0101/top/ |
Disallow | /dnp1/g0101/top/ |
Disallow | /ishikari_libs/g0101/top/ |
Disallow | /test001/g0101/top/ |
Disallow | /demo1/g0101/top/ |
Disallow | /demo2/g0101/top/ |
Disallow | /inagilib/g0101/top/ |
Disallow | /sandafs/g0101/top/ |
Disallow | /the_picture_bookdom/g0101/top/ |
Disallow | /cafelab_test/g0101/top/ |
Disallow | /TRC_DL/g0101/top/ |
Disallow | /cafelab/g0101/top/ |
Disallow | /ggg/g0101/top/ |
Disallow | /dlschool/g0101/top/ |
Disallow | /kmsi_demo/g0101/top/ |
Disallow | /nexs_demo/g0101/top/ |
Disallow | /demo3/g0101/top/ |
Disallow | /dnptest2018/g0101/top/ |
Disallow | /nul1/g0101/top/ |
Disallow | /manual/g0101/top/ |
Disallow | /nul2/g0101/top/ |
Disallow | /cnts_chk_lib/g0101/top/ |
Disallow | /nul5/g0101/top/ |
Disallow | /zdelete/g0101/top/ |
Disallow | /zdelete2/g0101/top/ |
Disallow | /virtuallib/g0101/top/ |
Disallow | /epub/g0101/top/ |
Disallow | /seiwa/g0101/top/ |
Disallow | /kawaton/g0101/top/ |
Disallow | /suzugaku/g0101/top/ |
Disallow | /test_20181106/ |
Disallow | /fuguaisyusei1217/ |
Disallow | /nul4/ |
Disallow | /honnomori/ |
Disallow | /trc1/ |
Disallow | /trc_sc/ |
Disallow | /try1/ |
Disallow | /try2/ |
Disallow | /try3/ |
Disallow | /dboard/ |
Disallow | /sensho/ |
Disallow | /mtsa/ |
Disallow | /sample/ |
Disallow | /dnp1/ |
Disallow | /ishikari_libs/ |
Disallow | /test001/ |
Disallow | /demo1/ |
Disallow | /demo2/ |
Disallow | /inagilib/ |
Disallow | /sandafs/ |
Disallow | /the_picture_bookdom/ |
Disallow | /cafelab_test/ |
Disallow | /TRC_DL/ |
Disallow | /cafelab/ |
Disallow | /ggg/ |
Disallow | /dlschool/ |
Disallow | /kmsi_demo/ |
Disallow | /nexs_demo/ |
Disallow | /demo3/ |
Disallow | /dnptest2018/ |
Disallow | /nul1/ |
Disallow | /manual/ |
Disallow | /nul2/ |
Disallow | /cnts_chk_lib/ |
Disallow | /nul5/ |
Disallow | /zdelete/ |
Disallow | /zdelete2/ |
Disallow | /virtuallib/ |
Disallow | /epub/ |
Disallow | /seiwa/ |
Disallow | /kawaton/ |
Disallow | /suzugaku/ |
Allow | /hakusan/ |
Allow | /takahagi/ |
Allow | /moroyama/ |
Allow | /kawaguchi/ |
Allow | /kasumi/ |
Allow | /koto/ |
Allow | /*/g0101/top/ |
Allow | /*/g0108/guide/ |
Other Records
Field | Value |
---|---|
crawl-delay | 180 |
bingbot
Rule | Path |
---|---|
Disallow | / |
Disallow | /test_20181106/g0101/top/ |
Disallow | /fuguaisyusei1217/g0101/top/ |
Disallow | /nul4/g0101/top/ |
Disallow | /honnomori/g0101/top/ |
Disallow | /trc1/g0101/top/ |
Disallow | /trc_sc/g0101/top/ |
Disallow | /try1/g0101/top/ |
Disallow | /try2/g0101/top/ |
Disallow | /try3/g0101/top/ |
Disallow | /dboard/g0101/top/ |
Disallow | /sensho/g0101/top/ |
Disallow | /mtsa/g0101/top/ |
Disallow | /sample/g0101/top/ |
Disallow | /dnp1/g0101/top/ |
Disallow | /ishikari_libs/g0101/top/ |
Disallow | /test001/g0101/top/ |
Disallow | /demo1/g0101/top/ |
Disallow | /demo2/g0101/top/ |
Disallow | /inagilib/g0101/top/ |
Disallow | /sandafs/g0101/top/ |
Disallow | /the_picture_bookdom/g0101/top/ |
Disallow | /cafelab_test/g0101/top/ |
Disallow | /TRC_DL/g0101/top/ |
Disallow | /cafelab/g0101/top/ |
Disallow | /ggg/g0101/top/ |
Disallow | /dlschool/g0101/top/ |
Disallow | /kmsi_demo/g0101/top/ |
Disallow | /nexs_demo/g0101/top/ |
Disallow | /demo3/g0101/top/ |
Disallow | /dnptest2018/g0101/top/ |
Disallow | /nul1/g0101/top/ |
Disallow | /manual/g0101/top/ |
Disallow | /nul2/g0101/top/ |
Disallow | /cnts_chk_lib/g0101/top/ |
Disallow | /nul5/g0101/top/ |
Disallow | /zdelete/g0101/top/ |
Disallow | /zdelete2/g0101/top/ |
Disallow | /virtuallib/g0101/top/ |
Disallow | /epub/g0101/top/ |
Disallow | /seiwa/g0101/top/ |
Disallow | /kawaton/g0101/top/ |
Disallow | /suzugaku/g0101/top/ |
Disallow | /test_20181106/ |
Disallow | /fuguaisyusei1217/ |
Disallow | /nul4/ |
Disallow | /honnomori/ |
Disallow | /trc1/ |
Disallow | /trc_sc/ |
Disallow | /try1/ |
Disallow | /try2/ |
Disallow | /try3/ |
Disallow | /dboard/ |
Disallow | /sensho/ |
Disallow | /mtsa/ |
Disallow | /sample/ |
Disallow | /dnp1/ |
Disallow | /ishikari_libs/ |
Disallow | /test001/ |
Disallow | /demo1/ |
Disallow | /demo2/ |
Disallow | /inagilib/ |
Disallow | /sandafs/ |
Disallow | /the_picture_bookdom/ |
Disallow | /cafelab_test/ |
Disallow | /TRC_DL/ |
Disallow | /cafelab/ |
Disallow | /ggg/ |
Disallow | /dlschool/ |
Disallow | /kmsi_demo/ |
Disallow | /nexs_demo/ |
Disallow | /demo3/ |
Disallow | /dnptest2018/ |
Disallow | /nul1/ |
Disallow | /manual/ |
Disallow | /nul2/ |
Disallow | /cnts_chk_lib/ |
Disallow | /nul5/ |
Disallow | /zdelete/ |
Disallow | /zdelete2/ |
Disallow | /virtuallib/ |
Disallow | /epub/ |
Disallow | /seiwa/ |
Disallow | /kawaton/ |
Disallow | /suzugaku/ |
Allow | /hakusan/ |
Allow | /takahagi/ |
Allow | /moroyama/ |
Allow | /kawaguchi/ |
Allow | /kasumi/ |
Allow | /koto/ |
Allow | /*/g0101/top/ |
Allow | /*/g0108/guide/ |
Other Records
Field | Value |
---|---|
crawl-delay | 180 |
y!j
Rule | Path |
---|---|
Disallow | / |
Disallow | /test_20181106/g0101/top/ |
Disallow | /fuguaisyusei1217/g0101/top/ |
Disallow | /nul4/g0101/top/ |
Disallow | /honnomori/g0101/top/ |
Disallow | /trc1/g0101/top/ |
Disallow | /trc_sc/g0101/top/ |
Disallow | /try1/g0101/top/ |
Disallow | /try2/g0101/top/ |
Disallow | /try3/g0101/top/ |
Disallow | /dboard/g0101/top/ |
Disallow | /sensho/g0101/top/ |
Disallow | /mtsa/g0101/top/ |
Disallow | /sample/g0101/top/ |
Disallow | /dnp1/g0101/top/ |
Disallow | /ishikari_libs/g0101/top/ |
Disallow | /test001/g0101/top/ |
Disallow | /demo1/g0101/top/ |
Disallow | /demo2/g0101/top/ |
Disallow | /inagilib/g0101/top/ |
Disallow | /sandafs/g0101/top/ |
Disallow | /the_picture_bookdom/g0101/top/ |
Disallow | /cafelab_test/g0101/top/ |
Disallow | /TRC_DL/g0101/top/ |
Disallow | /cafelab/g0101/top/ |
Disallow | /ggg/g0101/top/ |
Disallow | /dlschool/g0101/top/ |
Disallow | /kmsi_demo/g0101/top/ |
Disallow | /nexs_demo/g0101/top/ |
Disallow | /demo3/g0101/top/ |
Disallow | /dnptest2018/g0101/top/ |
Disallow | /nul1/g0101/top/ |
Disallow | /manual/g0101/top/ |
Disallow | /nul2/g0101/top/ |
Disallow | /cnts_chk_lib/g0101/top/ |
Disallow | /nul5/g0101/top/ |
Disallow | /zdelete/g0101/top/ |
Disallow | /zdelete2/g0101/top/ |
Disallow | /virtuallib/g0101/top/ |
Disallow | /epub/g0101/top/ |
Disallow | /seiwa/g0101/top/ |
Disallow | /kawaton/g0101/top/ |
Disallow | /suzugaku/g0101/top/ |
Disallow | /test_20181106/ |
Disallow | /fuguaisyusei1217/ |
Disallow | /nul4/ |
Disallow | /honnomori/ |
Disallow | /trc1/ |
Disallow | /trc_sc/ |
Disallow | /try1/ |
Disallow | /try2/ |
Disallow | /try3/ |
Disallow | /dboard/ |
Disallow | /sensho/ |
Disallow | /mtsa/ |
Disallow | /sample/ |
Disallow | /dnp1/ |
Disallow | /ishikari_libs/ |
Disallow | /test001/ |
Disallow | /demo1/ |
Disallow | /demo2/ |
Disallow | /inagilib/ |
Disallow | /sandafs/ |
Disallow | /the_picture_bookdom/ |
Disallow | /cafelab_test/ |
Disallow | /TRC_DL/ |
Disallow | /cafelab/ |
Disallow | /ggg/ |
Disallow | /dlschool/ |
Disallow | /kmsi_demo/ |
Disallow | /nexs_demo/ |
Disallow | /demo3/ |
Disallow | /dnptest2018/ |
Disallow | /nul1/ |
Disallow | /manual/ |
Disallow | /nul2/ |
Disallow | /cnts_chk_lib/ |
Disallow | /nul5/ |
Disallow | /zdelete/ |
Disallow | /zdelete2/ |
Disallow | /virtuallib/ |
Disallow | /epub/ |
Disallow | /seiwa/ |
Disallow | /kawaton/ |
Disallow | /suzugaku/ |
Allow | /hakusan/ |
Allow | /takahagi/ |
Allow | /moroyama/ |
Allow | /kawaguchi/ |
Allow | /kasumi/ |
Allow | /koto/ |
Allow | /*/g0101/top/ |
Allow | /*/g0108/guide/ |
Other Records
Field | Value |
---|---|
crawl-delay | 180 |
*
Rule | Path |
---|---|
Disallow | / |