books-by-isbn.com
robots.txt
Robots Exclusion Standard data for books-by-isbn.com
Resource Scan
Scan Details
| Site Domain | books-by-isbn.com |
| Base Domain | books-by-isbn.com |
| Scan Status | Ok |
| Last Scan | 2024-09-08T05:07:23+00:00 |
| Next Scan | 2024-10-08T05:07:23+00:00 |
Last Scan
| Scanned | 2024-09-08T05:07:23+00:00 |
| URL | https://books-by-isbn.com/robots.txt |
| Domain IPs | 2a01:238:42d4:9c00:2112:d167:dd27:3009, 81.169.199.58 |
| Response IP | 81.169.199.58 |
| Found | Yes |
| Hash | 65888b70ae480faeafd5a34414c0cf0d50b7c87fdd1113e13f4ab1865ffa27d7 |
| SimHash | 2117c0a2b490 |
Groups
slurp
| Rule | Path |
|---|---|
| Disallow | /links |
| Disallow | /cgi |
| Disallow | /bestseller/covers |
| Disallow | /lastl |
| Disallow | /rpix |
| Disallow | /auts |
| Disallow | /pubs |
| Disallow | /authors/konstanze/halt |
| Disallow | /3-935255 |
| Disallow | /framed |
| Disallow | /test |
| Disallow | /socialbookmarks |
| Disallow | /jspv |
| Disallow | /jspub/m |
| Disallow | /img/forsy |
| Disallow | /oldvers |
| Disallow | /nodat |
| Disallow | /authorindex |
| Disallow | /fordownload- |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
mj12bot
| Rule | Path |
|---|---|
| Disallow | /links |
| Disallow | /cgi |
| Disallow | /bestseller/covers |
| Disallow | /lastl |
| Disallow | /rpix |
| Disallow | /auts |
| Disallow | /pubs |
| Disallow | /authors/konstanze/halt |
| Disallow | /3-935255 |
| Disallow | /framed |
| Disallow | /test |
| Disallow | /socialbookmarks |
| Disallow | /jspv |
| Disallow | /jspub/m |
| Disallow | /img/forsy |
| Disallow | /oldvers |
| Disallow | /nodat |
| Disallow | /authorindex |
| Disallow | /fordownload- |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /links |
| Disallow | /cgi |
| Allow | /cgi-bin/random.pl |
| Allow | /cgi-bin/isbn-lookup.pl?isbn= |
| Disallow | /bestseller/covers |
| Disallow | /lastl |
| Disallow | /rpix |
| Disallow | /auts |
| Disallow | /pubs |
| Disallow | /authors/konstanze/halt |
| Disallow | /3-935255 |
| Disallow | /framed |
| Disallow | /test |
| Disallow | /socialbookmarks |
| Disallow | /jspv |
| Disallow | /jspub/m |
| Disallow | /img/forsy |
| Disallow | /oldvers |
| Disallow | /nodat |
| Disallow | /authorindex |
| Disallow | /fordownload- |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /links |
| Disallow | /cgi |
| Disallow | /bestseller/covers |
| Disallow | /lastl |
| Disallow | /auts |
| Disallow | /pubs |
| Disallow | /authors |
| Disallow | /rpix |
| Allow | /rpix/ecx-7/ |
| Allow | /rpix/ecx-8/ |
| Allow | /rpix/ecx-9/ |
| Disallow | /framed |
| Disallow | /test |
| Disallow | /socialbookmarks |
| Disallow | /jspv |
| Disallow | /jspub/m |
| Disallow | /authmedia |
| Disallow | /authyear |
| Disallow | /img/forsy |
| Disallow | /oldvers |
| Disallow | /nodat |
| Disallow | /authorindex |
| Disallow | /fordownload- |
googlebot
| Rule | Path |
|---|---|
| Disallow | /links |
| Disallow | /cgi |
| Allow | /cgi-bin/isbn-lookup.pl?isbn=0 |
| Allow | /cgi-bin/isbn-lookup.pl?isbn=0 |
| Allow | /cgi-bin/isbn-lookup.pl?isbn=1 |
| Allow | /cgi-bin/isbn-lookup.pl?isbn=2 |
| Allow | /cgi-bin/isbn-lookup.pl?isbn=3 |
| Allow | /cgi-bin/isbn-lookup.pl?isbn=4 |
| Allow | /cgi-bin/isbn-lookup.pl?isbn=5 |
| Allow | /cgi-bin/isbn-lookup.pl?isbn=6 |
| Allow | /cgi-bin/isbn-lookup.pl?isbn=7 |
| Allow | /cgi-bin/isbn-lookup.pl?isbn=8 |
| Allow | /cgi-bin/isbn-lookup.pl?isbn=9 |
| Allow | /cgi-bin/random.pl |
| Allow | /cgi-bin/randomauthor.pl |
| Disallow | /bestseller/covers |
| Disallow | /lastl |
| Disallow | /auts |
| Disallow | /pubs |
| Disallow | /authors/konstanze/halt |
| Disallow | /authors/konstantin/hermann |
| Disallow | /3-935255 |
| Disallow | /1-904764/1904764940 |
| Disallow | /1-904764/1904764959 |
| Disallow | /framed |
| Disallow | /test |
| Disallow | /socialbookmarks |
| Disallow | /jspv |
| Disallow | /jspub/m |
| Disallow | /img/forsy |
| Disallow | /oldvers |
| Disallow | /nodat |
| Disallow | /authorindex |
| Disallow | /fordownload- |
ccbot
| Rule | Path |
|---|---|
| Disallow | /links |
| Disallow | /cgi |
| Disallow | /bestseller |
| Disallow | /lastl |
| Disallow | /auts |
| Disallow | /pubs |
| Disallow | /authors/konstanze/halt |
| Disallow | /authors/konstantin/hermann |
| Disallow | /3-935255 |
| Disallow | /1-904764/1904764940 |
| Disallow | /1-904764/1904764959 |
| Disallow | /framed |
| Disallow | /test |
| Disallow | /socialbookmarks |
| Disallow | /jspv |
| Disallow | /jspub/m |
| Disallow | /img/forsy |
| Disallow | /oldvers |
| Disallow | /nodat |
| Disallow | /authorindex |
| Disallow | /fordownload- |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /cgi |
| Disallow | /links |
| Allow | /cgi-bin/isbn-lookup.pl?isbn=7 |
| Allow | /cgi-bin/random.pl |
| Disallow | /bestseller/covers |
| Disallow | /lastl |
| Disallow | /auts |
| Disallow | /pubs |
| Disallow | /authors/konstanze/halt |
| Disallow | /authors/konstantin/hermann |
| Disallow | /3-935255 |
| Disallow | /1-904764/1904764940 |
| Disallow | /1-904764/1904764959 |
| Disallow | /framed |
| Disallow | /test |
| Disallow | /socialbookmarks |
| Disallow | /jspv |
| Disallow | /jspub/m |
| Disallow | /authmedia |
| Disallow | /authyear |
| Disallow | /img/forsy |
| Disallow | /oldvers |
| Disallow | /nodat |
| Disallow | /authorindex |
| Disallow | /fordownload- |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /links |
| Disallow | /bestseller/covers |
| Disallow | /lastl |
| Disallow | /rpix |
| Disallow | /auts |
| Disallow | /pubs |
| Disallow | /authors/konstanze/halt |
| Disallow | /authors/konstantin/hermann |
| Disallow | /3-935255 |
| Disallow | /1-904764/1904764940 |
| Disallow | /1-904764/1904764959 |
| Disallow | /framed |
| Disallow | /test |
| Disallow | /socialbookmarks |
| Disallow | /84-15/ |
| Disallow | /jspv |
| Disallow | /jspub/m |
| Disallow | /authmedia |
| Disallow | /img/forsy |
| Disallow | /oldvers |
| Disallow | /nodat |
| Disallow | /authorindex |
| Disallow | /fordownload- |
pompos
| Rule | Path |
|---|---|
| Disallow | /links |
| Disallow | /cgi |
| Disallow | /bestseller/covers |
| Disallow | /lastl |
| Disallow | /rpix |
| Disallow | /autho |
| Disallow | /0- |
| Disallow | /1- |
| Disallow | /3- |
| Disallow | /framed |
| Disallow | /jspv |
| Disallow | /jspub/m |
| Disallow | /authmedia |
| Disallow | /authyear |
| Disallow | /img/forsy |
| Disallow | /oldvers |
| Disallow | /nodat |
| Disallow | /authorindex |
| Disallow | /fordownload- |
gigabot
| Rule | Path |
|---|---|
| Disallow | /links |
| Disallow | /cgi |
| Disallow | /bestseller/covers |
| Disallow | /lastl |
| Disallow | /rpix |
| Disallow | /autho |
| Disallow | /0- |
| Disallow | /1- |
| Disallow | /3- |
| Disallow | /framed |
| Disallow | /test |
| Disallow | /socialbookmarks |
| Disallow | /jspv |
| Disallow | /jspub/m |
| Disallow | /authmedia |
| Disallow | /authyear |
| Disallow | /img/forsy |
| Disallow | /oldvers |
| Disallow | /nodat |
| Disallow | /authorindex |
| Disallow | /fordownload- |
sputnikbot
| Rule | Path |
|---|---|
| Disallow | /links |
| Disallow | /cgi |
| Disallow | /bestseller/covers |
| Disallow | /lastl |
| Disallow | /rpix |
| Disallow | /auts |
| Disallow | /pubs |
| Disallow | /authors/konstanze/halt |
| Disallow | /authors/konstantin/hermann |
| Disallow | /3-935255 |
| Disallow | /1-904764/1904764940 |
| Disallow | /1-904764/1904764959 |
| Disallow | /framed |
| Disallow | /test |
| Disallow | /socialbookmarks |
| Disallow | /84-15/ |
| Disallow | /jspv |
| Disallow | /jspub/m |
| Disallow | /authmedia |
| Disallow | /authyear |
| Disallow | /img/forsy |
| Disallow | /oldvers |
| Disallow | /nodat |
| Disallow | /authorindex |
| Disallow | /fordownload- |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
yandex
| Rule | Path |
|---|---|
| Disallow | /links |
| Disallow | /cgi |
| Disallow | /bestseller/covers |
| Disallow | /lastl |
| Disallow | /rpix |
| Disallow | /auts |
| Disallow | /pubs |
| Disallow | /authors/konstanze/halt |
| Disallow | /authors/konstantin/hermann |
| Disallow | /3-935255 |
| Disallow | /1-904764/1904764940 |
| Disallow | /1-904764/1904764959 |
| Disallow | /framed |
| Disallow | /test |
| Disallow | /socialbookmarks |
| Disallow | /84-15/ |
| Disallow | /jspv |
| Disallow | /jspub/m |
| Disallow | /authmedia |
| Disallow | /authyear |
| Disallow | /img/forsy |
| Disallow | /oldvers |
| Disallow | /nodat |
| Disallow | /authorindex |
| Disallow | /fordownload- |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
*
| Rule | Path |
|---|---|
| Disallow | /links |
| Disallow | /cgi |
| Disallow | /bestseller/covers |
| Disallow | /lastl |
| Disallow | /rpix |
| Disallow | /auts |
| Disallow | /pubs |
| Disallow | /authors/konstanze/halt |
| Disallow | /authors/konstantin/hermann |
| Disallow | /3-935255 |
| Disallow | /1-904764/1904764940 |
| Disallow | /1-904764/1904764959 |
| Disallow | /framed |
| Disallow | /test |
| Disallow | /socialbookmarks |
| Disallow | /84-15/ |
| Disallow | /jspv |
| Disallow | /jspub/m |
| Disallow | /img/forsy |
| Disallow | /oldvers |
| Disallow | /nodat |
| Disallow | /authorindex |
| Disallow | /fordownload- |
Comments