e-reading-lib.org
robots.txt

Robots Exclusion Standard data for e-reading-lib.org

Resource Scan

Scan Details

Site Domain e-reading-lib.org
Base Domain e-reading-lib.org
Scan Status Ok
Last Scan2025-05-12T03:56:42+00:00
Next Scan 2025-05-19T03:56:42+00:00

Last Scan

Scanned2025-05-12T03:56:42+00:00
URL https://e-reading-lib.org/robots.txt
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.80.1
Found Yes
Hash 82513f39a454dd4cf58a6683ffbf0c9c9c6d4b01c37c424702f50e2563a7ad52
SimHash 0174dce3fb80

Groups

ahrefsbot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

bizinformatsiya

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /saveBookPos.php
Disallow /saveReaderSettings.php
Disallow /saveUserSettings.php
Disallow /backlinks.php
Disallow /complaint*
Disallow /subscribenewbook.php
Disallow /forumpost.php
Disallow /outside.php
Disallow /readerfilter.php
Disallow /bookimage.php
Disallow /login.php
Disallow /donate.php
Disallow /compare.php
Allow /

Other Records

Field Value
crawl-delay 40

Warnings

  • `clean-param` is not a known field.