e-reading.by
robots.txt

Robots Exclusion Standard data for e-reading.by

Resource Scan

Scan Details

Site Domain e-reading.by
Base Domain e-reading.by
Scan Status Ok
Last Scan2026-01-04T10:44:26+00:00
Next Scan 2026-01-11T10:44:26+00:00

Last Scan

Scanned2026-01-04T10:44:26+00:00
URL https://e-reading.by/robots.txt
Domain IPs 104.21.73.100, 172.67.160.239, 2606:4700:3030::ac43:a0ef, 2606:4700:3034::6815:4964
Response IP 172.67.160.239
Found Yes
Hash 82513f39a454dd4cf58a6683ffbf0c9c9c6d4b01c37c424702f50e2563a7ad52
SimHash 0174dce3fb80

Groups

ahrefsbot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

bizinformatsiya

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /saveBookPos.php
Disallow /saveReaderSettings.php
Disallow /saveUserSettings.php
Disallow /backlinks.php
Disallow /complaint*
Disallow /subscribenewbook.php
Disallow /forumpost.php
Disallow /outside.php
Disallow /readerfilter.php
Disallow /bookimage.php
Disallow /login.php
Disallow /donate.php
Disallow /compare.php
Allow /

Other Records

Field Value
crawl-delay 40

Warnings

  • `clean-param` is not a known field.