e-reading.biz
robots.txt

Robots Exclusion Standard data for e-reading.biz

Resource Scan

Scan Details

Site Domain e-reading.biz
Base Domain e-reading.biz
Scan Status Ok
Last Scan2025-05-26T22:55:35+00:00
Next Scan 2025-06-02T22:55:35+00:00

Last Scan

Scanned2025-05-26T22:55:35+00:00
URL https://e-reading.biz/robots.txt
Domain IPs 104.21.5.55, 172.67.133.2, 2606:4700:3031::6815:537, 2606:4700:3035::ac43:8502
Response IP 172.67.133.2
Found Yes
Hash 82513f39a454dd4cf58a6683ffbf0c9c9c6d4b01c37c424702f50e2563a7ad52
SimHash 0174dce3fb80

Groups

ahrefsbot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

bizinformatsiya

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /saveBookPos.php
Disallow /saveReaderSettings.php
Disallow /saveUserSettings.php
Disallow /backlinks.php
Disallow /complaint*
Disallow /subscribenewbook.php
Disallow /forumpost.php
Disallow /outside.php
Disallow /readerfilter.php
Disallow /bookimage.php
Disallow /login.php
Disallow /donate.php
Disallow /compare.php
Allow /

Other Records

Field Value
crawl-delay 40

Warnings

  • `clean-param` is not a known field.