e-reading.org.ua
robots.txt

Robots Exclusion Standard data for e-reading.org.ua

Resource Scan

Scan Details

Site Domain e-reading.org.ua
Base Domain e-reading.org.ua
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-05-07T08:23:12+00:00
Next Scan 2025-08-05T08:23:12+00:00

Last Successful Scan

Scanned2024-10-10T08:05:17+00:00
URL https://e-reading.org.ua/robots.txt
Domain IPs 104.21.49.221, 172.67.152.251, 2606:4700:3033::ac43:98fb, 2606:4700:3035::6815:31dd
Response IP 172.67.152.251
Found Yes
Hash 82513f39a454dd4cf58a6683ffbf0c9c9c6d4b01c37c424702f50e2563a7ad52
SimHash 0174dce3fb80

Groups

ahrefsbot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

bizinformatsiya

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /saveBookPos.php
Disallow /saveReaderSettings.php
Disallow /saveUserSettings.php
Disallow /backlinks.php
Disallow /complaint*
Disallow /subscribenewbook.php
Disallow /forumpost.php
Disallow /outside.php
Disallow /readerfilter.php
Disallow /bookimage.php
Disallow /login.php
Disallow /donate.php
Disallow /compare.php
Allow /

Other Records

Field Value
crawl-delay 40

Warnings

  • `clean-param` is not a known field.