ruslit.net
robots.txt

Robots Exclusion Standard data for ruslit.net

Resource Scan

Scan Details

Site Domain ruslit.net
Base Domain ruslit.net
Scan Status Ok
Last Scan2025-05-06T16:35:27+00:00
Next Scan 2025-06-05T16:35:27+00:00

Last Scan

Scanned2025-05-06T16:35:27+00:00
URL https://ruslit.net/robots.txt
Domain IPs 104.21.69.42, 172.67.204.82, 2606:4700:3032::6815:452a, 2606:4700:3033::ac43:cc52
Response IP 172.67.204.82
Found Yes
Hash f9a1426c961376e36d89982a766e880a65a8f0013dba2e513e835c7ad2e6de33
SimHash c81cc562deb3

Groups

*

Rule Path
Disallow /download.php
Disallow /previewM.php
Disallow /index.php?path=%u
Allow /

megaindex.ru
ahrefsbot
obot
semrushbot
the knowledge ai
go-http-client
blexbot
feed
dotbot
barkrowler

Rule Path
Disallow /