74novosti.ru
robots.txt

Robots Exclusion Standard data for 74novosti.ru

Resource Scan

Scan Details

Site Domain 74novosti.ru
Base Domain 74novosti.ru
Scan Status Ok
Last Scan2025-02-25T09:34:55+00:00
Next Scan 2025-03-27T09:34:55+00:00

Last Scan

Scanned2025-02-25T09:34:55+00:00
URL https://74novosti.ru/robots.txt
Domain IPs 45.130.41.24
Response IP 45.130.41.24
Found Yes
Hash 4c213536a89c72bb5357bebfcca1109bb8a87455ff79688a6a3c880ce72e34d9
SimHash fd0db5784133

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch