e-news.su
robots.txt

Robots Exclusion Standard data for e-news.su

Resource Scan

Scan Details

Site Domain e-news.su
Base Domain e-news.su
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-29T19:44:38+00:00
Next Scan 2024-08-27T19:44:38+00:00

Last Successful Scan

Scanned2023-05-06T19:41:33+00:00
URL https://e-news.su/robots.txt
Domain IPs 104.21.88.86, 172.67.174.83, 2606:4700:3035::6815:5856, 2606:4700:3035::ac43:ae53
Response IP 172.67.174.83
Found Yes
Hash c7ac5ba5a44fcf2d432a56b3249bea5a5ce7e5afe55a93f52aaa917b3b961122
SimHash 0e08f462f131

Groups

amazonbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

buck

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

riddler

Rule Path
Disallow /

yandex

Rule Path
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /tik.php
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /*print%3Apage
Disallow /*page/

*

Rule Path
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /tik.php
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /*print%3Apage
Disallow /*page/

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.