e-news.pro
robots.txt

Robots Exclusion Standard data for e-news.pro

Resource Scan

Scan Details

Site Domain e-news.pro
Base Domain e-news.pro
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-25T06:34:37+00:00
Next Scan 2024-11-23T06:34:37+00:00

Last Successful Scan

Scanned2023-05-04T05:02:21+00:00
URL https://e-news.pro/robots.txt
Domain IPs 104.21.12.214, 172.67.167.184, 2606:4700:3034::6815:cd6, 2606:4700:3035::ac43:a7b8
Response IP 104.21.12.214
Found Yes
Hash c7ac5ba5a44fcf2d432a56b3249bea5a5ce7e5afe55a93f52aaa917b3b961122
SimHash 0e08f462f131

Groups

amazonbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

buck

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

riddler

Rule Path
Disallow /

yandex

Rule Path
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /tik.php
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /*print%3Apage
Disallow /*page/

*

Rule Path
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /tik.php
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /*print%3Apage
Disallow /*page/

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.