hotnews.plus
robots.txt

Robots Exclusion Standard data for hotnews.plus

Resource Scan

Scan Details

Site Domain hotnews.plus
Base Domain hotnews.plus
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-03-05T10:19:27+00:00
Next Scan 2025-06-03T10:19:27+00:00

Last Successful Scan

Scanned2023-11-12T05:09:04+00:00
URL https://hotnews.plus/robots.txt
Domain IPs 104.21.38.216, 172.67.139.81, 2606:4700:3031::6815:26d8, 2606:4700:3037::ac43:8b51
Response IP 104.21.38.216
Found Yes
Hash 1cec68a9e89aa9081244e00d9d41aa995d1fea3f989ec6cfaa254abe34955c67
SimHash 6afedbc69391

Groups

yandexnews

Rule Path
Allow /

yandex

Rule Path
Disallow /index.php
Disallow /user
Disallow /devel
Disallow /search
Disallow /node

googlebot

Rule Path
Disallow /index.php
Disallow /user
Disallow /devel
Disallow /search
Disallow /node

*

Rule Path
Disallow /index.php
Disallow /user
Disallow /devel
Disallow /search
Disallow /node
Disallow *_gl%3D
Disallow *_ga%3D
Disallow *_wrapper_format%3D
Disallow /?amp$
Disallow *search_api_fulltext%3D
Disallow /*amp_lite%3D
Disallow /*route%3D
Disallow /*email%3D
Disallow /*from%3D
Disallow /*fullscreen%3D
Disallow /*next%3D
Disallow /*page%3D
Disallow /*vid%3D
Disallow /*cid%3D
Disallow /*id%3D
Disallow /*uid%3D
Disallow *from%3D
Disallow *openstat%3D
Disallow *utm*%3D
Disallow *matchtype%3D
Disallow *network%3D
Disallow *device%3D
Disallow *creative%3D
Disallow *keyword%3D
Disallow *placement%3D
Disallow *adposition%3D

Other Records

Field Value
sitemap https://hotnews.plus/sitemap.xml
sitemap https://hotnews.plus/sitemap-fast.xml

Warnings

  • `clean-param` is not a known field.