Log In Sign Up

web-ru.net
robots.txt

Robots Exclusion Standard data for web-ru.net

Resource Scan

Scan Details

Site Domain web-ru.net
Base Domain web-ru.net
Scan Status Ok
Last Scan2025-09-29T14:17:27+00:00
Next Scan 2025-10-06T14:17:27+00:00

Last Scan

Scanned2025-09-29T14:17:27+00:00
URL https://web-ru.net/robots.txt
Domain IPs 104.21.42.102, 172.67.204.247, 2606:4700:3035::ac43:ccf7, 2606:4700:3036::6815:2a66
Response IP 104.21.42.102
Found Yes
Hash c4871579588d7b9fb9d1ec02154ef62b50b3ab3fd5691e964dc85339dd1fc1e0
SimHash e948a843cdb2

Groups

*

Rule Path
Disallow

yandex

Rule Path
Disallow /feed/
Disallow /*/amp
Disallow /amp/
Back to top

Other Records

Field Value
sitemap https://web-ru.net/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top