instavisor.ru
robots.txt

Robots Exclusion Standard data for instavisor.ru

Resource Scan

Scan Details

Site Domain instavisor.ru
Base Domain instavisor.ru
Scan Status Ok
Last Scan2024-09-25T07:06:25+00:00
Next Scan 2024-10-02T07:06:25+00:00

Last Scan

Scanned2024-09-25T07:06:25+00:00
URL https://instavisor.ru/robots.txt
Domain IPs 104.21.45.185, 172.67.218.65, 2606:4700:3032::6815:2db9, 2606:4700:3037::ac43:da41
Response IP 172.67.218.65
Found Yes
Hash c5892649b0495c3997c854f2693ba47e1d5f4049b5a8bebed0b70b20d1a0257c
SimHash 3a4da6922332

Groups

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /stories/*/
Disallow /highlights/*/
Disallow /posts/*/
Disallow /admin/
Disallow */feed/
Disallow */feed

yandex

Rule Path
Disallow /stories/*/
Disallow /highlights/*/
Disallow /posts/*/

Warnings

  • `clean-param` is not a known field.