Log In Sign Up

jv.ru
robots.txt

Robots Exclusion Standard data for jv.ru

Resource Scan

Scan Details

Site Domain jv.ru
Base Domain jv.ru
Scan Status Ok
Last Scan2024-11-15T08:31:49+00:00
Next Scan 2024-11-22T08:31:49+00:00

Last Scan

Scanned2024-11-15T08:31:49+00:00
URL https://jv.ru/robots.txt
Redirect https://www.jv.ru/robots.txt
Redirect Domain www.jv.ru
Redirect Base jv.ru
Domain IPs 104.21.95.96, 172.67.144.23, 2606:4700:3032::ac43:9017, 2606:4700:3035::6815:5f60
Redirect IPs 104.21.95.96, 172.67.144.23, 2606:4700:3032::ac43:9017, 2606:4700:3035::6815:5f60
Response IP 104.21.95.96
Found Yes
Hash 189ad57117a8286abaaf50d6de6f6db0ed25c8818e1759c4b1571a334e6098c5
SimHash 5c49de46d537

Groups

*

Rule Path
Disallow /?
Disallow /*?
Disallow /news/*/
Disallow /food/*/
Disallow /articles/
Disallow /eda/find/all/
Disallow /eda/group/
Disallow */site/search
Disallow */video/search
Disallow */support
Allow /category?page=
Allow /category?slug=*&page=
Allow /tag/*?page=
Allow /tests?page=

yandex

Rule Path
Disallow /?
Disallow /*?
Disallow /news/*/
Disallow /food/*/
Disallow /articles/
Disallow /eda/find/all/
Disallow /eda/group/
Disallow */site/search
Disallow */video/search
Disallow */support
Allow /category?page=
Allow /category?slug=*&page=
Allow /tag/*?page=
Allow /tests?page=

googlebot

Rule Path
Disallow */site/search
Disallow */video/search
Disallow */support
Allow /category?page=
Allow /category?slug=*&page=
Allow /tag/*?page=
Allow /tests?page=
Back to top

Other Records

Field Value
sitemap https://www.jv.ru/rss/sitemap.xml
Back to top

Comments

  • 17.04.23 Disallow: /?
  • 17.04.23 Disallow: /*?
  • 11.04.23 Disallow: /news/*/
  • 11.04.23 Disallow: /food/*/
  • 11.04.23 Disallow: /eda/find/all/
  • 11.04.23 Disallow: /eda/group/
  • 17.04.23 Disallow: /articles/
Back to top

Warnings

  • `clean-param` is not a known field.
Back to top