Log In Sign Up

gzt-sv.ru
robots.txt

Robots Exclusion Standard data for gzt-sv.ru

Resource Scan

Scan Details

Site Domain gzt-sv.ru
Base Domain gzt-sv.ru
Scan Status Ok
Last Scan2024-06-05T15:22:52+00:00
Next Scan 2024-06-12T15:22:52+00:00

Last Scan

Scanned2024-06-05T15:22:52+00:00
URL https://gzt-sv.ru/robots.txt
Redirect https://www.gzt-sv.ru/robots.txt
Redirect Domain www.gzt-sv.ru
Redirect Base gzt-sv.ru
Domain IPs 104.21.8.243, 172.67.130.197, 2606:4700:3030::ac43:82c5, 2606:4700:3035::6815:8f3
Redirect IPs 104.21.8.243, 172.67.130.197, 2606:4700:3030::ac43:82c5, 2606:4700:3035::6815:8f3
Response IP 104.21.8.243
Found Yes
Hash 8f79c09a1e64a409b26929666a2923e3dc9ca20c671d60a3eb5660f140e5ca8b
SimHash e4159b60a7b3

Groups

*

Rule Path
Disallow /search/
Disallow /author/
Disallow /?s=*
Disallow /*?s=*
Disallow /page/*?s=*

yandex

Rule Path
Allow /feed
Disallow /search/
Disallow /author/
Disallow /?s=*
Disallow /*?s=*
Disallow /page/*?s=*

msiecrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

xenu

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /
Back to top

Warnings

  • `host` is not a known field.
Back to top