vashgorod.ru
robots.txt

Robots Exclusion Standard data for vashgorod.ru

Resource Scan

Scan Details

Site Domain vashgorod.ru
Base Domain vashgorod.ru
Scan Status Ok
Last Scan2024-09-27T11:44:24+00:00
Next Scan 2024-10-04T11:44:24+00:00

Last Scan

Scanned2024-09-27T11:44:24+00:00
URL https://vashgorod.ru/robots.txt
Domain IPs 80.249.131.208
Response IP 80.249.131.208
Found Yes
Hash c715dddccecb74b36e4855d6b53a20bc5e53070d6b620c519a2f9664375526f8
SimHash 75d490a22e23

Groups

*

Rule Path
Allow */profile$
Disallow /search
Disallow /registration
Disallow /remember
Disallow /login
Disallow /rkn
Disallow */add
Disallow */recommend
Disallow */poll
Disallow *view
Disallow *?date
Disallow *year
Disallow *index.php
Disallow *response
Disallow *?table
Disallow *setCity
Disallow /auto
Disallow /*?w=
Disallow /*?key=
Disallow /*?page=
Disallow /*?query=
Disallow /*?video=
Disallow /*?beta=
Disallow /*?webapp=
Disallow /*?_r=
Disallow /*?change_city
Disallow /*?city_alias
Disallow /*?q=
Disallow */directory
Disallow */cat/*
Disallow /*?_nc=
Disallow /*?_wa=
Disallow *?from*
Disallow /news/captcha/*
Disallow /complaint/*
Disallow /user/*
Disallow /legal*
Disallow /*/news/*
Disallow /*/tag/*
Disallow */profile
Disallow *per-page%3D
Disallow *ref%3D
Disallow */members
Disallow */comments
Disallow */publications
Disallow */date
Disallow */?type=company&tag=
Disallow */?type=person&tag=
Disallow */?type=tag&tag=
Disallow */?baobab_event_id*
Disallow /person
Disallow /company
Disallow /community
Disallow /topic
Disallow /tag

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://vashgorod.ru/sitemap.xml

Warnings

  • `host` is not a known field.