kovrov.city
robots.txt

Robots Exclusion Standard data for kovrov.city

Resource Scan

Scan Details

Site Domain kovrov.city
Base Domain kovrov.city
Scan Status Ok
Last Scan2024-09-21T05:21:57+00:00
Next Scan 2024-09-28T05:21:57+00:00

Last Scan

Scanned2024-09-21T05:21:57+00:00
URL https://kovrov.city/robots.txt
Domain IPs 87.236.16.91
Response IP 87.236.16.91
Found Yes
Hash 94626ca51625fc097b9dd8a94d6e45a997e6ea429d704f31eba133a365de4abb
SimHash cc0c0b076db0

Groups

yandex

Rule Path
Disallow /
Allow /$
Allow /robots.txt
Allow /news
Allow /pages
Allow /work
Allow /marshrutki
Allow /trolleybus
Allow /taxi.html
Allow /street
Allow /busstop
Allow /cargo
Allow /autobus
Allow /eltrain
Allow /train
Allow /cinema
Allow /forum
Allow /firms
Allow /afisha
Allow /wboard
Allow /transport.html$
Allow /uploads
Allow /market
Allow /content
Allow /konkurs
Allow /sitemap*

googlebot

Rule Path
Disallow /
Allow /$
Allow /robots.txt
Allow /news
Allow /pages
Allow /work
Allow /marshrutki
Allow /trolleybus
Allow /taxi.html
Allow /street
Allow /busstop
Allow /cargo
Allow /autobus
Allow /eltrain
Allow /train
Allow /cinema
Allow /forum
Allow /firms
Allow /afisha
Allow /wboard
Allow /transport.html$
Allow /uploads
Allow /market
Allow /content
Allow /konkurs
Allow /sitemap*
Allow /templates/pure/

Other Records

Field Value
sitemap https://kovrov.city/sitemap.xml
sitemap https://kovrov.city/sitemap.xml

Comments

  • для Гугла. Настройки в сеч.консоли оставим на усмотрение гугла.
  • Всё запрещаем, кроме нужного.

Warnings

  • `host` is not a known field.