novozybkov.ru
robots.txt

Robots Exclusion Standard data for novozybkov.ru

Resource Scan

Scan Details

Site Domain novozybkov.ru
Base Domain novozybkov.ru
Scan Status Ok
Last Scan2024-10-15T01:57:47+00:00
Next Scan 2024-11-14T01:57:47+00:00

Last Scan

Scanned2024-10-15T01:57:47+00:00
URL https://novozybkov.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:2:76a4, 2a00:15f8:a000:5:1:12:2:76a4, 2a00:15f8:a000:5:1:13:2:76a4, 2a00:15f8:a000:5:1:14:2:76a4, 90.156.201.105, 90.156.201.22, 90.156.201.84, 90.156.201.97
Response IP 90.156.201.105
Found Yes
Hash 066d9a1812e7632b49c7352c752a4a5752a0a8c877b994c9df6833e6fb11eb5d
SimHash cc5309a5f3b4

Groups

mediapartners-google*

Rule Path
Disallow

*

Rule Path
Disallow */largemap.php
Disallow /map/largemap*
Disallow /blog/cgi-bin
Disallow /blog/wp-admin
Disallow /news/wp-admin*
Disallow /blog/wp-includes
Disallow /blog/wp-content/plugins
Disallow /blog/wp-content/cache
Disallow /blog/wp-content/themes
Disallow /blog/wp-trackback
Disallow /blog/wp-feed
Disallow /blog/wp-comments
Disallow */trackback
Disallow */feed
Disallow */comments*
Disallow *comment-page*
Disallow /blog/*?*
Disallow /votes/*
Disallow *popuplink*
Disallow /files/*
Disallow /news/comment-subscriptions*
Disallow *compage*
Disallow /sab/*
Disallow /afisha/*

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.