libreed.ru
robots.txt

Robots Exclusion Standard data for libreed.ru

Resource Scan

Scan Details

Site Domain libreed.ru
Base Domain libreed.ru
Scan Status Ok
Last Scan2024-09-25T00:19:38+00:00
Next Scan 2024-10-02T00:19:38+00:00

Last Scan

Scanned2024-09-25T00:19:38+00:00
URL https://libreed.ru/robots.txt
Domain IPs 37.187.134.116
Response IP 37.187.134.116
Found Yes
Hash 1817a1613693be1343060c8081060b546f82bfebccb9a9711b771b16b7696fa5
SimHash 4209db406605

Groups

googlebot

Rule Path
Disallow /cgi-bin
Disallow /books/
Disallow *.html/*
Disallow /wp-json/
Disallow /uploads/books/
Disallow /wp-admin
Disallow /wp-login
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-trackback
Disallow /wp-feed
Disallow /wp-comments
Disallow /author/
Disallow /page/
Disallow /*page*/
Disallow /feed/
Disallow /*feed
Disallow /trackback
Disallow /*?
Disallow /*?*

yandex

Rule Path
Disallow /cgi-bin
Disallow /books/
Disallow /wp-json/
Disallow *.html/*
Disallow /uploads/books/
Disallow /wp-login
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-trackback
Disallow /wp-feed
Disallow /wp-comments
Disallow /author/
Disallow /page/
Disallow /*page*/
Disallow /feed/
Disallow /*feed
Disallow /trackback
Disallow /*?
Disallow /*?*

*

Rule Path
Disallow /cgi-bin
Disallow /wp-json/
Disallow *.html/*
Disallow /books/
Disallow /uploads/books/
Disallow /wp-login
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-trackback
Disallow /wp-feed
Disallow /wp-comments
Disallow /author/
Disallow /page/
Disallow /*page*/
Disallow /feed/
Disallow /*feed
Disallow /trackback
Disallow /*?
Disallow /*?*

Other Records

Field Value
sitemap https://libreed.ru/sitemap.xml

Warnings

  • `host` is not a known field.