litfac.ru
robots.txt

Robots Exclusion Standard data for litfac.ru

Resource Scan

Scan Details

Site Domain litfac.ru
Base Domain litfac.ru
Scan Status Ok
Last Scan2024-09-29T13:45:54+00:00
Next Scan 2024-10-06T13:45:54+00:00

Last Scan

Scanned2024-09-29T13:45:54+00:00
URL https://litfac.ru/robots.txt
Domain IPs 91.206.14.160
Response IP 91.206.14.160
Found Yes
Hash c938c62cf3f55282ae6d69e2a9bb11076c92ee41bd91d84c02a0739135808e7b
SimHash 0b58df070e5c

Groups

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /
Allow *favicon*

yandexmedia

Rule Path
Disallow /
Allow *favicon*

tineye-bot

Rule Path
Disallow /

tineye

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-json/
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /t
Disallow /t/*/
Disallow /tg
Disallow /tg/*/
Disallow /*?
Disallow /?s=
Allow /*.css
Allow /*.js
Disallow /search
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */wp-json/*
Disallow /wp-content/uploads/
Disallow */page/*

Other Records

Field Value
sitemap https://litfac.ru/sitemap.xml

Comments

  • global

Warnings

  • `host` is not a known field.