liarte.ru
robots.txt

Robots Exclusion Standard data for liarte.ru

Resource Scan

Scan Details

Site Domain liarte.ru
Base Domain liarte.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-05T05:46:52+00:00
Next Scan 2024-12-04T05:46:52+00:00

Last Successful Scan

Scanned2022-11-09T16:14:52+00:00
URL https://liarte.ru/robots.txt
Response IP 172.67.135.79, 104.21.6.217
Found Yes
Hash ed37db597a35adaaf44481dcafcd688d6a29671645554639bc3c577800af0e28
SimHash 0959df870e5c

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-json/
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /t
Disallow /t/*/
Disallow /tg
Disallow /tg/*/
Disallow /*?
Disallow /?s=
Allow /*.css
Allow /*.js
Disallow /search
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */wp-json/*
Disallow /wp-content/uploads/
Disallow */page/*

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /
Allow *favicon*

yandexmedia

Rule Path
Disallow /
Allow *favicon*

tineye-bot

Rule Path
Disallow /

tineye

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

Other Records

Field Value
sitemap https://liarte.ru/sitemap.xml

Comments

  • global

Warnings

  • `host` is not a known field.