forpsy.ru
robots.txt

Robots Exclusion Standard data for forpsy.ru

Resource Scan

Scan Details

Site Domain forpsy.ru
Base Domain forpsy.ru
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-18T19:48:48+00:00
Next Scan 2024-10-02T19:48:48+00:00

Last Successful Scan

Scanned2024-09-08T22:24:53+00:00
URL https://www.forpsy.ru/robots.txt
Domain IPs 91.206.14.160
Response IP 91.206.14.160
Found Yes
Hash 14f9fdbe0ccdf0fc00e900681388082e90b4cc622f479e889d34af8c4b11148e
SimHash 0951df870e5c

Groups

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /
Allow *favicon*

yandexmedia

Rule Path
Disallow /
Allow *favicon*

tineye-bot

Rule Path
Disallow /

tineye

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-json/
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /t
Disallow /t/*/
Disallow /tg
Disallow /tg/*/
Disallow /*?
Disallow /?s=
Allow /*.css
Allow /*.js
Disallow /search
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */wp-json/*
Disallow /wp-content/uploads/
Disallow */page/*

Other Records

Field Value
sitemap https://forpsy.ru/wp-sitemap.xml

Comments

  • global

Warnings

  • `host` is not a known field.