psiheya-market.ru
robots.txt

Robots Exclusion Standard data for psiheya-market.ru

Resource Scan

Scan Details

Site Domain psiheya-market.ru
Base Domain psiheya-market.ru
Scan Status Ok
Last Scan2024-05-19T08:48:57+00:00
Next Scan 2024-06-18T08:48:57+00:00

Last Scan

Scanned2024-05-19T08:48:57+00:00
URL https://psiheya-market.ru/robots.txt
Domain IPs 194.67.109.252, 2a00:f940:2:4:2::5235
Response IP 194.67.109.252
Found Yes
Hash adaa3d943b9d3713a06946ccce6c3b5b9501e82170022fd975e39d5c5c394420
SimHash df1d8e038a73

Groups

*

Rule Path
Allow /
Disallow /wp-json/
Disallow /js/
Disallow /ajax/
Disallow /setcity/
Disallow /accaunt/
Disallow /password
Disallow /successUrl?
Disallow /successUrl
Disallow /?
Disallow /login
Disallow /profile
Disallow /fbauth
Disallow /okauth
Disallow /vkauth
Disallow /googleauth
Disallow /yandexauth
Disallow /yandexlogin
Disallow /googlelogin
Disallow /maillogin
Disallow /register
Disallow /shopFailUrl
Disallow /cart
Disallow /cart/ordering

Other Records

Field Value
crawl-delay 40

yandex

Rule Path
Allow /
Disallow /wp-json/
Disallow /js/
Disallow /ajax/
Disallow /setcity/
Disallow /accaunt/
Disallow /password
Disallow /successUrl?
Disallow /successUrl
Disallow /?
Disallow /login
Disallow /profile
Disallow /fbauth
Disallow /okauth
Disallow /vkauth
Disallow /googleauth
Disallow /yandexauth
Disallow /yandexlogin
Disallow /googlelogin
Disallow /maillogin
Disallow /register
Disallow /shopFailUrl
Disallow /cart
Disallow /cart/ordering

Other Records

Field Value
crawl-delay 40

googlebot

Rule Path
Allow /
Disallow /wp-json/
Disallow /js/
Disallow /ajax/
Disallow /setcity/
Disallow /accaunt/
Disallow /password
Disallow /successUrl?
Disallow /successUrl
Disallow /?
Disallow /login
Disallow /profile
Disallow /fbauth
Disallow /okauth
Disallow /vkauth
Disallow /googleauth
Disallow /yandexauth
Disallow /yandexlogin
Disallow /googlelogin
Disallow /maillogin
Disallow /register
Disallow /shopFailUrl
Disallow /cart
Disallow /cart/ordering

teoma, disco pump, wget, webzip, teleport pro, websnake, offline explorer, web-by-mail, teleport pro/1.29, scooter-w3-1.0, scooter, lycos, aport, webalta, slurp, msnbot, quintura-crw, turtle, twiceler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dolphin

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

sitereport

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

Other Records

Field Value
sitemap https://psiheya-market.ru/sitemap.xml
sitemap https://psiheya-market.ru/sitemap.xml
sitemap https://psiheya-market.ru/sitemap.xml

Warnings

  • `host` is not a known field.