planeta-mama.ru
robots.txt

Robots Exclusion Standard data for planeta-mama.ru

Resource Scan

Scan Details

Site Domain planeta-mama.ru
Base Domain planeta-mama.ru
Scan Status Ok
Last Scan2024-09-05T13:52:58+00:00
Next Scan 2024-10-05T13:52:58+00:00

Last Scan

Scanned2024-09-05T13:52:58+00:00
URL http://planeta-mama.ru/robots.txt
Domain IPs 5.101.153.249
Response IP 5.101.153.249
Found Yes
Hash a12cd37c093a9d54a8569e5b13ff0904562cf28425715b956f219f043a275bc3
SimHash b5ae80f32bd3

Groups

*

Rule Path
Disallow /images/thumbnails/
Disallow /cgi-bin/
Disallow /app/
Disallow /design/
Disallow /js/
Disallow /var/
Disallow /store_closed.html
Disallow /404.html
Disallow /init.php
Disallow /php.ini
Disallow /prepare.php
Disallow /sendmail/
Disallow /*sl%3D
Disallow /*currency%3D
Disallow /*sort_by%3D
Disallow /*layout%3D
Disallow /*variant_id%3D
Disallow /*display%3D
Disallow /*page%3D
Disallow /*return_url%3D
Disallow /*more_filters%3D
Disallow /*features_hash%3D
Disallow /*subcats%3D
Disallow /*?sef_rewrite=
Disallow /*tags.summary*
Disallow /*wishlist.view*
Disallow /login?
Disallow /profiles-update
Disallow /index.php?dispatch=products.quick_view
Disallow /index.php?dispatch=auth.recover_password
Disallow /index.php?dispatch=events.search
Disallow /index.php?dispatch=auth.login_form
Disallow /index.php?dispatch=gift_certificates.add
Disallow /index.php?dispatch=news.list
Disallow /index.php?dispatch=orders.search
Disallow /index.php?dispatch=profiles.update
Disallow /index.php?dispatch=profiles.add
Disallow /index.php?dispatch=checkout.cart

yandex

Rule Path
Disallow /images/thumbnails/
Disallow /cgi-bin/
Disallow /app/
Disallow /design/
Disallow /js/
Disallow /var/
Disallow /store_closed.html
Disallow /404.html
Disallow /init.php
Disallow /php.ini
Disallow /prepare.php
Disallow /sendmail/
Disallow /*sl%3D
Disallow /*currency%3D
Disallow /*sort_by%3D
Disallow /*layout%3D
Disallow /*variant_id%3D
Disallow /*display%3D
Disallow /*page%3D
Disallow /*return_url%3D
Disallow /*more_filters%3D
Disallow /*features_hash%3D
Disallow /*subcats%3D
Disallow /*?sef_rewrite=
Disallow /*tags.summary*
Disallow /*wishlist.view*
Disallow /login?
Disallow /profiles-update
Disallow /index.php?dispatch=products.quick_view
Disallow /index.php?dispatch=auth.recover_password
Disallow /index.php?dispatch=events.search
Disallow /index.php?dispatch=auth.login_form
Disallow /index.php?dispatch=gift_certificates.add
Disallow /index.php?dispatch=news.list
Disallow /index.php?dispatch=orders.search
Disallow /index.php?dispatch=profiles.update
Disallow /index.php?dispatch=profiles.add
Disallow /index.php?dispatch=checkout.cart

mail.ru

Rule Path
Disallow /images/thumbnails/
Disallow /cgi-bin/
Disallow /app/
Disallow /design/
Disallow /js/
Disallow /var/
Disallow /store_closed.html
Disallow /404.html
Disallow /init.php
Disallow /php.ini
Disallow /prepare.php
Disallow /sendmail/
Disallow /*sl%3D
Disallow /*currency%3D
Disallow /*sort_by%3D
Disallow /*layout%3D
Disallow /*variant_id%3D
Disallow /*display%3D
Disallow /*page%3D
Disallow /*return_url%3D
Disallow /*more_filters%3D
Disallow /*features_hash%3D
Disallow /*subcats%3D
Disallow /*?sef_rewrite=
Disallow /*tags.summary*
Disallow /*wishlist.view*
Disallow /login?
Disallow /profiles-update
Disallow /index.php?dispatch=products.quick_view
Disallow /index.php?dispatch=auth.recover_password
Disallow /index.php?dispatch=events.search
Disallow /index.php?dispatch=auth.login_form
Disallow /index.php?dispatch=gift_certificates.add
Disallow /index.php?dispatch=news.list
Disallow /index.php?dispatch=orders.search
Disallow /index.php?dispatch=profiles.update
Disallow /index.php?dispatch=profiles.add
Disallow /index.php?dispatch=checkout.cart

Other Records

Field Value
crawl-delay 300

vsagent

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

slurp

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ninjabot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

bubing

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

webartexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://planeta-mama.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.