cream.shop
robots.txt

Robots Exclusion Standard data for cream.shop

Resource Scan

Scan Details

Site Domain cream.shop
Base Domain cream.shop
Scan Status Ok
Last Scan2024-09-30T04:29:38+00:00
Next Scan 2024-10-30T04:29:38+00:00

Last Scan

Scanned2024-09-30T04:29:38+00:00
URL https://cream.shop/robots.txt
Domain IPs 91.228.222.32
Response IP 91.228.222.32
Found Yes
Hash ddb9a7b89201087e2570a1cfc1f74f7f68092fbe0209f9f93fd947387cdcbd71
SimHash 5b56d9736711

Groups

*

Rule Path
Disallow /*index.php
Disallow /*%26print%3D
Disallow /*/gallery/*order%3D*
Disallow /*/search/
Disallow /*/slide_show/
Disallow /*?action=
Disallow /*?PAGEN
Disallow /*?print=
Disallow /*ABC%3D
Disallow /*auth%3D
Disallow /*back_url_admin%3D*
Disallow /*back_url%3D*
Disallow /*backurl%3D*
Disallow /*bitrix
Disallow /*bitrix_*%3D
Disallow /*change_password%3D
Disallow /*COUNTRY_SECT%3D
Disallow /*COURSE_ID%3D
Disallow /*forgot_password%3D
Disallow /*login%3D
Disallow /*logout%3D
Disallow /*noempty%3D
Disallow /*order%3D
Disallow /*PAGEN_
Disallow /*print_course%3DY
Disallow /*register%3D
Disallow /*show_all%3D
Disallow /*SHOWALL
Disallow /*sort%3D
Disallow /ajax/
Disallow /bitrix/
Disallow /cart/
Disallow /order/
Disallow /cron/
Disallow /disable_subscription/
Disallow /personal/
Disallow /search/
Disallow /upload/
Disallow /orangeData/
Disallow /*q%3D
Disallow /*arrFilterTip%3D
Disallow /*rating%3D
Disallow /*view%3D
Disallow /*bitrix_include_areas%3D
Disallow /*logout_butt%3D
Disallow /*negative%3D
Disallow /*ALL_ITEM%3D
Disallow /*ID1%3D
Disallow /*rz%3D
Disallow /otpisatsya-ot-polucheniya-rassylok/
Disallow /*?series=
Disallow /reg/
Disallow /*.xls$
Disallow /*.xlsx$
Disallow /vip-
Disallow /*redirect.php
Disallow /*rk.php
Disallow /*click.php
Disallow /*tools/
Disallow /basket/
Disallow /legal/*.pdf
Disallow /payment_*
Disallow /*ajax.php?*yandex_metrika*
Disallow /gift-certificate/cache/
Disallow /e/*
Allow /*bitrix/*ajax.php
Allow /*bitrix/*.css
Allow /*bitrix/*.js
Allow /*bitrix*/*.png
Allow /*bitrix*/*.gif
Allow /*bitrix*/*.jpg
Allow /*bitrix*/*.jpeg
Allow /upload/*.png
Allow /upload/*.gif
Allow /upload/*.jpg
Allow /upload/*.jpeg
Allow /upload/*.bmp

ahrefsbot

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

webzip

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

websnake

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

web-by-mail

Rule Path
Disallow /

psbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

linguee

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

lcc

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

checkmarknetwork/1.0 (+http://www.checkmarknetwork.com/spider.html)

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

barkrowler/0.9

Rule Path
Disallow /

lcc

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Warnings

  • `clean-param` is not a known field.