cheekymonkeytoys.com
robots.txt

Robots Exclusion Standard data for cheekymonkeytoys.com

Resource Scan

Scan Details

Site Domain cheekymonkeytoys.com
Base Domain cheekymonkeytoys.com
Scan Status Ok
Last Scan2024-05-30T03:49:39+00:00
Next Scan 2024-06-29T03:49:39+00:00

Last Scan

Scanned2024-05-30T03:49:39+00:00
URL https://cheekymonkeytoys.com/robots.txt
Redirect https://www.cheekymonkeytoys.com/robots.txt
Redirect Domain www.cheekymonkeytoys.com
Redirect Base cheekymonkeytoys.com
Domain IPs 2600:3c01::f03c:91ff:fe99:fe1a, 45.33.35.166
Redirect IPs 2600:3c01::f03c:91ff:fe99:fe1a, 45.33.35.166
Response IP 45.33.35.166
Found Yes
Hash 818006f7c34e96048c008e7c609f00ab75fb1d6cd784ba5fca90a47eb55fb5a2
SimHash 025cd7eaea22

Groups

*

Rule Path
Disallow /events?*
Disallow /events
Disallow /events/*
Disallow /administrator/
Disallow /cache/
Disallow /editor/
Disallow /help/
Disallow /includes/
Disallow /language/
Disallow /mambots/
Disallow /media/
Disallow /modules/
Disallow /installation/
Disallow /wishlist
Disallow /cart
Disallow /members
Disallow /index.php?option=com_events
Disallow /index.php?option=com_wishlist
Disallow /index.php?option=com_virtuemart&page=shop.registration
Disallow /index.php?page=account.index
Disallow /index.php?option=com_virtuemart&page=shop.search
Disallow /index.php?page=shop.browse&age_id
Disallow /index.php?page=shop.cart&func=cartAdd&
Disallow /index.php?page=shop.cart
Disallow /index.php?page=checkout.index
Disallow /index2.php
Disallow /index.php/component/option%2Ccom_events/
Disallow /index.php?option=com_letterman&task=subscribe
Disallow /index.php?page=shop.browse&age_id
Disallow /component/option%2Ccom_events/
Disallow */Add-item-to-your-cart
Disallow /Add-item-to-your-cart/
Disallow */filter.html?age_%3Fid
Disallow /filter.html
Disallow /index.php?option=com_registration
Disallow /index.php?option=com_login
Allow /components/com_virtuemart/shop_image/
Allow /components/com_virtuemart/shop_image/product/
Allow /components/com_virtuemart/shop_image/product/

shopwiki

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

googlebot-image

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

gigabot/1.0

Rule Path
Disallow /

istellabot-nutch/nutch-1.10

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ptr.cnsat.com.cn

Rule Path
Disallow /

shenzhen sunrise technology

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

openlinkprofiler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

nutch

Rule Path
Disallow /

tbot-nutch/nutch-1.10

Rule Path
Disallow /

nutch-1.10

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

slurp

Rule Path
Disallow /

linkfeaturebot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

vegebot

Rule Path
Disallow /

linkdexbot/2.0

Rule Path
Disallow /

linkdexbot v2.0

Rule Path
Disallow /

linkdexbot v2.1

Rule Path
Disallow /

linkdexbot v2.2

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

xovi

Rule Path
Disallow /

veooz

Rule Path
Disallow /

veoozbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

experibot_v1

Rule Path
Disallow /

spbot

Rule Path
Disallow /