penguinoffice.co.uk
robots.txt

Robots Exclusion Standard data for penguinoffice.co.uk

Resource Scan

Scan Details

Site Domain penguinoffice.co.uk
Base Domain penguinoffice.co.uk
Scan Status Ok
Last Scan2025-09-22T23:19:07+00:00
Next Scan 2025-10-22T23:19:07+00:00

Last Scan

Scanned2025-09-22T23:19:07+00:00
URL https://penguinoffice.co.uk/robots.txt
Domain IPs 13.107.246.64
Response IP 13.107.246.64
Found Yes
Hash a9680af557425d481ba57348f7930444dc010ece15670f65931da1b5042f080d
SimHash 7f5ed950e7b3

Groups

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

yandex

Rule Path
Disallow /

crawl31

Rule Path
Disallow /

crawl31+

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

qihoo

Rule Path
Disallow /

qihoo

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wbsearchbot+

Rule Path
Disallow /

purebot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

domaintools

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

dotnetdotcom

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

solomonobot

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

morfeus

Rule Path
Disallow /

snoopy

Rule Path
Disallow /

slurp

Rule Path
Disallow /

exabot

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dinoping

Rule Path
Disallow /

panopta.com

Rule Path
Disallow /

searchmetrics

Rule Path
Disallow /

lipperhey

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

www.integromedb.org/crawler

Rule Path
Disallow /

yamanalab-robot

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

aboundex

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

yunyun

Rule Path
Disallow /

masscan

Rule Path
Disallow /

escan

Rule Path
Disallow /

linguee

Rule Path
Disallow /

kagoobot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

pricesearcher.com

Rule Path
Disallow /

seekport

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

*

Rule Path
Disallow /search/
Disallow /icons/
Disallow /blog/
Disallow /wordpress/
Disallow /wp/
Disallow /error/
Disallow /primaimage/
Disallow /basket/
Disallow /user/
Disallow /contract/
Disallow /order/
Disallow /orderpad/
Disallow /product/add_to_compare/
Disallow /product/compare/
Disallow /product/finder/
Disallow /product/frequently_purchased_products/
Disallow /product/unknown/
Disallow /product/ajax_display/
Disallow /product/display/
Disallow /product/list/
Disallow /contact/
Disallow /wp-login.php
Disallow /xmlrpc.php
Disallow /magmi/
Disallow /webstore-support.php
Disallow /ecommerce-integration.php
Disallow /skin/
Disallow /downloader/
Disallow /ap.php
Disallow /administrator/
Disallow /extras/
Disallow /webstore-faq.php
Disallow /webstore-account-manager.php
Disallow /configuration.php
Disallow /wp-admin/
Disallow /voip_and_web_phones.php
Disallow /partners.php
Disallow /email_services.php
Disallow /price_list.php
Disallow /domain_names.php
Disallow /license.php
Disallow /promotions.php
Disallow /privacy.php
Disallow /module/
Disallow /product/prices/
Disallow /product/sort_essendant_reviews/
Disallow /printer/
Disallow /featured/
Disallow /help/
Disallow /offline/
Disallow /quote/
Disallow /sharedbasket/
Disallow /*?*pageNum=*
Disallow /*?*class=*
Disallow /*?*attrib=*
Disallow /*?*sort=*
Disallow /*?*search_string=*

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://penguinoffice.co.uk/sitemap.xml

Warnings

  • 4 invalid lines.