Log In Sign Up

warehousestationery.co.nz
robots.txt

Robots Exclusion Standard data for warehousestationery.co.nz

Resource Scan

Scan Details

Site Domain warehousestationery.co.nz
Base Domain warehousestationery.co.nz
Scan Status Ok
Last Scan2024-05-12T00:47:57+00:00
Next Scan 2024-06-11T00:47:57+00:00

Last Scan

Scanned2024-05-12T00:47:57+00:00
URL https://warehousestationery.co.nz/robots.txt
Redirect https://www.warehousestationery.co.nz/robots.txt
Redirect Domain www.warehousestationery.co.nz
Redirect Base warehousestationery.co.nz
Domain IPs 104.18.24.166, 104.18.25.166, 2606:4700::6812:18a6, 2606:4700::6812:19a6
Redirect IPs 104.18.24.166, 104.18.25.166, 2606:4700::6812:18a6, 2606:4700::6812:19a6
Response IP 104.18.24.166
Found Yes
Hash a298ff1d251c1dbbf6d84dc83f6dfe9bd700f0eeed0742c6471e326d624ce638
SimHash 2a1ede97d4f0

Groups

*

Rule Path
Allow /
Disallow /on/demandware.store/
Disallow */account/addresses
Disallow */checkout/login
Disallow */account/orderhistory
Disallow */cart
Disallow */wishlist
Disallow /*?start
Disallow /*cgid%3D*
Disallow /*dwcont%3D*
Disallow /*sz%3D*
Disallow /?*srule=
Disallow /*q%3D*
Disallow *Prefv1%3D*
Disallow /*pid%3D*
Disallow *Prefv2%3D*
Disallow *Prefv3%3D*
Disallow *Prefv4%3D*
Disallow *Prefv5%3D*
Disallow *Prefv6%3D*
Disallow *Prefv7%3D*
Disallow *Prefn%3D*
Disallow *Prefn%3D*
Disallow *Prefn1%3D*
Disallow *Prefn2%3D*
Disallow *Prefn3%3D*
Disallow *Prefn4%3D*
Disallow *Prefn5%3D*
Disallow *Prefn6%3D*
Disallow *Prefn7%3D*
Disallow *prefv1%3D*
Disallow *prefv2%3D*
Disallow *prefv3%3D*
Disallow *prefv4%3D*
Disallow *prefv5%3D*
Disallow *prefv6%3D*
Disallow *prefv7%3D*
Disallow *prefn%3D*
Disallow *prefn%3D*
Disallow *prefn1%3D*
Disallow *prefn2%3D*
Disallow *prefn3%3D*
Disallow *prefn4%3D*
Disallow *prefn5%3D*
Disallow *prefn6%3D*
Disallow *prefn7%3D*
Disallow /*pmin%3D*
Disallow /*pmax%3D*
Disallow *srule%3D*
Disallow */cart*
Disallow /*?cid
Disallow /*?cgid

tineye-bot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sproose

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

shim-crawler

Rule Path
Disallow /

steeler

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ng

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

voyager

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

redcarpet

Rule Path
Disallow /

cazoodle

Rule Path
Disallow /

answerbus

Rule Path
Disallow /

teoma

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

auditbot

Rule Path
Disallow /

page_verifier

Rule Path
Disallow /

visbot

Rule Path
Disallow /

sproose

Rule Path
Disallow /

multicrawler

Rule Path
Disallow /

hiddenmarket

Rule Path
Disallow /

furlbot

Rule Path
Disallow /

minirank

Rule Path
Disallow /

yandex

Rule Path
Disallow /

worqmada

Rule Path
Disallow /

ocelli

Rule Path
Disallow /

accoona-ai-agent

Rule Path
Disallow /

bookdog

Rule Path
Disallow /

kretrieve

Rule Path
Disallow /

snappy

Rule Path
Disallow /

webpix

Rule Path
Disallow /

pyquery

Rule Path
Disallow /

depspid

Rule Path
Disallow /

netresearchserver

Rule Path
Disallow /

xspider

Rule Path
Disallow /

easydl

Rule Path
Disallow /

sygolbot

Rule Path
Disallow /

charlotte

Rule Path
Disallow /

smbot

Rule Path
Disallow /

easydl

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

gurujibot

Rule Path
Disallow /

snapbot

Rule Path
Disallow /

nwspider

Rule Path
Disallow /

dragonfly

Rule Path
Disallow /

jambot

Rule Path
Disallow /

kbeebot

Rule Path
Disallow /

digger

Rule Path
Disallow /

icu

Rule Path
Disallow /

gurujibot

Rule Path
Disallow /

blaiz-bee

Rule Path
Disallow /

gurujibot

Rule Path
Disallow /

webaroobot

Rule Path
Disallow /

rufusbot

Rule Path
Disallow /

favorstarbot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

cfetch

Rule Path
Disallow /

pagebullbot

Rule Path
Disallow /

pulsebot

Rule Path
Disallow /

metatagsdir

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

orangespider

Rule Path
Disallow /

vadixbot

Rule Path
Disallow /

netwhatcrawler

Rule Path
Disallow /

nimblecrawler

Rule Path
Disallow /

generic

Rule Path
Disallow /

sirketcebot

Rule Path
Disallow /

summizebot

Rule Path
Disallow /

gigamega

Rule Path
Disallow /

synoobot

Rule Path
Disallow /

litefinder

Rule Path
Disallow /

geonabot

Rule Path
Disallow /

spock

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.warehousestationery.co.nz/sitemap_index.xml
Back to top

Comments

  • All spiders are disallowed to access all static resources!
Back to top