heinemanndutyfree.com.au
robots.txt

Robots Exclusion Standard data for heinemanndutyfree.com.au

Resource Scan

Scan Details

Site Domain heinemanndutyfree.com.au
Base Domain heinemanndutyfree.com.au
Scan Status Ok
Last Scan2024-09-15T05:29:34+00:00
Next Scan 2024-09-29T05:29:34+00:00

Last Scan

Scanned2024-09-15T05:29:34+00:00
URL https://heinemanndutyfree.com.au/robots.txt
Redirect https://www.heinemann.com.au/robots.txt
Redirect Domain www.heinemann.com.au
Redirect Base heinemann.com.au
Domain IPs 13.94.213.28
Redirect IPs 152.199.39.108, 2606:2800:247:1cb7:261b:1f9c:2074:3c
Response IP 152.199.39.108
Found Yes
Hash 5cdfee82ccb6f36a1d8b3cce0a9f7d009ff50fccad595d697032e947b2d771da
SimHash c844185904d4

Groups

*

Rule Path
Disallow /*/startPage
Disallow /*/account
Disallow /*/login
Disallow /*/registration
Disallow /*/cart$
Disallow /*/cart/$
Disallow /*/sydt1/*
Disallow /*/ool/*
Disallow /*/oolt1/*
Disallow /*/sydt2/*
Disallow /*/sydt3/*
Disallow /*/sydhd/*
Disallow /*relevance%3APointsOfService
Disallow /*relevance%3Apcstype
Disallow /*relevance%3Apcnotes
Disallow /*relevance%3Aorigin
Disallow /*relevance%3Awgarea
Disallow /*relevance%3Aregion
Disallow /*relevance%3Aanbaugebiet
Disallow /*relevance%3Arebsorte
Disallow /*relevance%3Ageschmack
Disallow /*relevance%3Acategory
Disallow /*relevance%3Abrand
Disallow /*relevance%3AspecialEditions
Disallow /*relevance%3AtradeLine
Disallow /*relevance%3Asex
Disallow /*relevance
Disallow /*price-asc
Disallow /*price-desc
Disallow /*name-asc
Disallow /*name-desc
Disallow /*brand-name-asc
Disallow /*text
Disallow /*/search/
Disallow /*categoryEntryUrl
Disallow /*contact

logicmonitor sitemonitor/1.0

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

uptimerobot/1.0

Rule Path
Disallow /

uptimerobot/2.0

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

telegrambot (like twitterbot)

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

discordbot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

startmebot

Rule Path
Disallow /

bitlybot

Rule Path
Disallow /

bitlybot/1.0

Rule Path
Disallow /

bitlybot/2.0

Rule Path
Disallow /

internet-structure-research-project-bot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

seobilitybot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

exabot-thumbnails

Rule Path
Disallow /

x28-job-bot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

jamesbot

Rule Path
Disallow /

naver

Rule Path
Disallow /

komodiabot/1.0

Rule Path
Disallow /

changedetection

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Comments

  • Registrierung, Login, Warenkorb und Co.
  • Web- und Standort-Views
  • URL-Parameter (Facettierung)
  • Interne Suche
  • Sonstige

Warnings

  • `noindex` is not a known field.