birdfood.ie
robots.txt

Robots Exclusion Standard data for birdfood.ie

Resource Scan

Scan Details

Site Domain birdfood.ie
Base Domain birdfood.ie
Scan Status Ok
Last Scan2024-11-08T07:20:58+00:00
Next Scan 2024-12-08T07:20:58+00:00

Last Scan

Scanned2024-11-08T07:20:58+00:00
URL https://birdfood.ie/robots.txt
Redirect https://www.vivara.ie//robots.txt
Redirect Domain www.vivara.ie
Redirect Base vivara.ie
Domain IPs 2a03:9700:8000::500, 31.7.5.190
Redirect IPs 3.77.3.209
Response IP 3.77.3.209
Found Yes
Hash b951a0d5fb4b884f323d19303c0f70ad6d4d05f11edc1411709ac0325f3fe382
SimHash 123553ce4bd0

Groups

*

Rule Path
Disallow /customer/
Disallow /wishlist/
Disallow /checkout/
Disallow /catalog/
Disallow /catalogsearch/
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /onestepcheckout/
Disallow /phpserver/
Disallow /pkginfo/
Disallow /report/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /var/
Allow /*?p=
Disallow /*?*
Disallow /composer.json
Disallow /composer.lock
Disallow /CONTRIBUTING.md
Disallow /CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow /COPYING.txt
Disallow /Gruntfile.js
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /package.json
Disallow /RELEASE_NOTES.txt
Disallow /*.sample
Disallow /*.git
Disallow /*.cvs
Disallow /*.zip$
Disallow /*.svn$
Disallow /*.idea$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /mageworx_giftcards/preview/preview/
Disallow /*/?tt*
Disallow /j.php

httrack

Rule Path
Disallow /

pathdefender

Rule Path
Disallow /

aipbot

Rule Path
Disallow /

qihoobot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

iisbot

Rule Path
Disallow /

screaming frog

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

custo

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

newspointbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

seodiver

Rule Path
Disallow /

xenu link sleuth

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

abonti

Rule Path
Disallow /

buibui-bot

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

zyklop

Rule Path
Disallow /

bubing

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

jsoup

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

vegebot

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

domain re-animator

Rule Path
Disallow /

admantx

Rule Path
Disallow /

qcrawl

Rule Path
Disallow /

bhcbot

Rule Path
Disallow /

getintentcrawler

Rule Path
Disallow /

onpagebot

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

vegi bot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

Comments

  • Directories
  • Parameters
  • Files
  • Urls
  • DISALLOWS BY SMARTRANKING 082024
  • Specific Crawlers