lacompagniedesanimaux.com
robots.txt

Robots Exclusion Standard data for lacompagniedesanimaux.com

Resource Scan

Scan Details

Site Domain lacompagniedesanimaux.com
Base Domain lacompagniedesanimaux.com
Scan Status Ok
Last Scan2024-09-11T19:49:17+00:00
Next Scan 2024-10-11T19:49:17+00:00

Last Scan

Scanned2024-09-11T19:49:17+00:00
URL https://lacompagniedesanimaux.com/robots.txt
Redirect https://www.lacompagniedesanimaux.com/robots.txt
Redirect Domain www.lacompagniedesanimaux.com
Redirect Base lacompagniedesanimaux.com
Domain IPs 104.26.10.132, 104.26.11.132, 172.67.73.112, 2606:4700:20::681a:a84, 2606:4700:20::681a:b84, 2606:4700:20::ac43:4970
Redirect IPs 104.26.10.132, 104.26.11.132, 172.67.73.112, 2606:4700:20::681a:a84, 2606:4700:20::681a:b84, 2606:4700:20::ac43:4970
Response IP 104.26.11.132
Found Yes
Hash 28988f86d1cd6910d45a29fc847768cc812453ca5bd6217a21817df7fb79ce64
SimHash d0475382064f

Groups

*

Rule Path
Allow *.css
Allow *.js
Allow /media/*
Allow /static/*
Disallow /catalog/product_compare/*
Disallow /catalog/category/view/*
Disallow /catalog/product/view/*
Disallow /sendfriend/*
Disallow */productalert/*
Disallow /*attributes.reviewLink*
Disallow /review/*
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /*SID%3D
Allow *html?page=
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /catalogsearch/
Disallow /factfinder/
Disallow /search.html
Disallow /search/
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /tag/
Disallow /composer.json
Disallow /composer.lock
Disallow /CONTRIBUTING.md
Disallow /CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow /COPYING.txt
Disallow /Gruntfile.js
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /nginx.conf.sample
Disallow /package.json
Disallow /php.ini.sample
Disallow /RELEASE_NOTES.txt
Disallow /*.git
Disallow /*.CVS
Disallow /*.Zip$
Disallow /*.Svn$
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Tgz$
Disallow /app/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /var/
Disallow /install.php
Disallow /no-route/
Disallow /*?mode=
Allow /*?mode=*&
Disallow /*?SID=
Disallow /*?___SID=
Disallow /*PHPSESSID
Disallow /achat/
Disallow */gallery/*
Disallow /marketing-com/
Disallow /customer/
Disallow /checkout/
Disallow /cart/
Disallow /wishlist/
Disallow /sendfriend/
Disallow /review/
Disallow /noel/
Disallow /*.php$
Disallow /*%26forcedesktop%3D*
Disallow /*?msclkid=*
Disallow /*%26msclkid%3D*
Disallow /*?kk=*
Disallow /*%26kk%3D*
Disallow /*?fabricant=*
Allow /*%26fabricant%3D*
Disallow /*%26brand%3D*
Disallow /*?fbclid=*
Disallow /*%26fbclid%3D*
Disallow /*?pk_campaign=*
Disallow /*%26pk_campaign%3D*
Disallow /*?pk_kwd=*
Disallow /*%26pk_kwd%3D*
Disallow /*?followSearch=*
Disallow /*%26followSearch%3D*
Disallow /*?m=*
Disallow /*%26m%3D*
Disallow /*?filterCategoryPathROOT=*
Disallow /*%26filterCategoryPathROOT%3D*
Disallow /*%26q%3D*
Disallow /*?filterMarque=*
Disallow /*%26filterMarque%3D*
Disallow /*?cat=
Disallow /anciennes-categories*

adequat

Rule Path
Disallow /

admantx bot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

corporama

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotmic dotbot

Rule Path
Disallow /

ellisphere

Rule Path
Disallow /

dotmic dotbot

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

fetch

Rule Path
Disallow /

grapeshot bot

Rule Path
Disallow /

houzzbot

Rule Path
Disallow /

infoseek

Rule Path
Disallow /

jetbot

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

leadbox

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

linko

Rule Path
Disallow /

mail.ru bot

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

opinion-tracker

Rule Path
Disallow /

proxem

Rule Path
Disallow /

proximic bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

spotter

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

verticalsearch

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

winello

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.lacompagniedesanimaux.com/sitemap_lcda_fr.xml
sitemap https://www.lacompagniedesanimaux.com/sitemaps/default/sitemap_blog.xml

Comments

  • Disable checkout & customer account
  • Disable Search pages
  • Disable common folders
  • Disable Tag & Review (Avoid duplicate content)
  • Common files
  • Disable version control folders and others
  • Disable M1