mifarma.fr
robots.txt

Robots Exclusion Standard data for mifarma.fr

Resource Scan

Scan Details

Site Domain mifarma.fr
Base Domain mifarma.fr
Scan Status Ok
Last Scan2025-05-14T19:38:06+00:00
Next Scan 2025-06-13T19:38:06+00:00

Last Scan

Scanned2025-05-14T19:38:06+00:00
URL https://mifarma.fr/robots.txt
Redirect https://www.mifarma.fr/robots.txt
Redirect Domain www.mifarma.fr
Redirect Base mifarma.fr
Domain IPs 104.21.69.210, 172.67.213.91, 2606:4700:3034::6815:45d2, 2606:4700:3036::ac43:d55b
Redirect IPs 104.21.69.210, 172.67.213.91, 2606:4700:3034::6815:45d2, 2606:4700:3036::ac43:d55b
Response IP 172.67.213.91
Found Yes
Hash 6a76358774631fb88f22ca12394f49b342b253d8d0fad4beed0273c3ca3bf425
SimHash 8141f853a190

Groups

*

Rule Path
Disallow /*.csv
Disallow /*.zip$
Disallow /*.svn$
Disallow /*.idea$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pkginfo/
Disallow /report/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalogsearch/
Disallow /*/catalogsearch/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /review/
Disallow /sendfriend/
Disallow /wishlist/
Disallow /home$
Disallow /home?*

*

Rule Path
Disallow /*/confirmation
Disallow /*/basket
Disallow /*/login
Disallow /*/create-account
Disallow /*/set-new-password
Disallow /*/password-forgotten
Disallow /*/account
Disallow /*?search=
Disallow *?brand=
Disallow *?categories_lvl0=
Disallow *?categories_lvl1=
Disallow *%26categories_lvl1%3D
Disallow *?categories_lvl2=
Disallow *%26categories_lvl2%3D
Disallow *?format=
Disallow *%26hasPromo%3D
Disallow *?priceRange=
Disallow *?age_group=
Disallow *?skin_type=
Disallow *?hair_type=
Disallow *?hair_color=
Disallow *?taste=
Disallow *?color=
Disallow *?product_characteristics=
Disallow *?size=
Disallow *?spf=
Disallow *?absorption_level=
Disallow *?occasion=
Disallow *?vitamins=
Disallow *?minerals=
Disallow *?form_of_use=
Disallow *?glass=
Disallow *?warnings=
Disallow *?vitamins_multiselect=
Disallow *?minerals_multiselect=
Disallow *?taste_multiselect=
Disallow *?skin_type_multiselect=
Disallow *?product_features_list_multiselect=
Disallow *?hair_type_multiselect
Disallow *?fq=
Disallow *?limit=
Disallow *?yoReviewsPage=
Disallow *?___SID=
Disallow *?new=
Disallow *?dir=
Disallow *?manufacturer=
Disallow *?noforce=
Disallow *?themecustomizer=
Disallow *?mode=
Disallow *?queryID=
Disallow *?__cn_tracker=
Disallow *?onSale=
Disallow *?fee=
Disallow /composer.json
Disallow /composer.lock
Disallow /CONTRIBUTING.md
Disallow /CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow /COPYING.txt
Disallow /Gruntfile.js
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /nginx.conf.sample
Disallow /package.json
Disallow /php.ini.sample
Disallow /RELEASE_NOTES.txt
Disallow /*?*product_list_mode=
Disallow /*?*product_list_order=
Disallow /*?*product_list_limit=
Disallow /*?*product_list_dir=
Disallow /*?*price=
Disallow /*?*p=
Disallow /*?*product_list_mode=
Disallow /*?*page=
Disallow /*?*q=
Disallow /*?SID=
Disallow /*?
Disallow /*?*
Disallow /*.php$
Allow /media/*.css
Allow /media/*.CSS
Allow /media/*.js
Allow /media/*.png
Allow /media/*.gif
Allow /media/*.jpg
Allow /media/*.jpeg
Allow /media/*.svg
Allow /skin/*.css
Allow /skin/*.js
Allow /skin/*.png
Allow /skin/*.gif
Allow /skin/*.jpg
Allow /skin/*.jpeg
Allow /skin/*.svg

mozilla/5.0 (compatible; yandexbot/3.0; +http://yandex.com/bots)

Rule Path
Disallow /*

yandex

Rule Path
Disallow *

yandex

Rule Path
Disallow *

gecko

Rule Path
Disallow *

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.mifarma.fr/media/sitemap/fr/sitemap-index.xml

Comments

  • CVS, SVN directory and dump files
  • Directories
  • Paths (clean URLs)
  • 2024-04: block internal search
  • Parameters & filters
  • Files
  • Do not index pages that are sorted or filtered.
  • Do not index session ID
  • User-agent