dosfarma.com
robots.txt
Robots Exclusion Standard data for dosfarma.com
Resource Scan
Scan Details
Site Domain | dosfarma.com |
Base Domain | dosfarma.com |
Scan Status | Ok |
Last Scan | 2025-05-21T15:56:40+00:00 |
Next Scan | 2025-06-20T15:56:40+00:00 |
Last Scan
Scanned | 2025-05-21T15:56:40+00:00 |
URL | https://dosfarma.com/robots.txt |
Redirect | https://www.dosfarma.com/robots.txt |
Redirect Domain | www.dosfarma.com |
Redirect Base | dosfarma.com |
Domain IPs | 104.26.0.251, 104.26.1.251, 172.67.75.70, 2606:4700:20::681a:1fb, 2606:4700:20::681a:fb, 2606:4700:20::ac43:4b46 |
Redirect IPs | 104.26.0.251, 104.26.1.251, 172.67.75.70, 2606:4700:20::681a:1fb, 2606:4700:20::681a:fb, 2606:4700:20::ac43:4b46 |
Response IP | 104.26.0.251 |
Found | Yes |
Hash | 2e392862d60d1e0891c6477abf6ded6b9f155024a8bc8c788cc4fa9c7340a696 |
SimHash | 8540f9538190 |
Groups
*
Rule | Path |
---|---|
Disallow | /*.csv |
Disallow | /*.zip$ |
Disallow | /*.svn$ |
Disallow | /*.idea$ |
Disallow | /*.sql$ |
Disallow | /*.tgz$ |
Disallow | /app/ |
Disallow | /bin/ |
Disallow | /dev/ |
Disallow | /lib/ |
Disallow | /phpserver/ |
Disallow | /pkginfo/ |
Disallow | /report/ |
Disallow | /setup/ |
Disallow | /update/ |
Disallow | /var/ |
Disallow | /vendor/ |
Disallow | /index.php/ |
Disallow | /catalog/product_compare/ |
Disallow | /catalog/category/view/ |
Disallow | /catalog/product/view/ |
Disallow | /catalogsearch/ |
Disallow | /checkout/ |
Disallow | /control/ |
Disallow | /contacts/ |
Disallow | /customer/ |
Disallow | /customize/ |
Disallow | /newsletter/ |
Disallow | /review/ |
Disallow | /sendfriend/ |
Disallow | /wishlist/ |
Disallow | /home$ |
Disallow | /home?* |
*
Rule | Path |
---|---|
Disallow | /*/confirmation |
Disallow | /*/basket |
Disallow | /*/login |
Disallow | /*/create-account |
Disallow | /*/set-new-password |
Disallow | /*/password-forgotten |
Disallow | /*/account |
Disallow | /*?search= |
Disallow | *?brand= |
Disallow | *?categories_lvl0= |
Disallow | *?categories_lvl1= |
Disallow | *%26categories_lvl1%3D |
Disallow | *?categories_lvl2= |
Disallow | *%26categories_lvl2%3D |
Disallow | *?format= |
Disallow | *%26hasPromo%3D |
Disallow | *?priceRange= |
Disallow | *?age_group= |
Disallow | *?skin_type= |
Disallow | *?hair_type= |
Disallow | *?hair_color= |
Disallow | *?taste= |
Disallow | *?color= |
Disallow | *?product_characteristics= |
Disallow | *?size= |
Disallow | *?spf= |
Disallow | *?absorption_level= |
Disallow | *?occasion= |
Disallow | *?vitamins= |
Disallow | *?minerals= |
Disallow | *?form_of_use= |
Disallow | *?glass= |
Disallow | *?warnings= |
Disallow | *?vitamins_multiselect= |
Disallow | *?minerals_multiselect= |
Disallow | *?taste_multiselect= |
Disallow | *?skin_type_multiselect= |
Disallow | *?product_features_list_multiselect= |
Disallow | *?hair_type_multiselect |
Disallow | *?fq= |
Disallow | *?limit= |
Disallow | *?yoReviewsPage= |
Disallow | *?___SID= |
Disallow | *?new= |
Disallow | *?dir= |
Disallow | *?manufacturer= |
Disallow | *?noforce= |
Disallow | *?themecustomizer= |
Disallow | *?mode= |
Disallow | *?queryID= |
Disallow | *?__cn_tracker= |
Disallow | *?onSale= |
Disallow | *?fee= |
Disallow | /composer.json |
Disallow | /composer.lock |
Disallow | /CONTRIBUTING.md |
Disallow | /CONTRIBUTOR_LICENSE_AGREEMENT.html |
Disallow | /COPYING.txt |
Disallow | /Gruntfile.js |
Disallow | /LICENSE.txt |
Disallow | /LICENSE_AFL.txt |
Disallow | /nginx.conf.sample |
Disallow | /package.json |
Disallow | /php.ini.sample |
Disallow | /RELEASE_NOTES.txt |
Disallow | /*?*product_list_mode= |
Disallow | /*?*product_list_order= |
Disallow | /*?*product_list_limit= |
Disallow | /*?*product_list_dir= |
Disallow | /*?*price= |
Disallow | /*?*p= |
Disallow | /*?*product_list_mode= |
Disallow | /*?*page= |
Disallow | /*?*q= |
Disallow | /*?SID= |
Disallow | /*? |
Disallow | /*?* |
Disallow | /*.php$ |
Allow | /media/*.css |
Allow | /media/*.CSS |
Allow | /media/*.js |
Allow | /media/*.png |
Allow | /media/*.gif |
Allow | /media/*.jpg |
Allow | /media/*.jpeg |
Allow | /media/*.svg |
Allow | /skin/*.css |
Allow | /skin/*.js |
Allow | /skin/*.png |
Allow | /skin/*.gif |
Allow | /skin/*.jpg |
Allow | /skin/*.jpeg |
Allow | /skin/*.svg |
Other Records
Field | Value |
---|---|
sitemap | https://www.dosfarma.com/media/sitemap/dosfarma_es/sitemap-index.xml |
Comments