dogteur.com
robots.txt
Robots Exclusion Standard data for dogteur.com
Resource Scan
Scan Details
| Site Domain | dogteur.com |
| Base Domain | dogteur.com |
| Scan Status | Ok |
| Last Scan | 2024-11-14T00:42:02+00:00 |
| Next Scan | 2024-12-14T00:42:02+00:00 |
Last Scan
| Scanned | 2024-11-14T00:42:02+00:00 |
| URL | https://dogteur.com/robots.txt |
| Redirect | https://www.dogteur.com/robots.txt |
| Redirect Domain | www.dogteur.com |
| Redirect Base | dogteur.com |
| Domain IPs | 159.60.129.228 |
| Redirect IPs | 159.60.129.228 |
| Response IP | 159.60.129.228 |
| Found | Yes |
| Hash | c166205e303a693e2a558a311bf65507950501178c5c54bd9c5f49cc7f450042 |
| SimHash | 91555a0006c7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | *.css |
| Allow | *.js |
| Allow | /media/* |
| Allow | /static/* |
| Disallow | *PageSpeed%3D* |
| Disallow | /catalog/product_compare/* |
| Disallow | /catalog/category/view/* |
| Disallow | /catalog/product/view/* |
| Disallow | */customer/* |
| Disallow | /sendfriend/* |
| Disallow | */productalert/* |
| Disallow | /*attributes.reviewLink* |
| Disallow | /review/* |
| Disallow | /lib/ |
| Disallow | /*.php$ |
| Disallow | /pkginfo/ |
| Disallow | /report/ |
| Disallow | /var/ |
| Disallow | /*SID%3D |
| Disallow | /*? |
| Allow | /*?page=* |
| Disallow | /checkout/ |
| Disallow | /onestepcheckout/ |
| Disallow | /catalogsearch/ |
| Disallow | /app/ |
| Disallow | /bin/ |
| Disallow | /dev/ |
| Disallow | /lib/ |
| Disallow | /phpserver/ |
| Disallow | /tag/ |
| Disallow | /composer.json |
| Disallow | /composer.lock |
| Disallow | /CONTRIBUTING.md |
| Disallow | /CONTRIBUTOR_LICENSE_AGREEMENT.html |
| Disallow | /COPYING.txt |
| Disallow | /Gruntfile.js |
| Disallow | /LICENSE.txt |
| Disallow | /LICENSE_AFL.txt |
| Disallow | /nginx.conf.sample |
| Disallow | /package.json |
| Disallow | /php.ini.sample |
| Disallow | /RELEASE_NOTES.txt |
| Disallow | /*?*product_list_mode= |
| Disallow | /*?*product_list_order= |
| Disallow | /*?*product_list_limit= |
| Disallow | /*?*product_list_dir= |
| Disallow | /*.git |
| Disallow | /*.CVS |
| Disallow | /*.Zip$ |
| Disallow | /*.Svn$ |
| Disallow | /*.Idea$ |
| Disallow | /*.Sql$ |
| Disallow | /*.Tgz$ |
| Disallow | /app/ |
| Disallow | /downloader/ |
| Disallow | /errors/ |
| Disallow | /includes/ |
| Disallow | /var/ |
| Disallow | /install.php |
| Disallow | /no-route/ |
| Disallow | /*?dir= |
| Disallow | /*?mode |
| Disallow | /*limit%3D |
| Disallow | /*?SID= |
| Disallow | /*?___SID= |
| Disallow | /*PHPSESSID |
| Disallow | /achat/ |
| Disallow | */gallery/* |
| Disallow | /marketing-com/ |
| Disallow | /customer/ |
| Disallow | /checkout/ |
| Disallow | /cart/ |
| Disallow | /wishlist/ |
| Disallow | /sendfriend/ |
| Disallow | /review/ |
| Disallow | /noel/ |
| Disallow | /*.php$ |
| Disallow | /*?forcedesktop=* |
| Disallow | /*%26forcedesktop%3D* |
| Disallow | /*?marque=* |
| Disallow | /*%26marque%3D* |
| Disallow | /*?msclkid=* |
| Disallow | /*%26msclkid%3D* |
| Disallow | /*?type=* |
| Disallow | /*%26type%3D* |
| Disallow | /*?kk=* |
| Disallow | /*%26kk%3D* |
| Disallow | /*?espece=* |
| Disallow | /*%26espece%3D* |
| Disallow | /*?fabricant=* |
| Disallow | /*%26fabricant%3D* |
| Disallow | /*?mode-de-vie=* |
| Disallow | /*%26mode-de-vie%3D* |
| Disallow | /*?saveur=* |
| Disallow | /*%26saveur%3D* |
| Disallow | /*?gabarit-d-animal=* |
| Disallow | /*%26gabarit-d-animal%3D* |
| Disallow | /*?type=* |
| Disallow | /*%26type%3D* |
| Disallow | /*?brand=* |
| Disallow | /*%26brand%3D* |
| Disallow | /*?fbclid=* |
| Disallow | /*%26fbclid%3D* |
| Disallow | /*?pk_campaign=* |
| Disallow | /*%26pk_campaign%3D* |
| Disallow | /*?pk_kwd=* |
| Disallow | /*%26pk_kwd%3D* |
| Disallow | /*?tranche-d-age=* |
| Disallow | /*%26tranche-d-age%3D* |
| Disallow | /*?order=* |
| Disallow | /*%26order%3D* |
| Disallow | /*?followSearch=* |
| Disallow | /*%26followSearch%3D* |
| Disallow | /*?specie=* |
| Disallow | /*%26specie%3D* |
| Disallow | /*?m=* |
| Disallow | /*%26m%3D* |
| Disallow | /*?filterCategoryPathROOT=* |
| Disallow | /*%26filterCategoryPathROOT%3D* |
| Disallow | /*?q=* |
| Disallow | /*%26q%3D* |
| Disallow | /*?filterMarque=* |
| Disallow | /*%26filterMarque%3D* |
| Disallow | /*?regimes-alimentaires=* |
| Disallow | /*?manufacturer=* |
| Disallow | /*?taille=* |
| Disallow | /anciennes-categories* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dogteur.com/sitemap_do_fr.xml |
Comments