dogtore.it
robots.txt
Robots Exclusion Standard data for dogtore.it
Resource Scan
Scan Details
| Site Domain | dogtore.it |
| Base Domain | dogtore.it |
| Scan Status | Ok |
| Last Scan | 2024-11-03T15:01:03+00:00 |
| Next Scan | 2024-12-03T15:01:03+00:00 |
Last Scan
| Scanned | 2024-11-03T15:01:03+00:00 |
| URL | https://dogtore.it/robots.txt |
| Redirect | https://www.dogtore.it/robots.txt |
| Redirect Domain | www.dogtore.it |
| Redirect Base | dogtore.it |
| Domain IPs | 159.60.129.228 |
| Redirect IPs | 159.60.129.228 |
| Response IP | 159.60.129.228 |
| Found | Yes |
| Hash | 9b3b8fbf2a087914a6a05ad91f81d69dc06e694fa3cb6db058f4a6f81a011d97 |
| SimHash | 915552030687 |
Groups
*
googlebot
| Rule | Path |
|---|---|
| Allow | *.css |
| Allow | *.js |
| Allow | /media/* |
| Allow | /static/* |
| Disallow | *PageSpeed%3D* |
| Disallow | /catalog/product_compare/* |
| Disallow | /catalog/category/view/* |
| Disallow | /catalog/product/view/* |
| Disallow | */customer/* |
| Disallow | /sendfriend/* |
| Disallow | */productalert/* |
| Disallow | /*attributes.reviewLink* |
| Disallow | /review/* |
| Disallow | /lib/ |
| Disallow | /*.php$ |
| Disallow | /pkginfo/ |
| Disallow | /report/ |
| Disallow | /var/ |
| Disallow | /*SID%3D |
| Disallow | /*? |
| Allow | /*?page=* |
| Disallow | /checkout/ |
| Disallow | /onestepcheckout/ |
| Disallow | /catalogsearch/ |
| Disallow | /app/ |
| Disallow | /bin/ |
| Disallow | /dev/ |
| Disallow | /lib/ |
| Disallow | /phpserver/ |
| Disallow | /tag/ |
| Disallow | /composer.json |
| Disallow | /composer.lock |
| Disallow | /CONTRIBUTING.md |
| Disallow | /CONTRIBUTOR_LICENSE_AGREEMENT.html |
| Disallow | /COPYING.txt |
| Disallow | /Gruntfile.js |
| Disallow | /LICENSE.txt |
| Disallow | /LICENSE_AFL.txt |
| Disallow | /nginx.conf.sample |
| Disallow | /package.json |
| Disallow | /php.ini.sample |
| Disallow | /RELEASE_NOTES.txt |
| Disallow | /*?*product_list_mode= |
| Disallow | /*?*product_list_order= |
| Disallow | /*?*product_list_limit= |
| Disallow | /*?*product_list_dir= |
| Disallow | /*.git |
| Disallow | /*.CVS |
| Disallow | /*.Zip$ |
| Disallow | /*.Svn$ |
| Disallow | /*.Idea$ |
| Disallow | /*.Sql$ |
| Disallow | /*.Tgz$ |
| Disallow | /app/ |
| Disallow | /downloader/ |
| Disallow | /errors/ |
| Disallow | /includes/ |
| Disallow | /var/ |
| Disallow | /install.php |
| Disallow | /no-route/ |
| Disallow | /*?dir= |
| Disallow | /*?mode |
| Disallow | /*limit%3D |
| Disallow | /*?SID= |
| Disallow | /*?___SID= |
| Disallow | /*PHPSESSID |
| Disallow | /achat/ |
| Disallow | */gallery/* |
| Disallow | /marketing-com/ |
| Disallow | /customer/ |
| Disallow | /checkout/ |
| Disallow | /cart/ |
| Disallow | /wishlist/ |
| Disallow | /sendfriend/ |
| Disallow | /review/ |
| Disallow | /noel/ |
| Disallow | /*.php$ |
| Disallow | /*?forcedesktop=* |
| Disallow | /*%26forcedesktop%3D* |
| Disallow | /*?marque=* |
| Disallow | /*%26marque%3D* |
| Disallow | /*?msclkid=* |
| Disallow | /*%26msclkid%3D* |
| Disallow | /*?type=* |
| Disallow | /*%26type%3D* |
| Disallow | /*?kk=* |
| Disallow | /*%26kk%3D* |
| Disallow | /*?espece=* |
| Disallow | /*%26espece%3D* |
| Disallow | /*?fabricant=* |
| Disallow | /*%26fabricant%3D* |
| Disallow | /*?animal=* |
| Disallow | /*%26animal%3D* |
| Disallow | /*?sapori=* |
| Disallow | /*%26sapori%3D* |
| Disallow | /*?regime-alimentare=* |
| Disallow | /*%26regime-alimentare%3D* |
| Disallow | /*?fascia-d-eta=* |
| Disallow | /*%26fascia-d-eta%3D* |
| Disallow | /*?taglia-animale=* |
| Disallow | /*%26taglia-animale%3D* |
| Disallow | /*?modo-di-vivere=* |
| Disallow | /*%26modo-di-vivere%3D* |
| Disallow | /*?type=* |
| Disallow | /*%26type%3D* |
| Disallow | /*?brand=* |
| Disallow | /*%26brand%3D* |
| Disallow | /*?fbclid=* |
| Disallow | /*%26fbclid%3D* |
| Disallow | /*?pk_campaign=* |
| Disallow | /*%26pk_campaign%3D* |
| Disallow | /*?pk_kwd=* |
| Disallow | /*%26pk_kwd%3D* |
| Disallow | /*?tranche-d-age=* |
| Disallow | /*%26tranche-d-age%3D* |
| Disallow | /*?order=* |
| Disallow | /*%26order%3D* |
| Disallow | /*?followSearch=* |
| Disallow | /*%26followSearch%3D* |
| Disallow | /*?specie=* |
| Disallow | /*%26specie%3D* |
| Disallow | /*?m=* |
| Disallow | /*%26m%3D* |
| Disallow | /*?filterCategoryPathROOT=* |
| Disallow | /*%26filterCategoryPathROOT%3D* |
| Disallow | /*?q=* |
| Disallow | /*%26q%3D* |
| Disallow | /*?filterMarque=* |
| Disallow | /*%26filterMarque%3D* |
| Disallow | /*?regimes-alimentaires=* |
| Disallow | /*?manufacturer=* |
| Disallow | /*?taille=* |
| Disallow | /*?colore=* |
| Disallow | /*%26colore%3D* |
| Disallow | /anciennes-categories* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dogtore.it/sitemap_do_it.xml |
Comments