webpet.it
robots.txt
Robots Exclusion Standard data for webpet.it
Resource Scan
Scan Details
| Site Domain | webpet.it |
| Base Domain | webpet.it |
| Scan Status | Ok |
| Last Scan | 2025-05-20T00:55:17+00:00 |
| Next Scan | 2025-06-19T00:55:17+00:00 |
Last Scan
| Scanned | 2025-05-20T00:55:17+00:00 |
| URL | https://webpet.it/robots.txt |
| Redirect | https://www.webpet.it/robots.txt |
| Redirect Domain | www.webpet.it |
| Redirect Base | webpet.it |
| Domain IPs | 51.91.78.198 |
| Redirect IPs | 104.26.10.46, 104.26.11.46, 172.67.75.62, 2606:4700:20::681a:a2e, 2606:4700:20::681a:b2e, 2606:4700:20::ac43:4b3e |
| Response IP | 104.26.10.46 |
| Found | Yes |
| Hash | 2841b6d0aadaa6dd5951fb0c2df69c9c0e3125d63263813269b8baf9f1aafae1 |
| SimHash | e22c7948453e |
Groups
*
| Rule | Path |
|---|---|
| Allow | */modules/*.css |
| Allow | */modules/*.js |
| Allow | */modules/*.png |
| Allow | */modules/*.jpg |
| Allow | /js/jquery/* |
| Disallow | /*?order= |
| Disallow | /*?tag= |
| Disallow | /*?id_currency= |
| Disallow | /*?search_query= |
| Disallow | /*?back= |
| Disallow | /*?n= |
| Disallow | /*%26order%3D |
| Disallow | /*%26tag%3D |
| Disallow | /*%26id_currency%3D |
| Disallow | /*%26search_query%3D |
| Disallow | /*%26back%3D |
| Disallow | /*%26n%3D |
| Disallow | /*controller%3Daddresses |
| Disallow | /*controller%3Daddress |
| Disallow | /*controller%3Dauthentication |
| Disallow | /*controller%3Dcart |
| Disallow | /*controller%3Ddiscount |
| Disallow | /*controller%3Dfooter |
| Disallow | /*controller%3Dget-file |
| Disallow | /*controller%3Dheader |
| Disallow | /*controller%3Dhistory |
| Disallow | /*controller%3Didentity |
| Disallow | /*controller%3Dimages.inc |
| Disallow | /*controller%3Dinit |
| Disallow | /*controller%3Dmy-account |
| Disallow | /*controller%3Dorder |
| Disallow | /*controller%3Dorder-slip |
| Disallow | /*controller%3Dorder-detail |
| Disallow | /*controller%3Dorder-follow |
| Disallow | /*controller%3Dorder-return |
| Disallow | /*controller%3Dorder-confirmation |
| Disallow | /*controller%3Dpagination |
| Disallow | /*controller%3Dpassword |
| Disallow | /*controller%3Dpdf-invoice |
| Disallow | /*controller%3Dpdf-order-return |
| Disallow | /*controller%3Dpdf-order-slip |
| Disallow | /*controller%3Dproduct-sort |
| Disallow | /*controller%3Dsearch |
| Disallow | /*controller%3Dstatistics |
| Disallow | /*controller%3Dattachment |
| Disallow | /*controller%3Dguest-tracking |
| Disallow | /app/ |
| Disallow | /cache/ |
| Disallow | /classes/ |
| Disallow | /config/ |
| Disallow | /controllers/ |
| Disallow | /download/ |
| Disallow | /js/ |
| Disallow | /localization/ |
| Disallow | /log/ |
| Disallow | /mails/ |
| Disallow | /modules/ |
| Disallow | /override/ |
| Disallow | /pdf/ |
| Disallow | /src/ |
| Disallow | /tools/ |
| Disallow | /translations/ |
| Disallow | /upload/ |
| Disallow | /var/ |
| Disallow | /vendor/ |
| Disallow | /webservice/ |
| Disallow | /it/app/ |
| Disallow | /it/cache/ |
| Disallow | /it/classes/ |
| Disallow | /it/config/ |
| Disallow | /it/controllers/ |
| Disallow | /it/download/ |
| Disallow | /it/js/ |
| Disallow | /it/localization/ |
| Disallow | /it/log/ |
| Disallow | /it/mails/ |
| Disallow | /it/modules/ |
| Disallow | /it/override/ |
| Disallow | /it/pdf/ |
| Disallow | /it/src/ |
| Disallow | /it/tools/ |
| Disallow | /it/translations/ |
| Disallow | /it/upload/ |
| Disallow | /it/var/ |
| Disallow | /it/vendor/ |
| Disallow | /it/webservice/ |
| Disallow | /*it/password-recovery |
| Disallow | /*it/address |
| Disallow | /*it/addresses |
| Disallow | /*it/login |
| Disallow | /*it/cart |
| Disallow | /*it/discount |
| Disallow | /*it/order-history |
| Disallow | /*it/identity |
| Disallow | /*it/my-account |
| Disallow | /*it/order-follow |
| Disallow | /*it/credit-slip |
| Disallow | /*it/order |
| Disallow | /*it/search |
| Disallow | /*it/guest-tracking |
| Disallow | /*it/order-confirmation |
Comments