duepstore.it
robots.txt
Robots Exclusion Standard data for duepstore.it
Resource Scan
Scan Details
Site Domain | duepstore.it |
Base Domain | duepstore.it |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-09-29T10:50:12+00:00 |
Next Scan | 2024-10-13T10:50:12+00:00 |
Last Successful Scan
Scanned | 2024-08-22T09:52:56+00:00 |
URL | https://duepstore.it/robots.txt |
Domain IPs | 217.64.201.138 |
Response IP | 217.64.201.138 |
Found | Yes |
Hash | aa84cac4f8838aadf66c9d490660eb4a960d9ced6e38093342b22bf82a5f8b4a |
SimHash | 0165335244a1 |
Groups
semrushbot
semrushbot-sa
mail.ru
dotbot
blexbot
blexbot/1.0
istellabot
istellabot/1.01.18
istellabot/1.01.18 +http://www.tiscali.it/
istellabot/1.10.2 +http://www.tiscali.it/
mozilla/5.0 (compatible; istellabot/1.01.18 +http://www.tiscali.it/)
turnitinbot
mj12bot
smtbot
smtbot/1.0
alphabot
alphaseobot
alphaseobot-sa
seekbot
seekport crawler
linguee bot
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /wishlist/index/add/ |
Disallow | /catalog/product_compare/add/ |
Disallow | /newsletter/subscriber/new/ |
*
Rule | Path |
---|---|
Disallow | /CVS |
Disallow | /*.svn$ |
Disallow | /*.idea$ |
Disallow | /*.sql$ |
Disallow | /*.tgz$ |
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /app/ |
Disallow | /cgi-bin/ |
Disallow | /downloader/ |
Disallow | /errors/ |
Disallow | /includes/ |
Disallow | /lib/ |
Disallow | /magento/ |
Disallow | /pkginfo/ |
Disallow | /shell/ |
Disallow | /var/ |
Disallow | /php_barcode/ |
*
Rule | Path |
---|---|
Disallow | /api.php |
Disallow | /cron.php |
Disallow | /cron.sh |
Disallow | /error_log |
Disallow | /get.php |
Disallow | /install.php |
Disallow | /LICENSE.html |
Disallow | /LICENSE.txt |
Disallow | /LICENSE_AFL.txt |
Disallow | /STATUS.txt |
Disallow | /README.txt |
Disallow | /RELEASE_NOTES.txt |
Disallow | /cleanup.php |
*
Rule | Path |
---|---|
Disallow | /checkout/ |
Disallow | /onestepcheckout/ |
Disallow | /customer/ |
Disallow | /customer/account/ |
Disallow | /customer/account/login/ |
*
Rule | Path |
---|---|
Disallow | /public/ |
Disallow | /statistiche/ |
Disallow | /support/ |
Disallow | /tracking/ |
Disallow | /mysetting/ |
Disallow | /mapcategory/ |
Disallow | /ebay-track/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.duepstore.it/sitemap.xml |
Comments