deltaco.se
robots.txt
Robots Exclusion Standard data for deltaco.se
Resource Scan
Scan Details
Site Domain | deltaco.se |
Base Domain | deltaco.se |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-08-19T19:24:50+00:00 |
Next Scan | 2025-09-18T19:24:50+00:00 |
Last Successful Scan
Scanned | 2025-06-27T11:41:05+00:00 |
URL | https://deltaco.se/robots.txt |
Domain IPs | 185.31.79.5 |
Response IP | 185.31.79.5 |
Found | Yes |
Hash | 7f2bee4870803ac51fb5e177c60a2d030cc18e3cdc6018e0535fed132f29ccd8 |
SimHash | a4098cd1cdf3 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
cookieinformationscanner
Rule | Path |
---|---|
Disallow | /404/ |
Disallow | /app/ |
Disallow | /downloader/ |
Disallow | /errors/ |
Disallow | /includes/ |
Disallow | /js/ |
Disallow | /lib/ |
Disallow | /magento/ |
Disallow | /media/ |
Disallow | /pkginfo/ |
Disallow | /shell/ |
Disallow | /skin/ |
Disallow | /var/ |
Disallow | /tmp/ |
Disallow | /static/ |
Disallow | /*/catalog/product_compare/ |
Disallow | /*/catalog/category/view/ |
Disallow | /catalog/product/view/ |
Disallow | /*/catalogsearch/ |
Disallow | /*/checkout/ |
Disallow | /*/control/ |
Disallow | /*/contacts/ |
Disallow | /*/customer/ |
Disallow | /*/customize/ |
Disallow | /*/newsletter/ |
Disallow | /*/poll/ |
Disallow | /*/review/ |
Disallow | /*/sendfriend/ |
Disallow | /*/tag/ |
Disallow | /*/wishlist/ |
Disallow | /*/catalog/product/gallery/ |
Disallow | /*/ac_admin_1rytw |
Disallow | /index.php/*/catalog/product_compare/ |
Disallow | /index.php/*/catalog/category/view/ |
Disallow | /index.php/*/catalog/product/view/ |
Disallow | /index.php/*/catalogsearch/ |
Disallow | /index.php/*/checkout/ |
Disallow | /index.php/*/control/ |
Disallow | /index.php/*/contacts/ |
Disallow | /index.php/*/customer/ |
Disallow | /index.php/*/customize/ |
Disallow | /index.php/*/newsletter/ |
Disallow | /index.php/*/poll/ |
Disallow | /index.php/*/review/ |
Disallow | /index.php/*/sendfriend/ |
Disallow | /index.php/*/tag/ |
Disallow | /index.php/*/wishlist/ |
Disallow | /index.php/*/catalog/product/gallery/ |
Disallow | /index.php/*/ac_admin_1rytw |
Disallow | /cron.php |
Disallow | /cron.sh |
Disallow | /error_log |
Disallow | /install.php |
Disallow | /LICENSE.html |
Disallow | /LICENSE.txt |
Disallow | /LICENSE_AFL.txt |
Disallow | /STATUS.txt |
Disallow | /get.php |
Disallow | /robots.txt |
Disallow | /maintenance.html |
Disallow | /*.php$ |
Disallow | /*?p=*& |
Disallow | /*?product_list_order=*& |
Disallow | /*/*/stores/store/switch/* |
Disallow | /*?___from_store=* |
Disallow | /*?___store= |
Disallow | /*/webforms/ |
Disallow | /webforms/ |
Disallow | /*/webforms/* |
Disallow | /webforms/* |
Disallow | /*/webforms/form/submit/* |
Disallow | /webforms/form/submit/* |
Disallow | /*/amfile/ |
Disallow | /amfile/ |
Disallow | /*/amfile/* |
Disallow | /amfile/* |
Disallow | /*/amfile/file/download/* |
Disallow | /amfile/file/download/* |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
Other Records
Field | Value |
---|---|
sitemap | https://deltaco.fi/pub/sitemap/sitemap_fi_fi.xml |
sitemap | https://deltaco.dk/pub/sitemap/sitemap_dk_da.xml |
sitemap | https://deltaco.no/pub/sitemap/sitemap_no_no.xml |
sitemap | https://deltaco.eu/pub/sitemap/sitemap_eu_en.xml |
sitemap | https://deltaco.se/pub/sitemap/sitemap_se_sv.xml |
Comments