techly.it
robots.txt
Robots Exclusion Standard data for techly.it
Resource Scan
Scan Details
Site Domain | techly.it |
Base Domain | techly.it |
Scan Status | Ok |
Last Scan | 2025-07-14T06:26:47+00:00 |
Next Scan | 2025-08-13T06:26:47+00:00 |
Last Scan
Scanned | 2025-07-14T06:26:47+00:00 |
URL | https://www.techly.it/robots.txt |
Domain IPs | 104.26.4.28, 104.26.5.28, 172.67.69.58, 2606:4700:20::681a:41c, 2606:4700:20::681a:51c, 2606:4700:20::ac43:453a |
Response IP | 104.26.4.28 |
Found | Yes |
Hash | b900fea0b27482e834b84f1e328e7c4a094ec1d19d5ffe1ef28c58cb9b44d1f6 |
SimHash | 6520b17bce91 |
Groups
*
Rule | Path |
---|---|
Disallow | /*.svn$ |
Disallow | /*.idea$ |
Disallow | /*.sql$ |
Disallow | /*.tgz$ |
Disallow | /*.php$ |
Disallow | /app/ |
Disallow | /bin/ |
Disallow | /dev/ |
Disallow | /lib/ |
Disallow | /var/ |
Disallow | /vendor/ |
Disallow | /pkginfo/ |
Disallow | /report/ |
Disallow | /catalog/ |
Disallow | /*_mof_data |
Disallow | /*base_url |
Disallow | /iccatalog/product/getJsonInfo/ |
Disallow | /skin/frontend/manhattan/default/favicon/manifest.json |
Disallow | /iccatalog/compare/listids/ |
Disallow | /wishlist/index/listids/ |
Disallow | /iccatalog/compare/list/ |
Disallow | /customer/account/login/ |
Disallow | /*?* |
Allow | /*?p=* |
Disallow | /catalogsearch/ |
Disallow | /*?SID= |
Disallow | /checkout/ |
Disallow | /onestepcheckout/ |
Disallow | /customer/ |
Disallow | /wishlist/ |
Disallow | /sendfriend/ |
Disallow | /review/ |
Disallow | /iccatalog/compare/ |
Disallow | /sendfriend/ |
Disallow | /store/switch/* |
Disallow | /catalogsearch/ |
Disallow | /*?export* |
Disallow | /intracom-search/result/export/ |
Disallow | /shopby/ |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://www.techly.it/media/sitemap_techly-it_1.xml |
Comments