laptops.az
robots.txt
Robots Exclusion Standard data for laptops.az
Resource Scan
Scan Details
Site Domain | laptops.az |
Base Domain | laptops.az |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-08-15T21:41:57+00:00 |
Next Scan | 2024-10-14T21:41:57+00:00 |
Last Successful Scan
Scanned | 2024-05-25T21:40:44+00:00 |
URL | https://laptops.az/robots.txt |
Domain IPs | 109.94.209.230 |
Response IP | 109.94.209.230 |
Found | Yes |
Hash | 0440670aac72487987b5d5b67a643234ec8ac35d0a8987a022564a35d42b410b |
SimHash | 63157b772ba7 |
Groups
*
Rule | Path |
---|---|
Disallow | /route%3Daccount/ |
Disallow | /route%3Daffiliate/ |
Disallow | /route%3Dcheckout/ |
Disallow | /route%3Dproduct/search |
Disallow | /index.php?route=product%2Fproduct*&manufacturer_id= |
Disallow | /admin |
Disallow | /catalog |
Disallow | /system |
Disallow | /?sort= |
Disallow | /%26sort%3D |
Disallow | /?order= |
Disallow | /%26order%3D |
Disallow | /?limit= |
Disallow | /%26limit%3D |
Disallow | /?filter= |
Disallow | /%26filter%3D |
Disallow | /?filter_name= |
Disallow | /%26filter_name%3D |
Disallow | /?filter_sub_category= |
Disallow | /%26filter_sub_category%3D |
Disallow | /?filter_description= |
Disallow | /%26filter_description%3D |
Disallow | /?tracking= |
Disallow | /%26tracking%3D |
yandex
Rule | Path |
---|---|
Disallow | /*route%3Daccount/ |
Disallow | /*route%3Daffiliate/ |
Disallow | /*route%3Dcheckout/ |
Disallow | /*route%3Dproduct/search |
Disallow | /index.php?route=product%2Fproduct*&manufacturer_id= |
Disallow | /admin |
Disallow | /catalog |
Disallow | /system |
Disallow | /*?sort= |
Disallow | /%26sort%3D |
Disallow | /*?order= |
Disallow | /*%26order%3D |
Disallow | /*?limit= |
Disallow | /*%26limit%3D |
Disallow | /*?filter= |
Disallow | /*%26filter%3D |
Disallow | /*?filter_name= |
Disallow | /*%26filter_name%3D |
Disallow | /*?filter_sub_category= |
Disallow | /*%26filter_sub_category%3D |
Disallow | /*?filter_description= |
Disallow | /*%26filter_description%3D |
mozilla/5.0 (compatible; dataforseobot/1.0; +https://dataforseo.com/dataforseo-bot)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; dotbot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (linux; android 7.0;) applewebkit/537.36 (khtml, like gecko) mobile safari/537.36 (compatible; petalbot;+https://webmaster.petalsearch.com/site/petalbot)
Rule | Path |
---|---|
Disallow | / |
serpstatbot/2.1 (advanced backlink tracking bot; https://serpstatbot.com/; abuse@serpstatbot.com)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; yak/1.0; http://linkfluence.com/; bot@linkfluence.com)
Rule | Path |
---|---|
Disallow | / |
Warnings
- 8 invalid lines.
- `clean-param` is not a known field.
- `host` is not a known field.
Comments