agis.by
robots.txt
Robots Exclusion Standard data for agis.by
Resource Scan
Scan Details
Site Domain | agis.by |
Base Domain | agis.by |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-09-22T16:32:53+00:00 |
Next Scan | 2025-10-22T16:32:53+00:00 |
Last Successful Scan
Scanned | 2025-08-01T16:31:48+00:00 |
URL | https://agis.by/robots.txt |
Domain IPs | 2a0a:7d80:1:7::96, 93.125.99.78 |
Response IP | 93.125.99.78 |
Found | Yes |
Hash | a68171003cb089fddc1f2fed205e06bfb5ec81e2eca0611bce8f9de9a02ec035 |
SimHash | 0629eb47ec13 |
Groups
*
Rule | Path |
---|---|
Disallow | /*route%3Daccount/ |
Disallow | /*route%3Daffiliate/ |
Disallow | /*route%3Dcheckout/ |
Disallow | /*route%3Dcommon/ |
Disallow | /*route%3Dproduct/compare |
Disallow | /*route%3Dproduct/search |
Disallow | /*route%3Dproduct/product*%26manufacturer_id%3D |
Disallow | /catalog/controller |
Disallow | /catalog/language |
Disallow | /catalog/model |
Disallow | /download |
Disallow | /system |
Disallow | /search |
Disallow | */storage/ |
Disallow | /*?sort= |
Disallow | /*%26sort%3D |
Disallow | /*?order= |
Disallow | /*%26order%3D |
Disallow | /*?limit= |
Disallow | /*%26limit%3D |
Disallow | /*?filter= |
Disallow | /*%26filter%3D |
Disallow | /*?filter_name= |
Disallow | /*%26filter_name%3D |
Disallow | /*?filter_sub_category= |
Disallow | /*%26filter_sub_category%3D |
Disallow | /*?filter_description= |
Disallow | /*%26filter_description%3D |
Disallow | /*?tracking= |
Disallow | /*%26tracking%3D |
Disallow | /*%26tag%3D* |
Disallow | /*?tag=* |
Disallow | /sitemap |
Disallow | /my-account |
Disallow | /simpleregister |
Disallow | /login |
Disallow | /forgot-password |
Disallow | /address-book |
Disallow | /order-history |
Allow | *.css |
Allow | *.js |
Allow | *.jpg |
Allow | *.jpeg |
Allow | *.gif |
Allow | *.png |
Allow | *.svg |
Allow | *.webp |
Allow | *.ttf |
Allow | *.woff |
Allow | *.woff2 |
Other Records
Field | Value |
---|---|
sitemap | https://agis.by/sitemap.xml |