agos24.ru
robots.txt
Robots Exclusion Standard data for agos24.ru
Resource Scan
Scan Details
| Site Domain | agos24.ru |
| Base Domain | agos24.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-12T07:37:28+00:00 |
| Next Scan | 2024-11-19T07:37:28+00:00 |
Last Scan
| Scanned | 2024-11-12T07:37:28+00:00 |
| URL | https://agos24.ru/robots.txt |
| Domain IPs | 37.194.236.212 |
| Response IP | 37.194.236.212 |
| Found | Yes |
| Hash | d86083ba3f24e9cfc90416f54cfbd4486341ac90fd58ce5757aff27289208a8d |
| SimHash | 432cbdd16888 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /inform_availability_product/ |
| Disallow | /checkout/ |
| Allow | /images/ |
| Allow | /css/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /tmp/ |
| Disallow | /*user |
| Disallow | /component |
| Allow | /*product |
| Allow | /*category |
| Disallow | /*cart |
| Disallow | /*search |
| Disallow | /search/ |
| Allow | /search/result.html? |
| Disallow | /*wishlist |
| Disallow | /*?tmpl |
| Disallow | /*torrent |
| Disallow | /*korzina/add.html? |
| Disallow | /*cart/add.html? |
| Disallow | /*?tmpl=component&print=1 |
| Disallow | /%D0%B2%D1%81%D0%B5-%D1%82%D0%BE%D0%B2%D0%B0%D1%80%D1%8B.html* |
| Disallow | /%D0%B2%D1%81%D0%B5-%D1%82%D0%BE%D0%B2%D0%B0%D1%80%D1%8B/* |
| Allow | /components/com_jshopping/files/img_products/ |
| Allow | /components/com_jshopping/files/img_categories/ |
| Allow | /components/com_jshopping/css/ |
| Allow | /components/com_jshopping/images/ |
| Allow | /components/com_jshopping/js/ |
| Allow | /include/yandex_market/index_nesturbo.php |
| Disallow | /component/virtuemart/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 22 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://agos24.ru/include/karta_sayta/xml.xml |
Warnings
- `host` is not a known field.