agromat.ua
robots.txt
Robots Exclusion Standard data for agromat.ua
Resource Scan
Scan Details
| Site Domain | agromat.ua |
| Base Domain | agromat.ua |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 5/1/2025, 9:57:19 PM |
| Next Scan | 7/30/2025, 9:57:19 PM |
Last Successful Scan
| Scanned | 12/10/2024, 9:54:58 PM |
| URL | https://www.agromat.ua/robots.txt |
| Domain IPs | 13.35.238.115, 13.35.238.127, 13.35.238.71, 13.35.238.94, 2600:9000:2085:6000:15:680d:e1c0:93a1, 2600:9000:2085:600:15:680d:e1c0:93a1, 2600:9000:2085:7400:15:680d:e1c0:93a1, 2600:9000:2085:8c00:15:680d:e1c0:93a1, 2600:9000:2085:9e00:15:680d:e1c0:93a1, 2600:9000:2085:a800:15:680d:e1c0:93a1, 2600:9000:2085:cc00:15:680d:e1c0:93a1, 2600:9000:2085:dc00:15:680d:e1c0:93a1 |
| Response IP | 13.35.238.127 |
| Found | Yes |
| Hash | d42f8efff31efd54487f9ee1c5f29638f12701314bc63cfc63e07793a5d6bd68 |
| SimHash | 14194c408852 |
Groups
amazonbot
| Product | Comment |
|---|---|
| amazonbot | Amazon's user agent |
| Rule | Path | Comment |
|---|---|---|
| Disallow | / | disallow this directory |
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /site/error/ |
| Disallow | /account/ |
| Disallow | /cart/ |
| Disallow | /thanks/* |
| Disallow | /cabinet-registration/* |
| Disallow | /user/* |
| Disallow | /cabinet-login/* |
| Disallow | /cabinet-logout/* |
| Disallow | /confirm/* |
| Disallow | /*gclid%3D* |
| Disallow | /*yclid%3D* |
| Disallow | /?utm_source= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.agromat.ua/sitemap.xml |