agrox.by
robots.txt
Robots Exclusion Standard data for agrox.by
Resource Scan
Scan Details
Site Domain | agrox.by |
Base Domain | agrox.by |
Scan Status | Ok |
Last Scan | 2024-06-21T15:53:17+00:00 |
Next Scan | 2024-07-21T15:53:17+00:00 |
Last Scan
Scanned | 2024-06-21T15:53:17+00:00 |
URL | https://agrox.by/robots.txt |
Domain IPs | 85.209.148.153 |
Response IP | 85.209.148.153 |
Found | Yes |
Hash | b018fedb70f45dc917d87e7cfdf19c452893feeda1ccc725da4e2c2443c13ad8 |
SimHash | 73dd8c21c5c4 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | *?sf=* |
Disallow | *?m_=* |
Disallow | *?tmpl* |
Disallow | *?page=* |
Disallow | /auth* |
Disallow | *?brand_id=* |
Disallow | *?brand3618=* |
Disallow | *?brand3628=* |
Disallow | *?brand3616=* |
Disallow | *?brand3627=* |
Disallow | *?brand3624=* |
Disallow | /search?q=* |
Disallow | *?tmpl* |
Disallow | *?gad_source=* |
Disallow | *min_i* |
Disallow | *max_i* |
Disallow | *?etext=* |
Disallow | *?yadclid=* |
Disallow | *?region=* |
Disallow | *?m_=gmc* |
Disallow | *?block=* |
yandex
Rule | Path |
---|---|
Disallow | *?sf=* |
Disallow | *?m_=* |
Disallow | *?tmpl* |
Disallow | *?page=* |
Disallow | /auth* |
Disallow | *?brand_id=* |
Disallow | *?brand3618=* |
Disallow | *?brand3628=* |
Disallow | *?brand3616=* |
Disallow | *?brand3627=* |
Disallow | *?brand3624=* |
Disallow | /search?q=* |
Disallow | *?tmpl* |
Disallow | *?gad_source=* |
Disallow | *min_i* |
Disallow | *max_i* |
Disallow | *?etext=* |
Disallow | *?yadclid=* |
Disallow | *?region=* |
Disallow | *?m_=gmc* |
Disallow | *?block=* |
Other Records
Field | Value |
---|---|
sitemap | https://agrox.by/sitemap/index-xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.