agro.ria.com
robots.txt
Robots Exclusion Standard data for agro.ria.com
Resource Scan
Scan Details
Site Domain | agro.ria.com |
Base Domain | ria.com |
Scan Status | Ok |
Last Scan | 2025-03-03T18:09:21+00:00 |
Next Scan | 2025-04-02T18:09:21+00:00 |
Last Scan
Scanned | 2025-03-03T18:09:21+00:00 |
URL | https://agro.ria.com/robots.txt |
Domain IPs | 213.95.148.67 |
Response IP | 213.95.148.67 |
Found | Yes |
Hash | e8bc8d1aeccdd1705c311076b829b53ce49f7bfb8dcb8d1b75449ff676127aa7 |
SimHash | 57154974e796 |
Groups
*
Rule | Path |
---|---|
Disallow | *gosalon* |
Disallow | *golink* |
Disallow | *golinknews* |
Disallow | *login.html?from_url=* |
Disallow | */search* |
Disallow | */api/* |
Disallow | */keek.jpg |
Disallow | */content/news/* |
Disallow | */final_page/views/* |
Disallow | */demo/* |
Disallow | */accesslog* |
Disallow | */user/menu/bookmarks/* |
Disallow | */addauto/* |
Disallow | *slonikAccessStat* |
Disallow | */check_selection/* |
Disallow | */autotest_blocks/* |
Disallow | */?target=* |
Disallow | */buClickStat/* |
Disallow | */buShowStat?* |
Disallow | */dynamicLink/* |
Disallow | */advertisementStatistic/* |
Disallow | */t/dummy/json/* |
Disallow | *newsShowStat* |
Disallow | *rMetrics* |
Disallow | *newsSlonikSegmentation* |
Disallow | *countryOriginStat* |
Disallow | *vin-history* |
Disallow | *graphql* |
Disallow | *ext-pdf* |
Allow | */search/ |
Other Records
Field | Value |
---|---|
sitemap | https://agro.ria.com/sitemap.xml |