agro.ria.com
robots.txt

Robots Exclusion Standard data for agro.ria.com

Resource Scan

Scan Details

Site Domain agro.ria.com
Base Domain ria.com
Scan Status Ok
Last Scan2025-03-03T18:09:21+00:00
Next Scan 2025-04-02T18:09:21+00:00

Last Scan

Scanned2025-03-03T18:09:21+00:00
URL https://agro.ria.com/robots.txt
Domain IPs 213.95.148.67
Response IP 213.95.148.67
Found Yes
Hash e8bc8d1aeccdd1705c311076b829b53ce49f7bfb8dcb8d1b75449ff676127aa7
SimHash 57154974e796

Groups

criteobot/0.1

Rule Path
Disallow /

solomonobot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow *gosalon*
Disallow *golink*
Disallow *golinknews*
Disallow *login.html?from_url=*
Disallow */search*
Disallow */api/*
Disallow */keek.jpg
Disallow */content/news/*
Disallow */final_page/views/*
Disallow */demo/*
Disallow */accesslog*
Disallow */user/menu/bookmarks/*
Disallow */addauto/*
Disallow *slonikAccessStat*
Disallow */check_selection/*
Disallow */autotest_blocks/*
Disallow */?target=*
Disallow */buClickStat/*
Disallow */buShowStat?*
Disallow */dynamicLink/*
Disallow */advertisementStatistic/*
Disallow */t/dummy/json/*
Disallow *newsShowStat*
Disallow *rMetrics*
Disallow *newsSlonikSegmentation*
Disallow *countryOriginStat*
Disallow *vin-history*
Disallow *graphql*
Disallow *ext-pdf*
Allow */search/

Other Records

Field Value
sitemap https://agro.ria.com/sitemap.xml