rns.online
robots.txt

Robots Exclusion Standard data for rns.online

Resource Scan

Scan Details

Site Domain rns.online
Base Domain rns.online
Scan Status Ok
Last Scan2024-09-23T11:45:48+00:00
Next Scan 2024-09-30T11:45:48+00:00

Last Scan

Scanned2024-09-23T11:45:48+00:00
URL https://rns.online/robots.txt
Redirect https://finance-rambler.ru/robots.txt
Redirect Domain finance-rambler.ru
Redirect Base finance-rambler.ru
Domain IPs 81.19.82.104, 81.19.82.105, 81.19.82.106
Redirect IPs 81.19.82.104, 81.19.82.105, 81.19.82.106
Response IP 81.19.82.104
Found Yes
Hash 8f1973a7c19be5192427c4fb2f2900b3b00947871d6772000005d39050dbda24
SimHash 0a29d661ed13

Groups

yandex

Rule Path
Disallow /

googlebot

Rule Path
Allow /self/
Disallow /sports/*
Disallow /history/
Disallow /search
Disallow /set
Disallow /yandex-video-sitemap.xml
Disallow /*/items/
Disallow /*/comments/*
Disallow /calculators/
Disallow /currencies/

anews/1.0

Rule Path
Allow /rss/anews/
Disallow /self/
Disallow /sports/*
Disallow /*/comments/*

gptbot

Rule Path
Disallow /

shodan

Rule Path
Disallow /

*

Rule Path
Disallow /self/
Disallow /sports/*
Disallow /history/
Disallow /search
Disallow /set
Disallow /*/items/
Disallow /*/comments/*
Disallow /financial-promo/cookie
Disallow /financial-promo/privacy
Disallow /financial-promo/terms
Disallow /*?*show_deferred
Disallow /announces/
Disallow /brands/
Disallow /community/
Disallow /consumer-market/
Disallow /daily_themes/
Disallow /economy/
Disallow /energy/
Disallow /experience/
Disallow /finance/
Disallow /hrs/
Disallow /industry/
Disallow /internet/
Disallow /interviews/
Disallow /it-and-media/
Disallow /last_news/
Disallow /military/
Disallow /news/
Disallow /opinions/
Disallow /press_releases/
Disallow /quote_videos/
Disallow /regions/
Disallow /science/
Disallow /society/
Disallow /sports-economy/
Disallow /transport/
Disallow /world/
Disallow /calculators/
Disallow /currencies/

Other Records

Field Value
sitemap https://finance-rambler.ru/sitemap-index.xml