rtv.rs
robots.txt

Robots Exclusion Standard data for rtv.rs

Resource Scan

Scan Details

Site Domain rtv.rs
Base Domain rtv.rs
Scan Status Ok
Last Scan2024-10-31T21:05:34+00:00
Next Scan 2024-11-30T21:05:34+00:00

Last Scan

Scanned2024-10-31T21:05:34+00:00
URL https://rtv.rs/robots.txt
Domain IPs 212.200.255.139
Response IP 212.200.255.139
Found Yes
Hash a092d80e0b3285d0028e1ded32d6eebee50f2d9cbd4b29d3cad7a54f2f2b0730
SimHash 681103f50383

Groups

slurp

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

omgilibot

Rule Path
Disallow /

deusu

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bingbot

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

kraken

Rule Path
Disallow /

cutbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

feedspotbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /sr_ci/news/print
Disallow /sr_lat/news/print
Disallow /hu/news/print
Disallow /rsn/news/print
Disallow /sk/news/print
Disallow /ro/news/print
Disallow /rom/news/print
Disallow /dwr
Disallow /css
Disallow /js
Disallow /sr_lat/komentar
Disallow /sr_ci/komentar
Allow /

*

Rule Path
Disallow /

Comments

  • robots.txt