021.rs
robots.txt

Robots Exclusion Standard data for 021.rs

Resource Scan

Scan Details

Site Domain 021.rs
Base Domain 021.rs
Scan Status Ok
Last Scan2024-05-09T21:32:42+00:00
Next Scan 2024-05-16T21:32:42+00:00

Last Scan

Scanned2024-05-09T21:32:42+00:00
URL https://021.rs/robots.txt
Redirect http://www.021.rs/robots.txt
Redirect Domain www.021.rs
Redirect Base 021.rs
Domain IPs 92.249.52.62
Redirect IPs 92.249.52.62
Response IP 92.249.52.62
Found Yes
Hash be3055de8e874f2a3dbbb3544b20bd0f094429d91db1a544dc3d19fdd6347dc7
SimHash 61a4ee60d734

Groups

twitterbot

Rule Path
Allow /images/

*

Rule Path
Disallow /admin/
Disallow /images/
Disallow /application/
Disallow /assets/
Disallow /system/
Disallow /story/Info/Srbija/202809/*
Disallow /story/Info/Biznis-i-ekonomija/202809/*
Disallow /Info/komentari/202809
Disallow /story/Info/Misljenja-i-intervjui/218869/*
Disallow /Info/komentari/218869
Disallow /oglasi/ugostitelji-pekari-kuvari-poslasticari/9/*
Disallow /oglasi/trgovina/8/*
Disallow /oglasi/odrzavanje-higijene-pomoc-u-kuci-i-popravke/7/*
Disallow /oglasi/gradjevina-geodezija-arhitektura/6/*
Disallow /oglasi/briga-o-lepoti/5/*
Disallow /oglasi/transport-magacin-nabavka/4/*
Disallow /oglasi/administracija-racunovodstvo/3/*
Disallow /oglasi/prodaja-komercijalni-poslovi/2/*
Disallow /oglasi/ostalo/1/*
Disallow /quiz/ajax/*
Allow /application/js/
Allow /application/css/