nezavisne.rs
robots.txt

Robots Exclusion Standard data for nezavisne.rs

Resource Scan

Scan Details

Site Domain nezavisne.rs
Base Domain nezavisne.rs
Scan Status Ok
Last Scan2024-06-02T14:55:50+00:00
Next Scan 2024-06-09T14:55:50+00:00

Last Scan

Scanned2024-06-02T14:55:50+00:00
URL https://nezavisne.rs/robots.txt
Redirect https://www.nezavisne.com/robots.txt
Redirect Domain www.nezavisne.com
Redirect Base nezavisne.com
Domain IPs 104.21.4.252, 172.67.132.171, 2606:4700:3033::ac43:84ab, 2606:4700:3037::6815:4fc
Redirect IPs 104.26.8.54, 104.26.9.54, 172.67.75.232, 2606:4700:20::681a:836, 2606:4700:20::681a:936, 2606:4700:20::ac43:4be8
Response IP 104.26.9.54
Found Yes
Hash 7bc91ed8653a61c1fc6eea263420129a4d8c90a1a9e94beda4dc74c7c4ddc7f0
SimHash dab4db024712

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /6052073/
Disallow /nedjeljne/
Disallow /dnevne/
Disallow /vodic/
Disallow /ajaxtabs/
Disallow /baner/
Disallow /classes/
Disallow /conf/
Disallow /funkcije/
Disallow /HTML/
Disallow /image/
Disallow /images/
Disallow /include/
Disallow /kalendar/
Disallow /komponente/
Disallow /moduli/
Disallow /pdf/
Disallow /poll/
Disallow /Scripts/
Disallow /slike/
Disallow /stilovi/
Disallow /somefile.txt
Disallow /greskastrana.php
Disallow /izs.php
Disallow /vijesti.php
Disallow /pretraga.php
Disallow /slika.php
Disallow /glasanje/
Disallow /www/
Disallow /stats/
Disallow /rssAgregat/
Disallow /kolumne/
Disallow /var/
Disallow /forum/
Disallow /forum/*?action
Disallow /forum/*sort%3D
Disallow /forum/*msg
Disallow /slika/

mediapartners-google

Rule Path
Allow /
Disallow /magazin/ljubav-seks

Comments

  • All robots will spider the domain
  • Sitemap: http://www.nezavisne.com/robots.txt