Log In Sign Up

primorske.si
robots.txt

Robots Exclusion Standard data for primorske.si

Resource Scan

Scan Details

Site Domain primorske.si
Base Domain primorske.si
Scan Status Ok
Last Scan2024-09-29T12:12:14+00:00
Next Scan 2024-10-06T12:12:14+00:00

Last Scan

Scanned2024-09-29T12:12:14+00:00
URL https://primorske.si/robots.txt
Redirect https://primorske.svet24.si/robots.txt
Redirect Domain primorske.svet24.si
Redirect Base svet24.si
Domain IPs 194.6.242.60
Redirect IPs 194.6.242.60
Response IP 194.6.242.60
Found Yes
Hash 0e385d6fbdc7e8faa82d0a74a7dcf4d6fb346e4a1b01546458c8849cc93b69e5
SimHash 2800d8734e58

Groups

*

Rule Path
Allow /CmsPages/GoogleSiteMap.aspx
Disallow /getattachment/*
Disallow /GetAttachment/*
Disallow /Sitemaps/
Disallow /pn/
Disallow /PN/
Disallow /posebne_strani/
Disallow /m/
Disallow /404
Disallow /Uporabnik
Disallow /Prijava
Disallow /prijava
Disallow /profil
Disallow /Profil
Disallow /CMSWebParts/
Disallow /App_Themes/
Disallow /CMSMessages/
Disallow /admin/*
Disallow /Admin/*
Disallow /test
Disallow /test/*

Other Records

Field Value
crawl-delay 30

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow grapeshot
Disallow
Back to top

Comments

  • Disallow: /2010
  • Disallow: /2010/*
  • Disallow: /2011
  • Disallow: /2011/*
  • Disallow: /2012
  • Disallow: /2012/*
  • Disallow: /2013
  • Disallow: /2013/*
  • Disallow: /2014
  • Disallow: /2014/*
  • Disallow: /2015
  • Disallow: /2015/*
  • Disallow: /2016
  • Disallow: /2016/*
  • Disallow: /2017
  • Disallow: /2017/*
Back to top