borskollen.se
robots.txt

Robots Exclusion Standard data for borskollen.se

Resource Scan

Scan Details

Site Domain borskollen.se
Base Domain borskollen.se
Scan Status Ok
Last Scan2024-04-27T04:17:19+00:00
Next Scan 2024-05-04T04:17:19+00:00

Last Scan

Scanned2024-04-27T04:17:19+00:00
URL https://borskollen.se/robots.txt
Redirect https://www.borskollen.se/robots.txt
Redirect Domain www.borskollen.se
Redirect Base borskollen.se
Domain IPs 104.21.37.120, 172.67.208.24, 2606:4700:3030::6815:2578, 2606:4700:3033::ac43:d018
Redirect IPs 104.21.37.120, 172.67.208.24, 2606:4700:3030::6815:2578, 2606:4700:3033::ac43:d018
Response IP 172.67.208.24
Found Yes
Hash 900ed422fe2e022f3f9b5ecd3bc1f4b776668c912191a148206193b9f0dbc546
SimHash 6960c766c6b7

Groups

*

Rule Path
Allow /

googlebot-news

Rule Path
Allow /nyheter$
Allow /nyheter/27*
Allow /nyheter/intervjuer
Disallow /nyheter/*
Disallow /pressmeddelanden/*
Disallow /ekonomibloggar/*
Disallow /tv/*
Disallow /podcasts/*
Disallow /analyser/*

Other Records

Field Value
sitemap https://www.borskollen.se/sitemap_index.xml

Comments

  • Allow: /nyheter$
  • Allow: /nyheter/27*
  • Allow: /nyheter/intervjuer
  • Allow: /nyheter/arkiv
  • Allow: /aktie/
  • Disallow: /ut*
  • Disallow: /aktie/*/*
  • Disallow: /nyheter/*
  • Disallow: /pressmeddelanden/*
  • Disallow: /ekonomibloggar/*
  • Disallow: /tv/*
  • Disallow: /podcasts/*
  • Disallow: /analyser/*