Log In Sign Up

miljodirektoratet.no
robots.txt

Robots Exclusion Standard data for miljodirektoratet.no

Resource Scan

Scan Details

Site Domain miljodirektoratet.no
Base Domain miljodirektoratet.no
Scan Status Ok
Last Scan2025-12-02T03:39:41+00:00
Next Scan 2025-12-16T03:39:41+00:00

Last Scan

Scanned2025-12-02T03:39:41+00:00
URL https://miljodirektoratet.no/robots.txt
Redirect https://www.miljodirektoratet.no/robots.txt
Redirect Domain www.miljodirektoratet.no
Redirect Base miljodirektoratet.no
Domain IPs 194.63.248.52, 2a01:5b40:0:248::52
Redirect IPs 104.18.37.41, 172.64.150.215, 2a06:98c1:3103::ac40:96d7, 2a06:98c1:310a::6812:2529
Response IP 104.18.37.41
Found Yes
Hash 3d73feecf224793c5ec7dae93eb80bbe3cb85f2c64d030715bef9be9a7f72b6a
SimHash 3114b86ccdc1

Groups

googlebot

Rule Path
Disallow

*

Rule Path
Disallow

google-extended

Rule Path
Disallow /*.pdf$

gptbot

Rule Path
Disallow /*.pdf$

perplexitybot

Rule Path
Disallow /*.pdf$

claudebot

Rule Path
Disallow /*.pdf$

claude-user

Rule Path
Disallow /*.pdf$
Back to top

Other Records

Field Value
sitemap https://www.miljodirektoratet.no/sitemap.xml
sitemap https://www.miljodirektoratet.no/chemicalsearch/chemicalssitemap
Back to top

Comments

  • La Googlebot (vanlig søk) hente alt
  • La alle andre søkemotorer hente alt ogsÃ¥
  • MEN: Blokker Google-Extended (AI)
  • Blokker OpenAI GPTBot (AI)
  • Blokker PerplexityBot (AI)
  • Blokker Anthropic/Claude (AI)
Back to top