hattebutikken.no
robots.txt

Robots Exclusion Standard data for hattebutikken.no

Resource Scan

Scan Details

Site Domain hattebutikken.no
Base Domain hattebutikken.no
Scan Status Ok
Last Scan2026-01-29T19:19:00+00:00
Next Scan 2026-02-28T19:19:00+00:00

Last Scan

Scanned2026-01-29T19:19:00+00:00
URL https://hattebutikken.no/robots.txt
Domain IPs 13.53.131.53
Response IP 13.53.131.53
Found Yes
Hash 7e2374c9f781e56f17b91d06c090b92e1481de72943fc6748c57cd0c671e81e9
SimHash 625e0851a097

Groups

*

Rule Path
Disallow /handlekurv/
Disallow /kasse/
Disallow /min-konto/

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

omgili

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://hattebutikken.no/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Exclude AI Data Scrapers
  • XML Sitemap
  • ---------------------------
  • END YOAST BLOCK