culina.no
robots.txt

Robots Exclusion Standard data for culina.no

Resource Scan

Scan Details

Site Domain culina.no
Base Domain culina.no
Scan Status Ok
Last Scan2025-09-16T08:30:33+00:00
Next Scan 2025-10-16T08:30:33+00:00

Last Scan

Scanned2025-09-16T08:30:33+00:00
URL https://culina.no/robots.txt
Redirect https://www.culina.no/robots.txt
Redirect Domain www.culina.no
Redirect Base culina.no
Domain IPs 217.114.94.2, 2a00:1c50:94::2
Redirect IPs 104.18.36.99, 172.64.151.157, 2606:4700:440d::6812:2463, 2a06:98c1:310a::ac40:979d
Response IP 104.18.36.99
Found Yes
Hash 2c053613a725f70ad34c4e01656c99f91ee1f422fb51deed17f32ddd57b40100
SimHash 711059408013

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

youbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.culina.no/sitemap.xml