lommelegen.no
robots.txt

Robots Exclusion Standard data for lommelegen.no

Resource Scan

Scan Details

Site Domain lommelegen.no
Base Domain lommelegen.no
Scan Status Ok
Last Scan2024-05-11T04:05:15+00:00
Next Scan 2024-05-18T04:05:15+00:00

Last Scan

Scanned2024-05-11T04:05:15+00:00
URL https://lommelegen.no/robots.txt
Redirect https://lommelegen.dagbladet.no/robots.txt
Redirect Domain lommelegen.dagbladet.no
Redirect Base dagbladet.no
Domain IPs 2a02:c0:ac:3:db::180, 2a02:c0:ac:3:db::181, 2a02:c0:ac:3:db::182, 87.238.33.180, 87.238.33.181, 87.238.33.182
Redirect IPs 104.18.34.161, 172.64.153.95, 2606:4700:4400::6812:22a1, 2606:4700:4400::ac40:995f
Response IP 172.64.153.95
Found Yes
Hash bcb20a7abaf26b0b5d038a1f47b23f4cdd78e9285d56112e9890360218107c15
SimHash 1b0e8961a137

Groups

*

Rule Path
Disallow /youtube-player/
Disallow /video/playlist/
Disallow /video/popular/
Disallow /video/*
Allow /app/cyclops-router-api/api/v1/
Allow /video/*/*

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://lommelegen.dagbladet.no/sitemapindex.xml