minmote.no
robots.txt

Robots Exclusion Standard data for minmote.no

Resource Scan

Scan Details

Site Domain minmote.no
Base Domain minmote.no
Scan Status Ok
Last Scan2024-06-06T19:02:54+00:00
Next Scan 2024-06-13T19:02:54+00:00

Last Scan

Scanned2024-06-06T19:02:54+00:00
URL https://minmote.no/robots.txt
Redirect https://www.minmote.no/robots.txt
Redirect Domain www.minmote.no
Redirect Base minmote.no
Domain IPs 2600:9000:2366:2800:17:8fe9:da80:93a1, 2600:9000:2366:4400:17:8fe9:da80:93a1, 2600:9000:2366:4800:17:8fe9:da80:93a1, 2600:9000:2366:4a00:17:8fe9:da80:93a1, 2600:9000:2366:b000:17:8fe9:da80:93a1, 2600:9000:2366:c000:17:8fe9:da80:93a1, 2600:9000:2366:c200:17:8fe9:da80:93a1, 2600:9000:2366:e00:17:8fe9:da80:93a1, 99.84.238.125, 99.84.238.191, 99.84.238.91, 99.84.238.93
Redirect IPs 2600:9000:2024:3c00:13:38c5:6240:93a1, 2600:9000:2024:5400:13:38c5:6240:93a1, 2600:9000:2024:600:13:38c5:6240:93a1, 2600:9000:2024:7e00:13:38c5:6240:93a1, 2600:9000:2024:c000:13:38c5:6240:93a1, 2600:9000:2024:c00:13:38c5:6240:93a1, 2600:9000:2024:ce00:13:38c5:6240:93a1, 2600:9000:2024:d800:13:38c5:6240:93a1, 65.9.112.114, 65.9.112.37, 65.9.112.5, 65.9.112.7
Response IP 3.160.246.25
Found Yes
Hash 535ae737f8a446676d114eec17eb5a03eb7d2e0a825df196e673060ef3990864
SimHash 3a4ec8c0a013

Groups

*

Rule Path
Disallow /favoritter
Disallow /arkiv

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.minmote.no/sitemap/sitemap-index.xml

Comments

  • start AI crawler block
  • End AI crawler block