finndel.no
robots.txt

Robots Exclusion Standard data for finndel.no

Resource Scan

Scan Details

Site Domain finndel.no
Base Domain finndel.no
Scan Status Ok
Last Scan2025-10-12T20:49:35+00:00
Next Scan 2025-11-11T20:49:35+00:00

Last Scan

Scanned2025-10-12T20:49:35+00:00
URL https://finndel.no/robots.txt
Domain IPs 13.69.228.16
Response IP 13.69.228.16
Found Yes
Hash b5938e7504a4c7f9d2941ddba2919d97c6e5159531ff5ee467fc54debc5c73ab
SimHash 6551da00c730

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

indexnow

Rule Path
Disallow

microsoftbot

Rule Path
Disallow

Comments

  • Block all crawlers by default
  • Allow Googlebot
  • Allow Bingbot
  • Allow AdsBot-Google
  • Allow Facebook crawler
  • Allow IndexNow and MicrosoftBot