bibel.no
robots.txt

Robots Exclusion Standard data for bibel.no

Resource Scan

Scan Details

Site Domain bibel.no
Base Domain bibel.no
Scan Status Ok
Last Scan2025-05-18T08:10:27+00:00
Next Scan 2025-05-25T08:10:27+00:00

Last Scan

Scanned2025-05-18T08:10:27+00:00
URL https://bibel.no/robots.txt
Domain IPs 104.26.8.114, 104.26.9.114, 172.67.70.242, 2606:4700:20::681a:872, 2606:4700:20::681a:972, 2606:4700:20::ac43:46f2
Response IP 104.26.8.114
Found Yes
Hash d4dcbfbe968b5e93766a2c55f75ec6a07758f2a9e3bf2f21d38228de179a9393
SimHash e35819f22f92

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://bibel.no/sitemaps-1-sitemap.xml
sitemap https://bibel.no/nn/sitemaps-1-sitemap.xml
sitemap https://bibel.no/no-se/sitemaps-1-sitemap.xml
sitemap https://bibel.no/no-svj/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://bibel.no/
  • live - don't allow web crawlers to index cpresources/ or vendor/