bloc.no
robots.txt

Robots Exclusion Standard data for bloc.no

Resource Scan

Scan Details

Site Domain bloc.no
Base Domain bloc.no
Scan Status Ok
Last Scan2025-10-19T18:01:48+00:00
Next Scan 2025-11-18T18:01:48+00:00

Last Scan

Scanned2025-10-19T18:01:48+00:00
URL https://bloc.no/robots.txt
Redirect https://www.bloc.no/robots.txt
Redirect Domain www.bloc.no
Redirect Base bloc.no
Domain IPs 194.63.248.52, 2a01:5b40:0:248::52
Redirect IPs 176.111.200.83
Response IP 176.111.200.83
Found Yes
Hash c00f2d05c5f91ce37c7cc4e0f4a3f0de55453be106e39caac89d8277985347fc
SimHash c31cc05acf10

Groups

*

Rule Path
Disallow /error/blackhole
Disallow /storage/
Disallow /fileStorage/

dotbot

Rule Path
Disallow /

googlebot

Rule Path
Allow *.js
Allow *.css

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bloc.no/sitemap/events.xml
sitemap https://www.bloc.no/sitemap/blog.xml
sitemap https://www.bloc.no/sitemap/classifieds.xml
sitemap https://www.bloc.no/sitemap/forum.xml
sitemap https://www.bloc.no/sitemap/pages.xml