bcdn.se
robots.txt

Robots Exclusion Standard data for bcdn.se

Resource Scan

Scan Details

Site Domain bcdn.se
Base Domain bcdn.se
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-10T03:52:22+00:00
Next Scan 2024-08-08T03:52:22+00:00

Last Successful Scan

Scanned2023-10-13T23:57:59+00:00
URL https://www.bcdn.se/robots.txt
Redirect https://www.booli.se/robots.txt
Redirect Domain www.booli.se
Redirect Base booli.se
Domain IPs 195.178.178.114
Redirect IPs 52.84.251.41, 52.84.251.44, 52.84.251.45, 52.84.251.86
Response IP 52.84.251.86
Found Yes
Hash b6ce90dc1909c4901b982168380504dbb5987d57f1f05d99f36c9bf232db1c48
SimHash 710ec053adc0

Groups

*

Rule Path
Disallow /auth/
Disallow /save/
Disallow /error/
Disallow /rss/
Disallow /user/
Disallow /siteFull.html
Disallow /503.html
Disallow /redirect
Disallow /redirect/
Disallow /inspiration*
Disallow /embed*

mj12bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

nettrapport crawler

Rule Path
Disallow /

genieo

Rule Path
Disallow /

bubing

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.booli.se/sitemap/sitemap.xml
sitemap https://www.booli.se/blogg/sitemap.xml