bnnbloomberg.ca
robots.txt

Robots Exclusion Standard data for bnnbloomberg.ca

Resource Scan

Scan Details

Site Domain bnnbloomberg.ca
Base Domain bnnbloomberg.ca
Scan Status Ok
Last Scan2024-10-30T19:10:10+00:00
Next Scan 2024-11-06T19:10:10+00:00

Last Scan

Scanned2024-10-30T19:10:10+00:00
URL https://bnnbloomberg.ca/robots.txt
Redirect https://www.bnnbloomberg.ca:443/robots.txt
Redirect Domain www.bnnbloomberg.ca
Redirect Base bnnbloomberg.ca
Domain IPs 3.33.200.62, 75.2.120.248
Redirect IPs 184.87.193.75, 184.87.193.81, 2600:1413:b000:13::b857:c18b, 2600:1413:b000:13::b857:c18d
Response IP 23.45.207.176
Found Yes
Hash d26dde3a7a535a84ae1896df9adf787a3203c5e539457eb6ccb77340b0182fe0
SimHash cd10ca154771

Groups

*

Rule Path
Allow /
Disallow /404/test
Disallow /captcha/
Disallow /cmlink/
Disallow /cm/
Disallow /content/
Disallow /dapi/
Disallow /greenfield-times/
Disallow /poll/
Disallow /polopolydevelopment/
Disallow /talent/anne-gaviola-1.1461702
Disallow /talent/anita-sharma-1.1217865
Disallow /talent/kristina-partsinevelos-1.436216
Disallow /talent/catherine-murray-1.436215
Disallow /talent/jameson-berkow-1.436161
Disallow /talent/michael-hainsworth-1.436164
Disallow /anne-gaviola-1.1461702
Disallow /anita-sharma-1.1217865
Disallow /kristina-partsinevelos-1.436216
Disallow /catherine-murray-1.436215
Disallow /jameson-berkow-1.436161
Disallow /michael-hainsworth-1.436164
Disallow /404/test

googlebot-image

Rule Path
Allow /polopoly_fs/

twitterbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.bnnbloomberg.ca/arc/outboundfeeds/sitemap-index/
sitemap https://www.bnnbloomberg.ca/arc/outboundfeeds/sitemap-news-index/
sitemap https://www.bnnbloomberg.ca/arc/outboundfeeds/sitemap-section-index/
sitemap https://www.bnnbloomberg.ca/arc/outboundfeeds/sitemap-video/