bnnbloomberg.ca
robots.txt

Robots Exclusion Standard data for bnnbloomberg.ca

Resource Scan

Scan Details

Site Domain bnnbloomberg.ca
Base Domain bnnbloomberg.ca
Scan Status Ok
Last Scan2024-06-11T21:51:46+00:00
Next Scan 2024-06-18T21:51:46+00:00

Last Scan

Scanned2024-06-11T21:51:46+00:00
URL https://bnnbloomberg.ca/robots.txt
Redirect https://www.bnnbloomberg.ca/robots.txt
Redirect Domain www.bnnbloomberg.ca
Redirect Base bnnbloomberg.ca
Domain IPs 42.99.140.169, 42.99.140.170
Redirect IPs 23.49.60.111, 23.49.60.97
Response IP 23.49.60.97
Found Yes
Hash 7f79f6243b39880f73afc9218c35812bac2c1e11c43fee2463aa812293903f25
SimHash cd088a1bc771

Groups

*

Rule Path
Allow /
Disallow /404/test
Disallow /captcha/
Disallow /cmlink/
Disallow /cm/
Disallow /content/
Disallow /dapi/
Disallow /greenfield-times/
Disallow /poll/
Disallow /polopolydevelopment/
Disallow /talent/anne-gaviola-1.1461702
Disallow /talent/anita-sharma-1.1217865
Disallow /talent/kristina-partsinevelos-1.436216
Disallow /talent/catherine-murray-1.436215
Disallow /talent/jameson-berkow-1.436161
Disallow /talent/michael-hainsworth-1.436164
Disallow /anne-gaviola-1.1461702
Disallow /anita-sharma-1.1217865
Disallow /kristina-partsinevelos-1.436216
Disallow /catherine-murray-1.436215
Disallow /jameson-berkow-1.436161
Disallow /michael-hainsworth-1.436164
Disallow /404/test
Disallow /*.amp.html.amp.html
Disallow /*.amp.html.amp.html.amp.html
Disallow /*.amp.html.amp.html.amp.html.amp.html

googlebot-image

Rule Path
Allow /polopoly_fs/

twitterbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.bnnbloomberg.ca/sitemap_videos.xml
sitemap https://www.bnnbloomberg.ca/sitemap_news.xml