investing.businessweek.com
robots.txt

Robots Exclusion Standard data for investing.businessweek.com

Resource Scan

Scan Details

Site Domain investing.businessweek.com
Base Domain businessweek.com
Scan Status Ok
Last Scan2024-09-21T14:00:35+00:00
Next Scan 2024-09-28T14:00:35+00:00

Last Scan

Scanned2024-09-21T14:00:35+00:00
URL https://investing.businessweek.com/robots.txt
Redirect https://www.bloomberg.com/robots.txt
Redirect Domain www.bloomberg.com
Redirect Base bloomberg.com
Domain IPs 104.45.185.92
Redirect IPs 151.101.1.73, 151.101.129.73, 151.101.193.73, 151.101.65.73
Response IP 199.232.45.73
Found Yes
Hash b016557017ab16b7e0f7c1ce8f4725d59e693c5ad624d4399514a5a458711a11
SimHash a637133b6773

Groups

*

Rule Path
Disallow /polska
Allow /account/newsletters
Disallow /account/*
Disallow /tosv*.html
Disallow /search
Disallow /company/search/
Disallow /professional/search/
Disallow /impact/search/
Disallow /ux/search/
Disallow /wnwi/search/
Disallow /gei/search/
Disallow /impact/search/
Disallow /netzeropathfinders/search/
Disallow /notices/search/
Disallow /distribution/search/
Disallow /ukinnovators/search/
Disallow /latam/search/
Disallow /faq/search/
Disallow /tc/search/
Disallow /subscriptions/group/manage/
Disallow /preview/lineup
Disallow /preview/articles
Disallow /explore/
Disallow /press-releases/
Disallow /artemis/
Disallow /sessions-publisher/
Disallow /sessions/

google-extended

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /about/careers
Disallow /about/careers/
Disallow /offlinemessage/
Disallow /apps/fbk
Disallow /bb/newsarchive/
Disallow /apps/news

spinn3r

Rule Path
Disallow /podcasts/
Disallow /feed/podcast/
Disallow /bb/avfile/

googlebot-news

Rule Path
Disallow /sponsor/
Disallow /news/sponsors/*
Disallow /news/terminal/*

twitterbot

Rule Path
Allow /en/news/thp

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bloomberg.com/sitemap.xml
sitemap https://www.bloomberg.com/feeds/sitemap_news.xml
sitemap https://www.bloomberg.com/feeds/bbiz/sitemap_index.xml
sitemap https://www.bloomberg.com/feeds/bpol/sitemap_index.xml
sitemap https://www.bloomberg.com/feeds/businessweek/sitemap_index.xml
sitemap https://www.bloomberg.com/feeds/citylab/sitemap_index.xml
sitemap https://www.bloomberg.com/feeds/green/sitemap_index.xml
sitemap https://www.bloomberg.com/feeds/technology/sitemap_index.xml
sitemap https://www.bloomberg.com/feeds/bbiz/sitemap_securities_index.xml
sitemap https://www.bloomberg.com/feeds/bbiz/sitemap_profiles_company_index.xml
sitemap https://www.bloomberg.com/billionaires/sitemap.xml
sitemap https://www.bloomberg.com/feeds/bbiz/sitemap_news.xml
sitemap https://www.bloomberg.com/feeds/dynamic/private-company-index.xml
sitemap https://www.bloomberg.com/feeds/dynamic/person-index.xml
sitemap https://www.bloomberg.com/feeds/curated/feeds/graphics_news.xml
sitemap https://www.bloomberg.com/feeds/curated/feeds/graphics_sitemap.xml
sitemap https://www.bloomberg.com/feeds/equality/sitemap_index.xml
sitemap https://www.bloomberg.com/feeds/wealth/sitemap_index.xml
sitemap https://www.bloomberg.com/multimedia/sitemap.xml
sitemap https://www.bloomberg.com/feeds/curated/bbiz_sitemap.xml
sitemap https://www.bloomberg.com/feeds/pursuits/sitemap_index.xml
sitemap https://www.bloomberg.com/feeds/quicktake/sitemap_index.xml

Comments

  • Bot rules:
  • 1. A bot may not injure a human being or, through inaction, allow a human being to come to harm.
  • 2. A bot must obey orders given it by human beings except where such orders would conflict with the First Law.
  • 3. A bot must protect its own existence as long as such protection does not conflict with the First or Second Law.
  • If you can read this then you should apply here https://www.bloomberg.com/careers/