Subscribe to DSC Newsletter

Robert R. Tucci's Blog (26)

No Causation without representation!

My free book Bayesuvius now has 39 chapters. I had been postponing writing the chapters on Pearl causality until now, because I consider them to be the most important chapters in the whole book, and I wanted to nail them, to the best of my limited abilities. Well, I finally bit the bullet and wrote them. Please check them out, and send me feedback. I would especially like your opinion on  the chapters…


Added by Robert R. Tucci on October 9, 2020 at 9:00am — No Comments

Belief Propagation (Message Passing) for Classical and Quantum Bayesian Networks

My FREE book about Bayesian Networks, Bayesuvius, continues to grow. It currently has 33 chapters. The purpose of this blog post is to announce the release of a new Bayesuvius chapter on Belief Propagation (BP).

Belief Propagation (BP) (aka Message Passing)was first proposed in 1982 by Judea Pearl to simplify the exact evaluation of probability marginals of…


Added by Robert R. Tucci on September 1, 2020 at 10:30am — No Comments

Decision Trees & Bayesian Networks


Decision Trees (DTs) are certainly cool and it is not my intention to belittle them here. Compared to Bayesian Networks (bnets), they seem easier to construct. In fact, I just wrote a poem dedicated to Decision Trees. It starts "I think that I shall never see an AI as lovely as a decision tree". DTs do have some drawbacks, but, like I said, the purpose of this blog post is not to criticize them.

The real purpose of this post is to point out that there is a secret…


Added by Robert R. Tucci on August 16, 2020 at 6:30am — No Comments

How complicated projects like building a skyscraper or a rocket or a bridge manage so many details?


It's a question I often wondered about as a child, as I marveled at NYC skyscrapers during my first visit there, or when I visited Cape Canaveral or the Golden Gate Bridge. I don't claim I will provide a full answer to this question in this short post. However, recently, I've been studying two types of tools that are very useful in handling the mindbogglingly numerous details of a complicated project. And I would like to tell you about those 2 tools here. So this is going to…


Added by Robert R. Tucci on August 15, 2020 at 9:30am — No Comments

Causal Reinforcement Learning under Bareinboim at Columbia Univ.

Elias Bareinboim

I recently wrote a popular article on Causal AI. Note that Causal AI is almost exclusively the province of Bayesian networks (bnets), not of their more puny brethren, neural networks (NNs). Indeed, Causal AI is based on Judea Pearl's theory of causality which is expressed via bnets, not NNs.

Something that I didn't mention in my…


Added by Robert R. Tucci on August 7, 2020 at 3:00am — No Comments

Prion Computer Viruses For China, With Love

Check out: When China Sees All, Chinese AI Is Creating an Axis of Autocracy, by Ross Andersen (The Atlantic, Sept 2020 print edition) And…


Added by Robert R. Tucci on July 31, 2020 at 1:06pm — No Comments

Quantum Neural Net, an Oxymoron


Venn diagram showing overlap between "quantum" and "neural network"

The term "quantum neural networks" is being used with increasing frequency by the quantum computing community. Maybe as a dishonest, bait-and-switch advertising strategy, this makes sense. However, from a scientific standpoint, "quantum neural network" is a very poor name choice for what is being alluded to here.

Artificial Neural Networks, often called "Neural Nets" for short, are supposed to…


Added by Robert R. Tucci on July 15, 2020 at 4:30am — No Comments

Simpson’s Paradox, the Bane of Clinical Trials

(This article is now a chapter of my github proto-book Bayesuvius)

Simpson's paradox is a recurring nightmare for all statisticians overseeing a clinical trial for a medicine. It is possible that if they leave out a certain "confounding" variable from a study, the study's conclusion on whether a medicine is effective or not, might be, without measuring that confounding variable, the opposite of what it would have been had that variable been measured. Statisticians have to enlist expert…


Added by Robert R. Tucci on July 9, 2020 at 7:00pm — No Comments

Added Chapter on Reinforcement Learning to my book “Bayesuvius” on Bayesian Networks

I just uploaded a new chapter to my github proto-book "Bayesuvius". This chapter deals with Reinforcement Learning (RL) done right, i.e., with Bayesian Networks :)

My chapter is heavily based on the excellent course notes for CS 285 taught at UC Berkeley by Prof. Sergey Levine. All I did was to translate some of those lectures into B net lingo.

During a recent conversation that I had on LinkedIn with some very smart Machine Learning experts, the experts opined that the fields…


Added by Robert R. Tucci on July 7, 2020 at 12:00pm — No Comments

QC Paulinesia, !(yet another book about quantum computing)

Today I uploaded to github the first version of my book “QC Paulinesia” about Quantum Computing. The title is a play on the surname of the famous quantum scientist Wolfgang Pauli and the word "Polynesia". The book is based on a paper with the same name that I wrote in 2004. 

Here is  its github repo. Here is the pdf for the book. Let me quote the current…


Added by Robert R. Tucci on June 27, 2020 at 1:00pm — No Comments

Generative Adversarial Networks (GANs) & Bayesian Networks

Generative Adversarial Networks (GANs) software is software for producing forgeries and imitations of data (aka synthetic data, fake data). Human beings have been making fakes, with good or evil intent, of almost everything they possibly can, since the beginning of the human race. Thus, perhaps not too surprisingly, GAN software has been widely used since it was first proposed in this amazingly recent 2014 paper. To gauge how widely GAN software has been used so far, see, for example, this…


Added by Robert R. Tucci on June 24, 2020 at 11:30pm — No Comments

Today I uploaded to github the first version of my book "Bayesuvius" about Bayesian Networks

vesuvius-from-pompei View of Mount Vesuvius form Pompeii

In the last week, I started a new book on classical (not quantum) Bayesian Networks. Today, I uploaded the first installment to github. Here is its github repo. Here is the pdf for the book. Let me quote the current…


Added by Robert R. Tucci on June 23, 2020 at 7:12pm — No Comments

Causal AI & Bayesian Networks

Bullet ripping through Jack of Hearts. High speed photo by MIT's Harold (Doc) Edgerton.

Artist Harry Clarke's 1919 illustration for "A Descent into the Maelström"


We are all familiar with the dictum that "correlation does not imply causation". Furthermore, given a data file with samples of two variables…


Added by Robert R. Tucci on June 10, 2020 at 5:00pm — No Comments

Information Theory (Turbo Codes) & Bayesian Networks

An error correcting code (ECC) is a way of controlling errors in data that is being transmitted over an unreliable or noisy communication channel. In an ECC, the sender encodes the message with redundant information. The receiver is able to detect a limited number of errors, and to correct these errors without retransmission.

Turbo codes are a class of ECC that approach very closely the theoretical…


Added by Robert R. Tucci on June 4, 2020 at 4:04pm — No Comments

Quantum Bayesian Network view of hybrid quantum-classical computation


Hybrid Quantum-Classical Computing (HQCC) (a.k.a. Variational Quantum Eigensolver (VQE)) is often touted as one of the main algorithms of Quantum AI. In fact, Rigetti, a Silicon Valley company which for several years has provided cloud access to their superconductive quantum computer, has designed its services around the HQCC paradigm.

In this brief blog post, I will explain how HQCC can be understood in terms of quantum Bayesian networks. In the process, I will…


Added by Robert R. Tucci on May 20, 2020 at 3:06pm — No Comments

IBM's new quantum computer finally achieves a quantum advantage

The online conference, IBM Think 2020, was held in May 5-6 2020. During that conference, Dario Gil, IBM Research Director, was visibly, almost orgasmically, excited with his new toy, an IBM quantum computer.

The IBM quantum computer already gives a clear quantum advantage to all IBM partners, as long as they rent the version that is mounted on…


Added by Robert R. Tucci on May 7, 2020 at 9:22am — No Comments

Proxy Quantum Clouds and the JupyterHub

About 4 months ago, I wrote for this blog an article entitled "List of Quantum Clouds". In that article, I listed 17 "quantum clouds". By now, there are probably a few more. The "HWB" (hardware backed) quantum clouds of Dwave, Rigetti and IBM, offer access to already existing, on-line qc hardware. I'll call all the other quantum clouds "proxy" quantum…


Added by Robert R. Tucci on April 10, 2020 at 10:30pm — No Comments

Rigett's New Quantum Optimized Compiler

Check out the following paper unveiled last night in ArXiv:

An Open-Source, Industrial-Strength Optimizing Compiler for Quantum Programs, by Robert S. Smith, Eric C. Peterson, Mark G. Skilbeck, Erik J. Davis.

This is an exciting development for me since I have been a proponent and practitioner of the art of quantum compilers for a long time.

The new "optimized quantum compiler" by Rigetti is a computer program that tackles the problem of…


Added by Robert R. Tucci on April 1, 2020 at 5:30pm — No Comments

Google Releases TensorFlow Quantum

Today, Google published the following paper:

TensorFlow Quantum: A Software Framework for Quantum Machine Learning, 

TensorFlow Quantum is software for doing Quantum Bayesian Networks. QB nets have been a dream of mine for 24 years, although Google's paper, despite having 20 authors and 129 references, never cites any of my work. When I first had the idea of Quantum Bayesian Networks, I thought it was such a cool idea that, within a span of a year, I published…


Added by Robert R. Tucci on March 8, 2020 at 10:30pm — 1 Comment

Quantum Computing + Bayesian Networks = Future AI

Burma Shave ads in the service of Data Science

Added by Robert R. Tucci on February 13, 2020 at 10:59pm — No Comments


  • Add Videos
  • View All

© 2020   TechTarget, Inc.   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service