My free book Bayesuvius now has 39 chapters. I had been postponing writing the chapters on Pearl causality until now, because I consider them to be the most important chapters in the whole book, and I wanted to nail them, to the best of my limited abilities. Well, I finally bit the bullet and wrote them. Please check them out, and send me feedback. I would especially like your opinion on the chapters…Continue
Added by Robert R. Tucci on October 9, 2020 at 9:00am — No Comments
My FREE book about Bayesian Networks, Bayesuvius, continues to grow. It currently has 33 chapters. The purpose of this blog post is to announce the release of a new Bayesuvius chapter on Belief Propagation (BP).
Belief Propagation (BP) (aka Message Passing)was first proposed in 1982 by Judea Pearl to simplify the exact evaluation of probability marginals of…Continue
Added by Robert R. Tucci on September 1, 2020 at 10:30am — No Comments
Decision Trees (DTs) are certainly cool and it is not my intention to belittle them here. Compared to Bayesian Networks (bnets), they seem easier to construct. In fact, I just wrote a poem dedicated to Decision Trees. It starts "I think that I shall never see an AI as lovely as a decision tree". DTs do have some drawbacks, but, like I said, the purpose of this blog post is not to criticize them.
The real purpose of this post is to point out that there is a secret…Continue
Added by Robert R. Tucci on August 16, 2020 at 6:30am — No Comments
It's a question I often wondered about as a child, as I marveled at NYC skyscrapers during my first visit there, or when I visited Cape Canaveral or the Golden Gate Bridge. I don't claim I will provide a full answer to this question in this short post. However, recently, I've been studying two types of tools that are very useful in handling the mindbogglingly numerous details of a complicated project. And I would like to tell you about those 2 tools here. So this is going to…
Added by Robert R. Tucci on August 15, 2020 at 9:30am — No Comments
I recently wrote a popular article on Causal AI. Note that Causal AI is almost exclusively the province of Bayesian networks (bnets), not of their more puny brethren, neural networks (NNs). Indeed, Causal AI is based on Judea Pearl's theory of causality which is expressed via bnets, not NNs.
Something that I didn't mention in my…Continue
Added by Robert R. Tucci on August 7, 2020 at 3:00am — No Comments
Check out: When China Sees All, Chinese AI Is Creating an Axis of Autocracy, by Ross Andersen (The Atlantic, Sept 2020 print edition) And…
Added by Robert R. Tucci on July 31, 2020 at 1:06pm — No Comments
Venn diagram showing overlap between "quantum" and "neural network"
The term "quantum neural networks" is being used with increasing frequency by the quantum computing community. Maybe as a dishonest, bait-and-switch advertising strategy, this makes sense. However, from a scientific standpoint, "quantum neural network" is a very poor name choice for what is being alluded to here.
Artificial Neural Networks, often called "Neural Nets" for short, are supposed to…Continue
Added by Robert R. Tucci on July 15, 2020 at 4:30am — No Comments
(This article is now a chapter of my github proto-book Bayesuvius)
Simpson's paradox is a recurring nightmare for all statisticians overseeing a clinical trial for a medicine. It is possible that if they leave out a certain "confounding" variable from a study, the study's conclusion on whether a medicine is effective or not, might be, without measuring that confounding variable, the opposite of what it would have been had that variable been measured. Statisticians have to enlist expert…
Added by Robert R. Tucci on July 9, 2020 at 7:00pm — No Comments
I just uploaded a new chapter to my github proto-book "Bayesuvius". This chapter deals with Reinforcement Learning (RL) done right, i.e., with Bayesian Networks :)
My chapter is heavily based on the excellent course notes for CS 285 taught at UC Berkeley by Prof. Sergey Levine. All I did was to translate some of those lectures into B net lingo.
During a recent conversation that I had on LinkedIn with some very smart Machine Learning experts, the experts opined that the fields…Continue
Added by Robert R. Tucci on July 7, 2020 at 12:00pm — No Comments
Today I uploaded to github the first version of my book “QC Paulinesia” about Quantum Computing. The title is a play on the surname of the famous quantum scientist Wolfgang Pauli and the word "Polynesia". The book is based on a paper with the same name that I wrote in 2004.Continue
Added by Robert R. Tucci on June 27, 2020 at 1:00pm — No Comments
Generative Adversarial Networks (GANs) software is software for producing forgeries and imitations of data (aka synthetic data, fake data). Human beings have been making fakes, with good or evil intent, of almost everything they possibly can, since the beginning of the human race. Thus, perhaps not too surprisingly, GAN software has been widely used since it was first proposed in this amazingly recent 2014 paper. To gauge how widely GAN software has been used so far, see, for example, this…Continue
Added by Robert R. Tucci on June 24, 2020 at 11:30pm — No Comments
View of Mount Vesuvius form Pompeii
In the last week, I started a new book on classical (not quantum) Bayesian Networks. Today, I uploaded the first installment to github. Here is its github repo. Here is the pdf for the book. Let me quote the current…Continue
Added by Robert R. Tucci on June 23, 2020 at 7:12pm — No Comments
Bullet ripping through Jack of Hearts. High speed photo by MIT's Harold (Doc) Edgerton.
Artist Harry Clarke's 1919 illustration for "A Descent into the Maelström"
We are all familiar with the dictum that "correlation does not imply causation". Furthermore, given a data file with samples of two variables…
Added by Robert R. Tucci on June 10, 2020 at 5:00pm — No Comments
An error correcting code (ECC) is a way of controlling errors in data that is being transmitted over an unreliable or noisy communication channel. In an ECC, the sender encodes the message with redundant information. The receiver is able to detect a limited number of errors, and to correct these errors without retransmission.
Turbo codes are a class of ECC that approach very closely the theoretical…Continue
Added by Robert R. Tucci on June 4, 2020 at 4:04pm — No Comments
In this brief blog post, I will explain how HQCC can be understood in terms of quantum Bayesian networks. In the process, I will…Continue
Added by Robert R. Tucci on May 20, 2020 at 3:06pm — No Comments
The online conference, IBM Think 2020, was held in May 5-6 2020. During that conference, Dario Gil, IBM Research Director, was visibly, almost orgasmically, excited with his new toy, an IBM quantum computer.
The IBM quantum computer already gives a clear quantum advantage to all IBM partners, as long as they rent the version that is mounted on…Continue
Added by Robert R. Tucci on May 7, 2020 at 9:22am — No Comments
About 4 months ago, I wrote for this blog an article entitled "List of Quantum Clouds". In that article, I listed 17 "quantum clouds". By now, there are probably a few more. The "HWB" (hardware backed) quantum clouds of Dwave, Rigetti and IBM, offer access to already existing, on-line qc hardware. I'll call all the other quantum clouds "proxy" quantum…Continue
Added by Robert R. Tucci on April 10, 2020 at 10:30pm — No Comments
Check out the following paper unveiled last night in ArXiv:
An Open-Source, Industrial-Strength Optimizing Compiler for Quantum Programs, by Robert S. Smith, Eric C. Peterson, Mark G. Skilbeck, Erik J. Davis.
This is an exciting development for me since I have been a proponent and practitioner of the art of quantum compilers for a long time.
The new "optimized quantum compiler" by Rigetti is a computer program that tackles the problem of…Continue
Added by Robert R. Tucci on April 1, 2020 at 5:30pm — No Comments
Today, Google published the following paper:
TensorFlow Quantum: A Software Framework for Quantum Machine Learning,
TensorFlow Quantum is software for doing Quantum Bayesian Networks. QB nets have been a dream of mine for 24 years, although Google's paper, despite having 20 authors and 129 references, never cites any of my work. When I first had the idea of Quantum Bayesian Networks, I thought it was such a cool idea that, within a span of a year, I published…Continue
Burma Shave ads in the service of Data Science
Added by Robert R. Tucci on February 13, 2020 at 10:59pm — No Comments