DML stands for “Dynamical Machine Learning” (more in the book, “SYSTEMS Analytics for IoT Data Science”, 2017). This match is not surprising once you realize that DML & IoT are both based on the venerable Systems Theory. Let us dig deeper . . .

Consider IoT for industrial applications. A machine is instrumented with sensors, data are collected in real-time (or at intervals), communicated to the cloud where IoT Data Science techniques predict machine condition which results in an action, if necessary, such as repair action on the machine. This is a classic **“closed-loop” system**. The theory that abstracts and governs this closed-loop system is the subject matter of Systems Theory, an undergraduate engineering topic.

Systems Theory is broad and deep – in the past 70 or so years, a great body of work has been developed from deep theory to day-to-day applications such as GPS in your mobile phones, controlling massive chemical plants or Dreamliner airplanes. Systems Theory’s *state-space model based methods allow you to describe, estimate/predict and control all parts of a closed-loop system.*

DML is a topic in “Systems Analytics” (“SYSTEMS Analytics for IoT Data Science”, 2017). A key algorithm to implement DML is called “Rocket” Kalman algorithm developed in the book. As opposed to “static” ML (a more illuminating operational definition is “learn-once-and-use-for-ever” method!), “dynamical” ML permits continuous learning. For long term use of IoT for machinery monitoring and for rapidly changing systems, it is obvious that *dynamic* or *continuous* learning will be much more appropriate and hence more accurate, robust and reliable.

__State-space:__

In general terms, state space is the “space” in which the machine “exists”. Of course, quantitative aspects of the machine alone are captured in this “space”. It could be graphical (state-space trajectories, for example) or a list of the value of the “states” for each time interval.

Closed-loop system’s evolution over time is fully captured in these diagrams. While the visual representation by itself can be revealing (in some cases), we use the “state” equations in which these values are embedded as parameters for quantitative operations such as estimation and prediction. Since data associated with systems such as machine vibration or temperature are generally random, statistical methods are employed to obtain useful predictions such as, “Where is the State trajectory going next?”. *This is the right system-theoretic question to ask of your machine’s future condition!*

Here is a picture of “Rocket” Kalman for DML.

State Space Model:

** s[**n] =

y[n] = ** H**[n]

** s**[n] in the equations are the “States” that we have been discussing. As you can see, if we knew the States,

In summary, the “Rocket” Kalman block diagram is a general “**Digital Twin**” of our machine and the values of the States fully quantify a *specific* machine – ‘Digital Twin of Machine serial number: xxx’.

__DML for IoT Machine Learning:__

From the foregoing discussion, you got a glimpse of the basis for the assertion, “DML & IoT are based on Systems Theory”. A less technical discussion follows.

If we took a still picture of an athlete competing in a hurdles race, the picture of the runner will be fuzzy due to her movement. One the other hand, if we had a video camera, we can record the race faithfully. The current “static” machine learning (which I call “Loue” for Learn Once & Use for Ever!) is akin to the still camera picture and DML is like a video!

It is also notable that each video *frame* will have captured the runner in action at a particular instant faithfully (because of the frequent “updates” of the picture) without the fuzziness! This is a window into how to use DML for cases where “static” ML may suffice from an application/business value point of view. Observe that the video frame picture is NOT fuzzy but the still camera picture is; the “clarity” provided by the video frame will give us better results when DML is used for “LOUE” applications instead of Static ML.

*What does this mean in practice?*

In “ML speak”, DML is used for “learning” from the Training Set. *NOTE that DML is the canonical solution for CONTINUOUS machine learning; “Rocket” Kalman is an algorithm to realize DML*. What is learned is the State “evolution” – a “video” of States in the first picture – what we call a “Digital Twin Video”.

For each Feature Vector in the TEST Set, we find the corresponding “video frame” or the “vector of State values” (using some similarity measure) that will provide the best estimate of the ML output. The theory described in my book, “SYSTEMS Analytics for IoT Data Science”, shows that this **output is the OPTIMAL estimate in the Bayesian sense. This is the best we can do!**

*DML is a powerful framework based on Systems Theory which also underpins IoT closed-loop systems. “Rocket” Kalman is just one example of an algorithm, but optimal in the Bayesian sense. “Systems” thinking and new algorithms can be built up on this DML framework for diverse IoT applications.*

*PG Madhavan, Ph.D. - “LEADER . . . of a life in pursuit of excellence . . . in IoT Data Science”*

https://www.linkedin.com/in/pgmad

© 2019 Data Science Central ® Powered by

Badges | Report an Issue | Privacy Policy | Terms of Service

**Most Popular Content on DSC**

To not miss this type of content in the future, subscribe to our newsletter.

**Technical**

- Free Books and Resources for DSC Members
- Learn Machine Learning Coding Basics in a weekend
- New Machine Learning Cheat Sheet | Old one
- Advanced Machine Learning with Basic Excel
- 12 Algorithms Every Data Scientist Should Know
- Hitchhiker's Guide to Data Science, Machine Learning, R, Python
- Visualizations: Comparing Tableau, SPSS, R, Excel, Matlab, JS, Pyth...
- How to Automatically Determine the Number of Clusters in your Data
- New Perspectives on Statistical Distributions and Deep Learning
- Fascinating New Results in the Theory of Randomness
- Long-range Correlations in Time Series: Modeling, Testing, Case Study
- Fast Combinatorial Feature Selection with New Definition of Predict...
- 10 types of regressions. Which one to use?
- 40 Techniques Used by Data Scientists
- 15 Deep Learning Tutorials
- R: a survival guide to data science with R

**Non Technical**

- Advanced Analytic Platforms - Incumbents Fall - Challengers Rise
- Difference between ML, Data Science, AI, Deep Learning, and Statistics
- How to Become a Data Scientist - On your own
- 16 analytic disciplines compared to data science
- Six categories of Data Scientists
- 21 data science systems used by Amazon to operate its business
- 24 Uses of Statistical Modeling
- 33 unusual problems that can be solved with data science
- 22 Differences Between Junior and Senior Data Scientists
- Why You Should be a Data Science Generalist - and How to Become One
- Becoming a Billionaire Data Scientist vs Struggling to Get a $100k Job
- Why do people with no experience want to become data scientists?

**Articles from top bloggers**

- Kirk Borne | Stephanie Glen | Vincent Granville
- Ajit Jaokar | Ronald van Loon | Bernard Marr
- Steve Miller | Bill Schmarzo | Bill Vorhies

**Other popular resources**

- Comprehensive Repository of Data Science and ML Resources
- Statistical Concepts Explained in Simple English
- Machine Learning Concepts Explained in One Picture
- 100 Data Science Interview Questions and Answers
- Cheat Sheets | Curated Articles | Search | Jobs | Courses
- Post a Blog | Forum Questions | Books | Salaries | News

**Archives**: 2008-2014 | 2015-2016 | 2017-2019 | Book 1 | Book 2 | More

**Most popular articles**

- Free Book and Resources for DSC Members
- New Perspectives on Statistical Distributions and Deep Learning
- Time series, Growth Modeling and Data Science Wizardy
- Statistical Concepts Explained in Simple English
- Machine Learning Concepts Explained in One Picture
- Comprehensive Repository of Data Science and ML Resources
- Advanced Machine Learning with Basic Excel
- Difference between ML, Data Science, AI, Deep Learning, and Statistics
- Selected Business Analytics, Data Science and ML articles
- How to Automatically Determine the Number of Clusters in your Data
- Fascinating New Results in the Theory of Randomness
- Hire a Data Scientist | Search DSC | Find a Job
- Post a Blog | Forum Questions

## You need to be a member of Data Science Central to add comments!

Join Data Science Central