Machine Learning (ML) models are increasingly being used to augment human decision making process in domains such as finance, telecommunication, healthcare, and others. In most of the cases, users do not understand how these models make predictions. The lack of understanding makes it difficult for policy makers to justify their decisions. Most of the ML models are black boxes that do not explain on its own why it reached a specific recommendation or a decision. This forces the users to say…