Model 🔬 Explainability with David Guedalia (CTO @ Blue dot)
It’s hard to overestimate the importance of understanding how your ML model thinks and acts. Being able to explain its results is that important.
You can find those topics a little too philosophical, but when it comes to customer support and company revenue, you’ll definitely want to have those answers.
In this issue, we focus on Data Explainability as a tool to identify semantic confusion in Data Samples. And thus to have an educated decision on pushing for the model accuracy.
Our expert today is David Guedalia, currently Blue Dot’s CTO with more than 20 years of experience in ML, NLP, and Big Data, focused on unsupervised learning. So when someone like David says “…today our models are so complex that starting at the output and looking at the big picture helps us understand those models and prevent overfitting…” you want to dig deeper and understand how those tools can impact your product and business results.
Without further ado, hope you will get as many practical insights from this interview as we did.
Two reasons why Data Scientists should care 👂👁 about ML model explainability
First, People in Customer Support need to know why our model fails. Their relationships with customers depend on it. Just quoting the probability percentages won’t help support professionals.
Second, explainability can help us improve model performance. To be able to push the accuracy up, we need to understand how the machine thinks. To do that, we look at a semantic map. And we can get a better idea of why the model did what it did.
Understanding inaccuracies of the ML model with the help of the 🗺 semantic map
One of the ways to identify inaccuracies the ML model produces is to capture all data in a semantic tree and look at the hierarchy of information we get.
The goal of mapping is to help highlight semantic confusion between Data Samples. During the talk, David provided an example of such confusion and how Data Visualization helps Data scientists to increase the model accuracy.