Interpretability

Interpretability means understanding why a decision was made. Think of it this way: you have someone who can do lots of math. They can solve lots of equations and use math to figure out the best solution to a problem. However, if you can't understand how they arrived at that answer, you won't be able to keep them accountable or even follow what they're doing. So, interpretability is important to make sure that we can make decisions that we understand how and why they were made.