Cross-entropy

Cross-entropy is a way to measure how well something is working. Imagine you wanted to get from one place to another, one way to measure how well you were doing would be how close you were to the destination. Cross-entropy is like that: it measures how close you are to the goal. It is used a lot in machine learning and statistics to measure how well a model works.