ELI5: Explain Like I'm 5

Information gain in decision trees

Decision trees are a type of computer program that helps us figure out what choice to make. These trees are made up of different nodes and branches. Information gain is a measure used to decide which branch should be added in a decision tree. It measures how much more useful information an extra branch provides. For example, if you wanted to guess which animal someone was thinking of, a decision tree might help. You could start with the question "Does it live on land?" and then add two branches for "yes" and "no". This extra branch gives us useful information and increases our chances of guessing the correct animal. Information gain measures how much more useful information each extra branch adds. Higher information gain would mean adding a certain branch is more useful and should be used.