Entropy estimation

Entropy estimation is a way of measuring how much information is in something. It's like trying to guess how complicated a system is. To figure this out, entropy estimation looks at all of the possible outcomes of a system, then tries to figure out how likely it is that each of those outcomes will happen. If there are more likely outcomes, then the system has more entropy and is more complicated. If there are fewer likely outcomes, then the system has less entropy and is simpler.