Entropy rate

Entropy rate is a measure of how quickly a message or piece of information changes from one state to another. Think of it like a game of Jenga. When you pull out a piece from the stack of blocks, the stack changes its state and the entropy rate is how quickly that change happens. The entropy rate tells us how quickly information is changing.