A degenerate distribution is when all the probability of some event happening is put into one single outcome. For example, if a coin was flipped and the probability of it landing heads was 100%, that would be a degenerate distribution because all the probability is put into the one outcome: heads.