# Measure distribution randomness with Entropy This definition of randomness level is based on the idea that [[Entropy]] of a distribution measures how close it is to the uniform distribution which is defined as maximum randomness. One can measure the frequency of each letter in a string $s$ and compute their distribution [[Entropy]] based on the [[Law of large numbers]]. Entropy can be calculated for all bigrams, trigrams and so on of $s$. If all entropies are close to $\frac{1}{|s|}$ (the uniform entropy of string length $s$) then the string is considered random. Related: [[Normal Numbers]] Reference:[[@What is Random? Chance and Order in Mathematics and Life]] ## Created 2024-06-12 21:58