How it works
Shannon entropy is computed as H = −Σ p(x) · log₂ p(x) over the chosen symbol set (characters, words, or word bigrams).
Predictability is 1 − H/Hₘₐₓ — higher means more repetitive and easier to compress.
Compare modes: AI-generated text often shows lower word entropy and higher word-bigram repetition than human writing of similar length.