Skip to content
Redmoon Calculators
텍스트 분석 All languages

Text Entropy & Predictability Analyzer

무료 텍스트 엔트로피/예측 가능성 계산기. 문자 및 단어 수준의 섀넌 엔트로피, n-그램 엔트로피, 압축 비율을 계산합니다.

사용 시기

Use when you suspect a text is repetitive but can't spot why. Word entropy catches phrase-level repetition; character entropy catches alphabet-level oddities.

비교

Lexical diversity measures unique-word *count*; entropy measures unique-word *distribution*. Two texts can have identical TTR but very different entropy.

0 chars

작동 방식

Shannon entropy is computed as H = −Σ p(x) · log₂ p(x) over the chosen symbol set (characters, words, or word bigrams).

Predictability is 1 − H/Hₘₐₓ — higher means more repetitive and easier to compress.

Compare modes: AI-generated text often shows lower word entropy and higher word-bigram repetition than human writing of similar length.

공식

자주 묻는 질문

What is Shannon entropy?

A measurement of unpredictability. Higher entropy means each symbol (word or character) carries more information; lower means the text is more repetitive.

What's a typical entropy value for English?

~9–10 bits per word for typical prose; ~4 bits per character. Highly templated text falls below.

Why include n-gram and character modes?

Different views surface different patterns. Word-bigram entropy catches phrase-level repetition; character entropy catches alphabet quirks.

실제 예시

입력

The cat sat on the mat. The cat sat on the mat. The cat sat on the mat.

출력

Word entropy: 2.32 bits — Very predictable (predictability 51%).

Only 6 unique words across 18 — the same six repeated three times. Maximum possible entropy is log₂(6) ≈ 2.58 bits, so 2.32 is close to maximum-given-vocab but predictability vs uniform is low.

흔한 함정

  • Entropy values are not directly comparable across mode (word vs character vs bigram).
  • Highly templated copy (legal boilerplate) scores very predictable — by design.
  • Compression estimate is a rough proxy, not real gzip output.

관련 도구

피드백 보내기

모든 메시지를 읽습니다. 무엇을 개선하면 좋을지, 좋았던 점은 무엇인지 알려주세요.