What Is A Good Perplexity?
What Is A Good Perplexity? This is why people say low perplexity is good and high perplexity is bad since the perplexity is the exponentiation of the entropy (and you can safely think of the concept of perplexity as entropy). A language model is a probability distribution over sentences. What does high perplexity mean? In