Comment

Comment by kwrobel

I agree. Perplexities (probability of a text) can be compared using different tokenization after normalization.
parent kwrobel 7 years ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton