GeDi: A Powerful New Method for Controlling Language Models
How smaller language models can guide larger ones, controlling tone and topic through generative classification.
Blog
Notes and longer explanations of my work on language models.
Achieving human-level text prediction
Classic experiments on the entropy of English, and a comparison of humans and deep learning models predicting the same text.