These are a few of my notes from Eunsol Choi’s NLP class at UT Austin. Generative Models vs. Discriminative Models# --- When it comes to classification, models are broadly categorized into Generative Models and Discriminative Models. Generative Models# In generative models, we aim to model the joint distribution of the data $ p(x, y) $. These models often assume a particular functional form for both $ P(x|y) $ and $ P(y) $. To classify a new data point, we maximize:
