Posts

Showing posts with the label Information Theory

Generative Models

Image
Disclaimer: These are just notes I'll use for references for future projects, or if any is interested to see my notes on Generative Models What is a generative model? A gen erative model, is a model for randomly generated data, aka observable data. When given some hidden parameters, it can create a probability distribution over observation and label sequences, Some cases a distribution can be created from a generative model through Baye's rule. Baye's rule   In probability theory and statistics,  Bayes '  theorem (alternatively  Bayes ' law or  Bayes '  rule ) describes the probability of an event, based on prior knowledge of conditions that might be related to the event.   Source:  https://en.wikipedia.org/wiki/Bayes%27_theorem There are a few types of Generative models (Source:  https://en.wikipedia.org/wiki/Generative_model ) Gaussian mixture model  and other types of  mixture model Hidden Markov model P...