Topic 3 The Breakthrough Cbow And Skip Gram Archit Guided Practice
Analyze the Mikolov et al. pivot to log-linear models. Calculate training complexity, simulate compute-optimal scaling, and solve vector analogy tasks.
Content adapted from Efficient Estimation of Word Representations in Vector Space by Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean.Original Source