Word2Vec: Log-Linearity, CBOW, and Skip-gram Efficiency
Master the transition from NNLMs to log-linear Word2Vec. Explore CBOW and Skip-gram complexity, hierarchical softmax, and linear semantic vector arithmetic.
Content adapted from Efficient Estimation of Word Representations in Vector Space by Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean.Original Source