Decoding NLM Complexity: NNLM and RNNLM Bottlenecks
Master the global training complexity metric. Derive NNLM and RNNLM per-token costs, identify bottlenecks, and see how Hierarchical Softmax optimizes scaling.
Content adapted from Efficient Estimation of Word Representations in Vector Space by Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean.Original Source