EmbeddingGraph EmbeddingMulti-layer Perceptron (MLP) pain points for NLPTruncated Backpropagation through timeRecurrent Neural Networks (RNN)Training
... [Show More]
Vanilla RNN's difficulties
Long Short-Term Memory Network Gates and States
Perplexity(s)
Language Model Goal
Masked Language Modeling
Knowledge Distillation to Reduce Model Sizes
Collobert and Weston Vector Idea
Word2vec Overview
Word2vec Variants
Word2vec Objective Function
Word2vec P( w(t+j) | w(t) )
Word2vec Expensive to Compute Solutions
Negative Sampling Intuition
Evaluating Word Embeddings Intrinsic
Evaluating Word Embeddings Extrinsic
Why Graph Embeddings
Graph Embeddings
[Show Less]