Speaker
Márton Makrai
Description
The task of predicting the next word in a sentence is called language modelling. In the early times of machine learning, this task was important for machine translation. The first talk also tells what world embeddings of shallow neural networks knew about the relations between the lexical meanings of the words. One of the main components of the deep neural language models also came from translation: a model of how words ,,attend" to each other.
