Lectures on Modern Scientific Programing 2024

Session

Lectures

20 Nov 2024, 08:40

Building 3, 2nd floor, Council Room (HUN-REN Wigner RCP )

1. Openning

Gergely Barnafoldi (Wigner RCP RMI of the Hungarian Academy of Sciences)

20/11/2024, 08:40

14. Introduction to Language Modeling

Márton Makrai

20/11/2024, 09:00

The task of predicting the next word in a sentence is called language modelling. In the early times of machine learning, this task was important for machine translation. The first talk also tells what world embeddings of shallow neural networks knew about the relations between the lexical meanings of the words. One of the main components of the deep neural language models also came from...

15. LLM Applications

Dávid Nemeskey, Natabara Máté Gyöngyössy (ELTE Eötvös Loránd University)

20/11/2024, 11:00

A high-level review of the current state of adapting LLMs: fine tuning, prompting, RAG. Including a practical overview of LLM parameters (such as size, limitations, most widespread parametrization, etc).