This talk gives an introduction to Large Language Models for nonspecialists, especially those who might be considering applying them to nature or climate projects. We will cover the recent history of language models and then deep dive on a modern transformerbased language model. We will look at tokenisation, training methods, preference alignment and the future trends in model architectures.

Bio:
https://toao.com/