A practical Python Coding Guide In this guide I use a hugging face language model on the Microsoft research sentence completion challenge! This is a two part video, in this part I explain what masked language modelling is and then show you how to apply a pretrained language model to the Microsoft research sentence completion challenge and evaluate the models performance.

TUTORIAL NOTEBOOK
https://colab.research.google.com/dri...

Intro and outline: 00:00:00
What is masked language modelling? 00:04:00
Colab notebook / Inspect data: 00:06:01
Applying the language model to MRSCC: 00:11:02
Evaluating the model: 00:43:08

This series attempts to offer a casual guide to Hugging Face and Transformer models focused on implementation rather than theory. Let me know if you enjoy them! Will be doing future videos on computer vision if that is something people are interested in, let me know in the comments :)

Research material for theory
RoBERTa paper: https://arxiv.org/abs/1907.11692
HuggingFace: https://huggingface.co/
Microsoft research sentence completion challenge: https://www.microsoft.com/enus/resea...

Check out my website: https://www.rupert.digital