A practical Python Coding Guide In this guide I use a hugging face language model on the Microsoft research sentence completion challenge! In this episode (part 2) I show you how to quickly retrain a masked language model to increase the performance on a given dataset.

TUTORIAL NOTEBOOK
https://colab.research.google.com/dri...
remember to copy the notebook to your own drive before you use it!

Intro and outline: 00:00:00
Loading dataset 00:01:30
Hugging Face Dataset: 00:03:55
Hugging face model and training: 00:23:36
Evaluating the model: 00:29:48

This series attempts to offer a casual guide to Hugging Face and Transformer models focused on implementation rather than theory. Let me know if you enjoy them! Will be doing future videos on computer vision if that is something people are interested in, let me know in the comments :)

Research material for theory
RoBERTa paper: https://arxiv.org/abs/1907.11692
HuggingFace: https://huggingface.co/
Microsoft research sentence completion challenge: https://www.microsoft.com/enus/resea...

Check out my website: https://www.rupert.digital