in this video chris teaches the llama2 7B model a programming language that it doesn't know how to program through fine tuning.
at the end of this video you will learn not only how to finetune the llama2 7B model using instruction tuning with HuggingFace, PEFT, Google Colab, and 4bit quantization but you will also know how to build datasets that can teach large language models how to program any programming language, even ones it has never seen before.
In this video chris teaches llama27b the Psion OPL programming language
GoLab Notebook
https://github.com/chrishayuk/opltra...
Github Repo
https://github.com/chrishayuk/opltrain/