Secret weapon how to promote your YouTube channel
Get Free YouTube Subscribers, Views and Likes

fine tuning llama-2 to code

Follow
Chris Hay

in this video chris teaches the llama2 7B model a programming language that it doesn't know how to program through fine tuning.

at the end of this video you will learn not only how to finetune the llama2 7B model using instruction tuning with HuggingFace, PEFT, Google Colab, and 4bit quantization but you will also know how to build datasets that can teach large language models how to program any programming language, even ones it has never seen before.

In this video chris teaches llama27b the Psion OPL programming language

GoLab Notebook
https://github.com/chrishayuk/opltra...

Github Repo
https://github.com/chrishayuk/opltrain/

posted by apetitus7d