Being a professional programmer is all about learning new things and keeping up with the changes in technology. Periodically, you have to stop and look around and decide what to learn next.

I've been through a dozen or so phases of my career so far, and at present, I've decided to learn more about PyTorch and LLMs. In this video, I'll explain why, what resources I'm using, how having a coding LLM copilot changes the process, how advice I got decades ago makes working with Github CoPilot much more efficient, and thoughts on the future of programming languages.

Also some thoughts on how web searching is changing for me (much to the better), how that's impacting my thinking on AI (with help from Steve Jobs) and initial impressions of ChatGPT4o.

00:00 Introduction
02:36 Various tech I've used (much abandoned)
06:22 How I've decided what to study
07:07 Recommendations here not for working on existing codebases
07:41 Advice I got on being interruptible vs "In the Zone"
10:04 "Literate Programming" is a more formal way of doing it
10:45 Literate Programming technique is perfect for working with CoPilot
11:16 Clarification this is NOT sponsored just stuff I really use
11:42 Pros and Cons of using CoPilot/LLM/AI to help you code
14:32 Choice of Programming languages (or lack thereof)
16:32 Programming Languages are tools don't get attached
16:57 Soon, I expect languages to matter much less
17:56 Resources I'm using to learn PyTorch/LLMs
18:49 How I recommend learning a new language/framework
21:09 My current side project (if you care)
22:28 Coursera course on Machine Learning
22:33 YouTube Channels I'm learning a lot from:
22:43 ‪@3blue1brown‬
22:58 ‪@AndrejKarpathy‬
23:14 ‪@borismeinardus‬
23:46 ‪@ArtemKirsanov‬
24:06 ‪@MachineLearningStreetTalk‬
24:34 ‪@Computerphile‬ and ‪@davidbombal‬ (for Dr Mike Pound)
24:55 New Web "Search" with perplexity.ai (not sponsored I just like it)
25:34 Changing my mindset on Search Agents vs Search Engines
26:17 First impressions of ChatGPT4o
26:26 ChatGPT4o vs Perplexity.ai
26:36 ChatGPT4o multimodal (disappointing, but at least it's fast)
27:45 Wrap up


Links to resources from video:

interruptible programmer
https://www.stevestreeting.com/2010/0...

Literate Programming
https://thenewstack.io/whyliteratep...
https://blog.bitsrc.io/literateprogr...
http://web.stanford.edu/group/cslipub...
https://programminghistorian.org/en/l...

Sprint Internet Project I was on (If you're curious)
https://archive.org/details/SprintInt...
https://www.adweek.com/brandmarketin...
https://corporate.findlaw.com/contrac...

Coursera course I'm taking
https://www.coursera.org/specializati...

Youtuber resources
3Blue1Brown Neural Nets
   • Neural networks  

Great channels with learning about LLMs/AI content:
   / @andrejkarpathy  
   / @borismeinardus  
   / @artemkirsanov  
   • Dendrites: Why Biological Neurons Are...  
Comment on my channel where I learned about Artem Kirsanov:
   • How Developers might stop worrying ab...  

Machine Learning Street Talk interview with Deep Learning Expert:
   • This is why Deep Learning is really w...  
Comment on my channel where I learned about this Machine Learning Street Talk video:
   • 5 new Software Engineer Jobs that "AI...  

Videos from Dr Mike Pound on two different channels he frequents
   • Has Generative AI Already Peaked?  C...  
   • You need to learn AI in 2024! (And he...  

Search tool I've been using lately (not sponsored):
https://www.perplexity.ai/

Source for Steve Jobs Quote
   • Steve Jobs Talk IDCA in 1983