In this video, I discuss 3 methods to work with tables of billion rows. This discussion is inspired by a comment on my YouTube video on Twitter System Design right here    • Twitter System Design  Building the ...  

Chapters
Intro 0:00
1. Brute Force Distributed Processing 2:30
2. Working with a Subset of table 3:35
2.1 Indexing 3:55
2.2 Partitioning 5:30
2.3 Sharding 7:30
3. Avoid it all together (reshuffle the whole design) 9:10
Summary 11:30


Listen to the Backend Engineering Podcast
https://husseinnasser.com/podcast

Backend Engineering Videos
   • Backend Engineering (Beginner)  

Database Engineering Videos
   • Database Engineering  

Load Balancing and Proxies Videos
   • Proxies  

Software Archtiecture Videos
   • Software Architecture  

Messaging Systems
   • Message Queues & PubSub Systems  

Become a Member
   / @hnasr  

Support me on PayPal
https://bit.ly/33ENps4

Stay Awesome,
Hussein