System Design for SDE2 and above: https://arpitbhayani.me/masterclass
System Design for Beginners: https://arpitbhayani.me/sysdesign
Redis Internals: https://arpitbhayani.me/redis
Build Your Own Redis / DNS / BitTorrent / SQLite with CodeCrafters.
Sign up and get 40% off https://app.codecrafters.io/join?via=...
In the video, I discussed the importance of maintaining search at scale using Elasticsearch at Twitter. Twitter built tooling around Elasticsearch to handle surges in search traffic, realtime ingestion, and backfill. The course on system design focuses on building intuition and covers realworld system design scenarios. Twitter's tooling includes an Elasticsearch proxy for standardization and a backfill service for staggered data ingestion. By deferring rights and ensuring synchronous reads, Twitter maintains stability and scalability in its Elasticsearch clusters.
Recommended videos and playlists
If you liked this video, you will find the following videos and playlists helpful
System Design: • PostgreSQL connection management and ...
Designing Microservices: • Advantages of adopting a microservice...
Database Engineering: • How nested loop, hash, and merge join...
Concurrency Indepth: • How to write efficient and fair multi...
Research paper dissections: • The Google File System Paper Explained
Outage Dissections: • Dissecting GitHub Outage and things t...
Hash Table Internals: • Internal Structure of a Hash Table
Bittorrent Internals: • Introduction to BitTorrent and the pr...
Things you will find amusing
Knowledge Base: https://arpitbhayani.me/knowledgebase
Bookshelf: https://arpitbhayani.me/bookshelf
Papershelf: https://arpitbhayani.me/papershelf
Other socials
I keep writing and sharing my practical experience and learnings every day, so if you resonate then follow along. I keep it no fluff.
LinkedIn: / arpitbhayani
Twitter: / arpit_bhayani
Weekly Newsletter: https://arpit.substack.com
Thank you for watching and supporting! it means a ton.
I am on a mission to bring out the best engineering stories from around the world and make you all fall in
love with engineering. If you resonate with this then follow along, I always keep it nofluff.