Buy real YouTube subscribers. Best price and warranty.
Get Free YouTube Subscribers, Views and Likes

What problems will Data Engineers solve in 2024?

Follow
Pragmatic Data Scientists

In this episode, we are joined by Pushpendra, a data engineer with 15 years of experience, including time at consulting, Amazon AWS and Statsig. He discusses the progression of his career, the differences between data engineering at big tech companies and startups, the evolution of data modeling and data quality, and how culture plays a significant role in ensuring data quality. Pushpendra also highlights the importance of understanding business requirements when making technology choices and the balancing act between data volume and business complexity. He also gives insights into businessspecific data modeling and how advances in technology have impacted this process.

00:00 Introduction and Guest Background
00:10 Data Engineering Journey and Experience
00:50 The Role and Challenges of Data Engineering
02:36 Data Engineering in Startups vs Big Tech
04:30 Understanding Data Ecosystem and Choosing the Right Fit
05:55 Building Blocks of Data Engineering
09:50 The Importance of Business Requirements in Data Engineering
10:50 The Evolution of Data Modeling
17:20 The Challenge of Data Quality
21:57 Conclusion and Final Thoughts

posted by marxisystemz7