Hello everyone!
Happy autumn! It’s pumpkin season again. Well… I recently learned that there is no pumpkin at all in pumpkin spice. Hopefully, I’m not the last one to know. 🎃
The DET community now has over 5K members! Thank you for being part of it!
🌟 Community Highlights
Mark your calendar! DET and SeattleDataGuy will be co-hosting the Data Engineering & Machine Learning Summit 2023 on Oct 25th and 26th.
It’s a FREE online conference where we invite practitioners in data engineering and machine learning to share how they solved real-world data problems. As a data engineer myself, whenever I go to a conference, talks from other ICs are always the most interesting to me because I get to learn about practical data engineering. That’s why we put a lot of emphasis on bringing IC voices to the summit!
The summit has 3 tracks: data engineering, machine learning, and technical demos.
We are almost done finalizing the sessions, but here are a few talks that I personally look forward to attending:
Centralized ETL Framework for Decentralized Teams at Uber by Sudhir Mallem (Staff Engineer at Uber)
Machine Learning for League of Legends by Ian Schweer (Staff Software/ML Engineer at Riot Games)
Overcoming Challenges and Pitfalls of A/B Testing by Kasia Rachuta (Staff Data Scientist at Square)
.. and so many more! Stay tuned for the full lineup announcement.
👉🏼 RSVP for the conference HERE.
(Thank you and shoutout to Decube, Segment, and Onehouse for sponsoring the conference!)
📚 Articles of the Week
Building a Real-Time Data Architecture with Apache Kafka, Flink, and Druid by David Wang
SQL Cookbook for dbt: Transforming Big Data with Incremental Models by Hugo Lu
Saving Millions with 5-Min Streaming SQL Techniques & Future-Proofing an Optimized Composable Data Ecosystem by Zhenzhong Xu
Data Engineering at Meta: High-Level Overview of the Internal Tech Stack by Analytics at Meta
How Agoda Manages 1.8 Trillion Events per Day on Kafka by Agoda Engineering
Introduction to Apache Doris: A Next-Generation Real-Time Data Warehouse
(Want to publish blogs with DET? Read our submission guidelines here.)
Have a great week and see you next time!
Cheers,
Xinran Waibel (LinkedIn)