Hello everyone!
The Data Engineer Things (DET) community is now a family of over 4500 members! Thank you for being part of it!
🌟 Community Highlights
DET is co-hosting an in-person meetup for all the data engineering and event streaming enthusiasts! Many data engineers will be in town for the Current 2023 that week. Even if you are not attending the conference, please join us and network.
Time: 6:30 PM - 8:30 PM on Sep 27
Location: 60 S 1st St, San Jose, CA 95113 (Downtown San Jose)
RSVP: Link
(Shoutout to our co-hosts Claypot, Quix, and RisingWave for making this happen!)
📚 Articles of the Month
Career Pathways of Data Engineers by Ravi Ganta
Traps and Pitfalls of Using SQL with Jinja by Iaroslav Zeigerman
Ingestion of data is over. But not as you know it by Hugo Lu
Streaming from Apache Iceberg by Steven Wu
Lessons Learnt From Consolidating ML Models in a Large Scale Recommendation System from Netflix Tech Blog (written by the Algorithm Research team that I support at work! 😉)
(Want to publish blogs with DET? Read our submission guidelines here.)
🎸 Events & Activities
[Sep 14] [Online] Career Growth in Data Engineering Q&A with Shachar Meir: Shachar is currently a Data Advisor. Previously at Meta, Shachar was the Data Engineering Lead in London, and has grown the London site from 4 Data Engineers to about 200 at its peak. He has mentored and grown many people over the years, from entry-level to very senior leadership roles. Sign up HERE.
[Sep 22] [Online] Building Lakehouse on Delta Lake: With over 19 million downloads, Delta Lake is one of the most popular open-source lakehouse frameworks. Matthew Powers will walk us through the advantages of Data Lakehouse architecture, the benefits of pairing Delta Lake with Spark, and how it can make Pandas / Polars / PyTorch analyses faster. Sign up HERE.
(Missed a DET event? All recordings are available on our Youtube channel. Don’t forget to subscribe to the DET Event Calendar!)
Have a great week and see you next time!
Cheers,
Xinran Waibel (LinkedIn)