Hello everyone! 👋
Welcome to the 1st issue of the Data Engineer Things Newsletter!
The Data Engineer Things (DET) community is now a family of over 1300 members! Thank you for being part of our community, and we look forward to continuing to support you on your data engineering journey!
P.S. Don’t forget to join our Slack group if you haven’t!
🌟 Community Highlights
We have two exciting community events coming up in June:
[June 2] [Online] Demystifying Data Lake & Apache Iceberg: Dipankar Mazumdar, the co-author of "Apache Iceberg: The Definitive Guide", will provide an introduction to data lake, a comparison of common table formats, and a deep dive into Apache Iceberg. Sign up HERE.
[June 27] [In-person + Online] Magic Meetup in San Francisco: DET is partnering with Mage to host in-person data engineering meetups in the Bay Area! Our speakers include Joe Reis, the co-author of "Fundamentals of Data Engineering,” and Julian Jaffe and Ramayan Tiwari from Netflix. Sign up HERE.
📚 Articles of the Week
Featured blog posts from DET authors:
SOLID Principles in Data Engineering by Stephen David-Williams
Supercharging Performance with Partitioning in Databricks and Spark by Eduard Popa
Data Quality Management in Data Engineering: Why, How, and What by Nam Nguyen
Beyond the Pipelines: The Hidden Duties of Data Engineers by Shivananda D
5 Tips to Make Data Engineering a Marathon, Not a Sprint by Tim Webster
(Want to write for DET? Read our submission guidelines here.)
Don’t forget to also check out:
Setting Uber’s Transactional Data Lake in Motion with Incremental ETL Using Apache Hudi by Uber Engineering
Latency goes subsecond in Apache Spark Structured Streaming by Databricks
A Decade In Data Engineering - What Has Changed? by SeattleDataGuy
🎸 Events & Activities
Data Con LA 2023 is calling for speakers. Submit a talk proposal here by June 15.
The DET Mentorship program is coming soon. If you are interested in participating as a mentor or mentee, join the #mentorship-program Slack channel.
Roblox and Confluent are hiring Data Engineers. Reach out to Max Sung and Sharath Chandra if you are interested!
🐶 DE + PET of the Week
Foxy Snugglepants is my 8-year-old Pomeranian mix pup. We adopted her from Minnesota when she was 2 years old. She likes napping and loves bread and fried chicken. Foxy prefers remote working because she gets more walk time but she doesn’t like bad-quality data - it upsets her mama.
(💖 Join the #de-and-pet channel and share cute pictures of your pets with us!)
Want to recommend awesome data engineering content to be featured in the next newsletter? Submit recommendations here.
Have a great week and see you next time!
Cheers,
Xinran Waibel