Data Engineering Weekly | Ananth Packkildurai | Substack

Welcome To Data Engineering Weekly - The Newsletter for Data

06-20-2024

͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏

It’s good to have you here!

Data Engineering Weekly is a weekly aggregation of data engineering articles right into your inbox.

You will start receiving updates right here in your inbox. You can also log in to the website to read the full archives and other posts as they are published.

Interesting in Contributing To Data Engineering Weekly?

Are you a data startup founder - Tell Your Story in Data Engineering Weekly

Data Engineering Weekly launches the Founder’s Story, where we feature your startup story. An example

Data Engineering Weekly

The Data Founder Story: I Founded Spectacles With Someone I'd Only Met Once

🏗 Data Founder: Josh Temple 🏢 Product: Spectacles This is the story of how Dylan Baker and I founded and bootstrapped Spectacles, continuous integration, and DevOps suite for Looker developers and admins. 45% of Looker changes have unseen errors, so the best data teams rely on Spectacles to check their work (over 10k Pull Requests worth of work!) and sh…

2 years ago · 5 likes · Ananth Packkildurai

You can find the details below on how to contribute Data Founder story.

https://github.com/ananthdurai/dataengineeringweekly#how-can-i-contribute-founder-story

Did you Enjoy any Data Articles? Would you like to share your opinion with Everyone?

You can find the details below on contributing to the Data Founder story.

https://github.com/ananthdurai/dataengineeringweekly#how-can-i-contribute-articles

Interesting in Writing Op-Ed in Data Engineering Weekly?

The Data Engineering Weekly occasionally publishes op-eds about the recent trends in the industry and observations. Email me at ananth@dataengineeringweekly.com with your proposal.

Some of the most loved op-eds in the recent times

Data Engineering Weekly

Introducing Schemata - A Decentralized Schema Modeling Framework For Modern Data Stack

I’m thrilled to write about Schemata, a decentralized schema modeling framework for data contracts. Oh, wait, all the jargon, what is it? Let me take you all on the Schemata journey. You can find the source code and the documentation here. GitHub Repo…

2 years ago · 15 likes · Ananth Packkildurai

Data Engineering Weekly

Bundling Vs. UnBundling: The Tale of Airflow Operator and dbt Ref

I started working on the data pipeline at the early stage of Hadoop/ Bigdata when Big Data was a buzzword. Apache Oozie (anyone remembers Oozie?) is a go-to tool to orchestrate the data pipeline, where you have to hand-code workflow in an XML file(not surprisingly, the file name is workflow.xml…

2 years ago · 6 likes · 2 comments · Ananth Packkildurai

Data Engineering Weekly

Functional Data Engineering - A Blueprint

The Rise of Data Modeling Data modeling has been one of the hot topics in Data LinkedIn. Hadoop put forward the schema-on-read strategy that leads to the disruption of data modeling techniques as we know until then. We went through a full cycle that…

a year ago · 20 likes · Ananth Packkildurai

Data Engineering Weekly

Data Catalog - A Broken Promise

Data catalogs are the most expensive data integration systems you never intended to build. Data Catalog as a passive web portal to display metadata requires significant rethinking to adopt modern data workflow, not just adding “modern” in its prefix…

a year ago · 9 likes · 4 comments · Ananth Packkildurai

Private podcast setup:
To set up your podcast app, click this link on your phone.

Respond To Email