✉️

#17 The third-generation data catalog primer!

Hi,

The data world has recently converged around the best set of tools for dealing with massive amounts of data, aka the “modern data stack”. The good? The modern data stack is super fast, easy to scale up in seconds, and requires little overhead. The bad? It’s still a noob in terms of bringing governance, trust, and context to data.

That’s where metadata comes in. ⭐️

However, as the rest of the data stack has accelerated, metadata management is stuck in the past. While companies ingest more and more data, data catalogs are struggling to keep up. The result is chaos and mistrust.

So what should modern metadata look like in today’s modern data stack? How can data catalogs evolve into a powerful vehicle for data democratization and governance? Why does metadata management need a fundamental shift from its old-school roots to today’s modern demands?

We spoke to over 350 data leaders to understand their struggles with metadata. This helped us construct a vision for the future of data catalogs — one built around agility, trust, and collaboration. We call this “Data Catalog 3.0” or the “Third-Generation Data Catalog”.

image

We have consolidated our learnings into an ebook and are super excited to send over your copy in this Email. 💙

Briefly, the ebook is structured as below:

  1. Chapter 1 – A brief history of how metadata management has evolved since its creation in the 1990s
  2. Chapter 2 – Why current data catalogs are falling short, and the five trends behind third-gen catalogs
  3. Chapter 3 – What the third-generation data catalog looks like, and how it fits into our modern data stack

Would love to hear your thoughts! And always, if you have any questions please reach out to me directly. Happy reading :) Cheers, Nandini

P.S. The purpose of these emails is to share learnings and best practices to empower our community of DataOps Leaders. All the previous editions of these weekly digests can be found on our community website. Though we have put a lot of thought into curating the most relevant content, if you do not wish to have access to this, you can choose to opt-out by emailing me here: opt-out