Data Mesh Paradigm Shift in Data Platform Architecture – Arif Wider – DDD Europe 2020

video:

Domain-Driven Design Europe 2020
http://dddeurope.com – https://twitter.com/ddd_eu

Many enterprises are investing in their next generation data platform, with the hope of democratizing data at scale to provide business insights and ultimately make automated intelligent decisions. Data platforms based on the data lake architecture have common failure modes that lead to unfulfilled promises at scale.

In this talk Arif shares his observations on the failure modes of a centralized paradigm of a data lake, or its predecessor data warehouse.

He introduces Data Mesh, the next generation data platforms, that shifts to a paradigm that draws from modern distributed architecture: considering domains as the first class concern, applying platform thinking to create self-serve data infrastructure, and treating data as a product.

Dr. Arif Wider is a lead developer at ThoughtWorks, where he enjoys building scalable applications and building teams that build scalable applications. As the Head of AI for ThoughtWorks Germany he is leading the data and machine learning activities. He is still passionate about functional programming and software engineering excellence.

Tags

Follow us

Read our latest news from Virtual DDD on any of these social networks!

Recent videos

Impact Mapping – The Secret Sauce

Details "Impact mapping is a lightweight, collaborative planning technique for teams that want to make a big impact with software products. It is based on user interaction design, outcome-driven planning and mind mapping. Impact maps help delivery teams and...

Pragmatic Architecture: How to Know When It’s Enough

Details Overengineering wastes time and effort, while underengineering creates future pain. How do you strike the right balance? This talk explores how you can use the balanced coupling model to achieve the just-right engineering. You’ll learn to predict volatility of...