Learn Data Engineering

The ultimate Data Engineering Academy. Teaching you everything you need to become a Data Engineer or add Data Engineering to your skillset. Proven system through my 10+ years of experience, over 2,000 students, over 50hours of video training material.

Founder

Udemy

I create free data & AI courses on Udemy for Data Engineers, Analysts, Scientists and beginners.

Course Author & Instructor

Kretz Media

At Kretz Media, we help innovative companies share their story and connect with the right audience. We specialize in creating authentic, high-impact content that makes complex topics understandable – and your brand unforgettable.

Whether it's a YouTube product demo, a livestream, a branded online course, or a strategic LinkedIn campaign – we turn your innovation into media that resonates.

LinkedIn

In this course you learn everything you need to know to design a NoSQL graph database and implement it in the cloud.

LinkedIn Learning Instructor

Bosch Rexroth

Data Lab Team Lead

Data Engineering Team Lead

Data Engineer

SALT Solutions GmbH

SAP Consultant

Hey there! I'm Andreas Kretz, your dedicated guide to the exciting realm of Data Engineering and the founder of the Learn Data Engineering Academy. With over years of specialized coaching experience, I've had the pleasure of helping more than 2,000 students reach their goals in this essential field.

I bring over 8 years of experience in Corporate Data Science, 14+ years in Computer Science and IoT, and a robust background as a Data Engineering and Data Labs Team Lead. My journey in Data Engineering has garnered global recognition, including being named a LinkedIn Top Voice in Data Science & Analytics in 2018, 2019, and 2024.

Here's what I do:
➡️ Learn Data Engineering Academy
I’ve trained over 2,000 students through my Academy, offering 30+ in-depth courses and projects with over 55 hours of video content, covering everything you need to excel in Data Engineering.

➡️ Media Work
In 2024, I helped my media partners achieve significant brand awareness, resulting in 1.21 million post views on LinkedIn, 250,000 video views on YouTube, and 235,000 sent emails with a 40% open rate. My efforts have built a vast network of over 100,000 engineers and scientists.

➡️ YouTube
On my YouTube channel, I simplify complex Data Engineering concepts and share valuable insights from the Academy. Join me for livestreams with industry experts, workshops, tool reviews, and deep dives into the latest architectures. It’s your go-to source for staying ahead in the data world.

If you're passionate about Data Engineering, eager to learn, or curious about the latest tools and techniques, hit subscribe. Let's explore the world of Data Engineering together!

Andreas Kretz

Roy Hasson

My first post on Microsoft Fabric blog highlighting an integration with #OneLake I'm really excited about - querying database backups powered by Apache Iceberg and Eon.io

A best practice is to replicate operational databases into your lakehouse or warehouse for analytics and AI. This drives much of the integration tooling ecosystem with lots of products and OSS tools, including connectors, CDC and replication engines. 

CDC is a common pattern for replicating data, but it requires custom tools, continuously running pipelines and constant management. Even more important that most vendors won't tell you, is the need for the source DBs to support CDC or even be capable of handling the workload without falling over. 

Many enterprises simply can't enable CDC so what are they to do?

In addition, as you replicate operational DBs, data is duplicated. How can you avoid more copies of the same data?

Database backups are commonplace and simply a hard requirement these days. Even for cloud-native DBs, backups are a must. This means that now you have your data in the original DB, backup files and replicated out to your lakehouse for analytics - that's 3 copies.

One of them, the backups, are for risk mitigation and aren't super useful beyond that.  

Enter Eon.io

A modern data backup solution that stores these backups using Iceberg in your lake. This makes them queryable from your engine of choice.  

At #MSIgnite we announced an integration between #OneLake and Eon that allow users to query their DB backups without building any ETL pipelines, turning on CDC or deploying any new tooling.  Simply backup your data as you normally do, with Eon, and it's queryable from Fabric or your choice of engine - OneLake automatically converts between DeltaLake and Iceberg so you can really use any modern engine.

Read the post -

Product @ Microsoft | Data engineer | Advocate for better data

Open article: How to Query Database Backups in Microsoft Fabric Without Copies or ETL | Microsoft Fabric Blog | Microsoft Fabric by blog.fabric.microsoft.com

How to Query Database Backups in Microsoft Fabric Without Copies or ETL | Microsoft Fabric Blog | Microsoft Fabric

One of the key features of Apache Iceberg is the ability to delete rows. Beyond the obvious, this allows orgs to comply with privacy regulations, but it's actually much harder in practice then most assume...

Technically speaking, Iceberg enables the ability and functions to delete rows, clean up old files and remove unused snapshots.  This means users can implement ETL processes to ensure compliance with privacy regulations and corporate policies.

However, doing this successfully still requires building and maintaining ETL jobs with complex logic, across lots of tables 😥 

As with zero-ETL, the less ETL we need to write and manage the better.  So why can't compliance also be automated?

It's really cool to see Ryft tackling this problem. Automating compliance enforcement for Iceberg based lakehouses is a game changer for every organization.

🔥 Don't need to learn how Iceberg handles retention, file deletion and snapshot expiration - simply define a desired retention policy and Ryft takes care of the technical details to implement it efficiently and quickly.

🔥 Retention is partition-aware, minimizing data scans for large tables.

🔥 Deletion is verified before it's performed to ensure misconfiguration or other mismatches don't result in accidently loss of data

Stay tuned for more to come from Ryft.  They are tackling the hard problems of making Iceberg lakes enterprise grade and scalable in a data platform independent way.

Open article: Announcing Ryft Data Retention & Compliance Enforcement for Apache Iceberg | Yuval Yogev by ryft.io

Announcing Ryft Data Retention & Compliance Enforcement for Apache Iceberg

Announcing Ryft Data Retention & Compliance Enforcement for Apache Iceberg | Yuval Yogev

taplio

The Battle

Andreas Kretz

Roy Hasson

Followers

Posts

Engagements

Likes

Performance ScoreRoy Hasson's LinkedIn Performance

Ready to grow your LinkedIn presence?

taplio

The Battle

Andreas Kretz

Roy Hasson

Followers

Posts

Engagements

Likes

Performance Score.css-goub6s{font-size:var(--chakra-fontSizes-md);font-weight:500;color:var(--chakra-colors-gray-600);display:block;margin-top:var(--chakra-space-1);}Roy Hasson's LinkedIn Performance

Ready to grow your LinkedIn presence?

Performance ScoreRoy Hasson's LinkedIn Performance