Skip links

DENG-251: Building an Open Data Lakehouse Using Apache Iceberg

Because we know just how hard it is to get the size.

Training
Certificate

DENG-251: Building an Open Data Lakehouse Using Apache Iceberg

Course Information

Course Name

DENG-251: Building an Open Data Lakehouse Using Apache Iceberg

Exam code

CDP-3002

Duration

4 Days

Certification

Overview

The Open Data Lakehouse is a modern data architecture that enables versatile analytics on streaming and stored data within cloud-native object stores. This architecture can span hybrid and multi-cloud environments.

This course introduces Apache Ozone, a hybrid storage service addressing the limitations of HDFS. You’ll also explore Apache Iceberg, an open-table format optimized for petabyte-scale datasets. The course covers Iceberg’s benefits, architecture, read/write operations, streaming, and advanced features like time travel, partition evolution, and Data-as-Code. Over 25 hands-on labs and a capstone project will equip you with the skills to build an efficient, performant Open Data Lakehouse within your own environment.

Overview

Overview

The Open Data Lakehouse is a modern data architecture that enables versatile analytics on streaming and stored data within cloud-native object stores. This architecture can span hybrid and multi-cloud environments.

This course introduces Apache Ozone, a hybrid storage service addressing the limitations of HDFS. You’ll also explore Apache Iceberg, an open-table format optimized for petabyte-scale datasets. The course covers Iceberg’s benefits, architecture, read/write operations, streaming, and advanced features like time travel, partition evolution, and Data-as-Code. Over 25 hands-on labs and a capstone project will equip you with the skills to build an efficient, performant Open Data Lakehouse within your own environment.

Audience Profile

This course is designed for data professionals within organizations using Cloudera Data Warehouse or Cloudera Data Engineering solutions. If you’re building an Open Data Lakehouse powered by Apache Iceberg, this course will provide the knowledge and skills you need. Ideal roles include Data Engineers, Hive/Impala SQL Developers, Kafka Streaming Engineers, Data Scientists, and CDP Admins.

Prerequisites

A basic understanding of HDFS and experience with Hive and Spark are prerequisites.

At Course Completion

Course Outline

  • Understand core Open Data Lakehouse concepts and benefits.
  • Introduction to Apache Ozone and its integration within the CDP Ecosystem.
  • Configure Ozone, use CLI commands, and transfer data between HDFS and Ozone.
  • Integrate Ozone into applications.
  • Explore Iceberg’s integration with CDP, architecture, and data lakehouse design principles.
  • Master data management, governance, and optimization best practices.
  • Understand snapshots and time travel queries.
  • Design tables strategically (external/managed, copy-on- write, merge-on-read).
  • Employ advanced features: change data capture (CDC), schema/partition evolution, hidden partitions.
  • Implement zero-copy cloning, table branching, and tagging for QA, ML models, and auditing.
  • Optimize ETL/ELT data loading and achieve GDPR compliance with Iceberg’s write-audit-publish (WAP).
  • Understand catalog differences and migration strategies.
  • Manage late-arriving data effectively.
  • Perform table maintenance tasks.
  • Configure and manage access control settings.
  • Apply all concepts by implementing an Open Data Lakehouse use case in CDP.
  • Develop a comprehensive Open Data Lakehouse implementation runbook.
Course Price

RM13,600.00 exc. 8% tax

Training Dates

Product price:RM13,600.00 exc. 8% tax
Total options:
Order total:
Fill up the form for enquiry

Related Courses

You might also being interested in this course

Intermediate

DENG-254: Preparing with Cloudera Data Engineering