Fundamentals of Data Engineering Training

This one-day course shows the history, skills required, theory and technologies behind the Data Engineering role. This course is an overview of the role and shows the importance of the data engineer to a successful data team. The course will consist of examining the following key areas:

• Data roles
• Data engineering walkthrough
• Data types and groupings
• Data warehouse
• ELT, ETL and pipelines
• Modern data warehouse 2.0
• Architecture and compliance Documenting design

This is a fundamental 1-day course, an interest in Data Engineering or the role of a data engineer would be useful, but not essential.

Target Audience

For those who manage a data team and would like to gain a better understanding of the data engineer role, or are looking to work with or become a data engineer. This course is an overview of the role and shows the importance of the data engineer to a successful data team.

• Introduction to data engineering core concepts listing the skills required and the personality to perform the role.
• An end to end walkthrough of the Data Engineering tasks and terms.
• Reviewing the data pipelines with no or little code to the perform ETL or ELT, then expanding the breadth by adding SQL data queries and Python data manipulation
• Recognising the data architecture choices presented to the data engineer and modelling the data to suit both the data store and data retrieval needs.
• Reviewing the concepts and technologies in a DW 2.0 environment including data lakes and lakehouses.
• Covering the disposal of data and the possible approaches to perform this.
• Documenting the data engineering performed, holding metadata and aligning data governance within the organisation.

The introduction covers gaining a better understanding of the data engineer role, or are looking to work with or become a data engineer. This course is an overview of the role and shows the importance of the data engineer to a successful data team.

The main subjects covered are:

• Data roles
• Data Engineering Walkthrough
• The data engineer
• Data types and groupings
• Relational data warehouse
• Data movement: ETL, ELT and pipelines
• Modern data warehouse
• Data engineering steps
• Data disposal and GDPR