Fundamentals of Data Engineering Training in Australia

This is a fundamental 1-day course, an interest in Data Engineering or the role of a data engineer would be useful, but not essential.

Target Audience

For those who manage a data team and would like to gain a better understanding of the data engineer role, or are looking to work with or become a data engineer. This course is an overview of the role and shows the importance of the data engineer to a successful data team.

• Introduction to data engineering core concepts listing the skills required and the personality to perform the role.
• An end to end walkthrough of the Data Engineering tasks and terms.
• Reviewing the data pipelines with no or little code to the perform ETL or ELT, then expanding the breadth by adding SQL data queries and Python data manipulation
• Recognising the data architecture choices presented to the data engineer and modelling the data to suit both the data store and data retrieval needs.
• Reviewing the concepts and technologies in a DW 2.0 environment including data lakes and lakehouses.
• Covering the disposal of data and the possible approaches to perform this.
• Documenting the data engineering performed, holding metadata and aligning data governance within the organisation.

The introduction covers gaining a better understanding of the data engineer role, or are looking to work with or become a data engineer. This course is an overview of the role and shows the importance of the data engineer to a successful data team.

The main subjects covered are:

• Data roles
• Data Engineering Walkthrough
• The data engineer
• Data types and groupings
• Relational data warehouse
• Data movement: ETL, ELT and pipelines
• Modern data warehouse
• Data engineering steps
• Data disposal and GDPR