HDP Developer: Real Time Development, New Zealand

We can host this training at your preferred location. Contact us!

This training course is designed for developers who need to create real-time applications to ingest and process streaming data sources using Hortonworks Data Platform (HDP) and Hortonworks Data Flow (HDF) environments. Specific technologies covered includes: Apache Hadoop, Apache Kafka, Apache Storm & Trident, Apache Spark and Apache HBase as well as Apache NiFi. The highlight of the course is the custom workshop-styled labs that will allow participants to build streaming applications with Storm and Spark Streaming.

Students should be familiar with programming principles and have experience in software development. Java programming experience is required. SQL and light scripting knowledge is also helpful. No prior Hadoop knowledge is required.

Developers and data engineers who need to understand and develop real-time / streaming applications on HDP and HDF.

Objectives

Real-time architecture & overview of the class
Identify the relevant HDP/HDF components
Spark ecosystem overview
RDD Programming
Pair RDD Programming
Spark Streaming
Kafka Architecture
HBase Architecture
Storm Architecture
Building Storm Topologies
Advanced Storm Features
Storm Integrations
Introduction to HDF/NiFi
NiFi Architecture
Developing DataFlows

Hands-on Labs

Using HDFS Commands
Introduction to SPARK REPLs and Zeppelin
Create and Manipulate RDDs
Create and Manipulate Pair RDDs
Spark Streaming Using HDFS Directories and TCP Sockets
Spark Streaming Transformations
Spark Streaming Window Transformations
Storm WordCount
Integrating Storm with Kafka
Storm Workshop with Kafka and HBase
NiFi User Interface
Building a NiFi Data Flow
Processor Group
Remote Processor Group

Upcoming Trainings

Join our public courses in our New Zealand facilities. Private class trainings will be organized at the location of your preference, according to your schedule.

Classroom / Virtual Classroom

09 June 2024