HDP Developer: Real Time Development Training in New Zealand

This training course is designed for developers who need to create real-time applications to ingest and process streaming data sources using Hortonworks Data Platform (HDP) and Hortonworks Data Flow (HDF) environments. Specific technologies covered includes: Apache Hadoop, Apache Kafka, Apache Storm & Trident, Apache Spark and Apache HBase as well as Apache NiFi. The highlight of the course is the custom workshop-styled labs that will allow participants to build streaming applications with Storm and Spark Streaming.

Developers and data engineers who need to understand and develop real-time / streaming applications on HDP and HDF.

Objectives

• Real-time architecture & overview of the class
• Identify the relevant HDP/HDF components
• Spark ecosystem overview
• RDD Programming
• Pair RDD Programming
• Spark Streaming
• Kafka Architecture
• HBase Architecture
• Storm Architecture
• Building Storm Topologies
• Advanced Storm Features
• Storm Integrations
• Introduction to HDF/NiFi
• NiFi Architecture
• Developing DataFlows

Hands-on Labs

• Using HDFS Commands
• Introduction to SPARK REPLs and Zeppelin
• Create and Manipulate RDDs
• Create and Manipulate Pair RDDs
• Spark Streaming Using HDFS Directories and TCP Sockets
• Spark Streaming Transformations
• Spark Streaming Window Transformations
• Storm WordCount
• Integrating Storm with Kafka
• Storm Workshop with Kafka and HBase
• NiFi User Interface
• Building a NiFi Data Flow
• Processor Group
• Remote Processor Group