The intersection of technologies!

HDP Developer: Real Time Development Training

There is no planned dates for this training. Please contact us to plan the training by filling out the form.

Prerequisites

Students should be familiar with programming principles and have experience in software development. Java programming experience is required. SQL and light scripting knowledge is also helpful. No prior Hadoop knowledge is required.

This training course is designed for developers who need to create real-time applications to ingest and process streaming data sources using Hortonworks Data Platform (HDP) and Hortonworks Data Flow (HDF) environments. Specific technologies covered includes: Apache Hadoop, Apache Kafka, Apache Storm & Trident, Apache Spark and Apache HBase as well as Apache NiFi. The highlight of the course is the custom workshop-styled labs that will allow participants to build streaming applications with Storm and Spark Streaming.

Students should be familiar with programming principles and have experience in software development. Java programming experience is required. SQL and light scripting knowledge is also helpful. No prior Hadoop knowledge is required.

Developers and data engineers who need to understand and develop real-time / streaming applications on HDP and HDF.

Objectives

  • Real-time architecture & overview of the class
  • Identify the relevant HDP/HDF components
  • Spark ecosystem overview
  • RDD Programming
  • Pair RDD Programming
  • Spark Streaming
  • Kafka Architecture
  • HBase Architecture
  • Storm Architecture
  • Building Storm Topologies
  • Advanced Storm Features
  • Storm Integrations
  • Introduction to HDF/NiFi
  • NiFi Architecture
  • Developing DataFlows

Hands-on Labs

  • Using HDFS Commands
  • Introduction to SPARK REPLs and Zeppelin
  • Create and Manipulate RDDs
  • Create and Manipulate Pair RDDs
  • Spark Streaming Using HDFS Directories and TCP Sockets
  • Spark Streaming Transformations
  • Spark Streaming Window Transformations
  • Storm WordCount
  • Integrating Storm with Kafka
  • Storm Workshop with Kafka and HBase
  • NiFi User Interface
  • Building a NiFi Data Flow
  • Processor Group
  • Remote Processor Group

By using this website you agree to let us use cookies. For further information about our use of cookies, check out our Cookie Policy.