Cloudera Developer for Spark and Hadoop Training in Ireland

  • Learn via: Classroom / Virtual Classroom / Online
  • Duration: 4 Days
  • Price: Please contact for booking options
We can host this training at your preferred location. Contact us!

This hands-on training course delivers the key concepts and expertise participants need to ingest and process data on a Hadoop cluster using the most up-to-date tools and techniques. Employing Hadoop ecosystem projects such as Spark (including Spark Streaming and Spark SQL), Flume, Kafka, and Sqoop, this training course is the best preparation for the real-world challenges faced by Hadoop developers. With Spark, developers can write sophisticated parallel applications to execute faster decisions, better decisions, and interactive actions, applied to a wide variety of use cases, architectures, and industries.

There are no prerequisites for this course.

  • This course is designed for developers and engineers who have programming experience, but prior knowledge of Hadoop is not required
  • Apache Spark examples and hands-on exercises are presented in Scala and Python. The ability to program in one of those languages is required
  • Basic familiarity with the Linux command line is assumed
  • Basic knowledge of SQL is helpful

  • Through expert-led discussion and interactive, hands-on exercises, participants will learn how to:
  • Distribute, store, and process data in a Hadoop cluster
  • Write, configure, and deploy Apache Spark applications on a Hadoop cluster
  • Use the Spark shell for interactive data analysis
  • Process and query structured data using Spark SQL
  • Use Spark Streaming to process a live data stream
  • Use Flume and Kafka to ingest data for Spark Streaming

Introduction

Introduction to Apache Hadoop and the Hadoop Ecosystem

  • Apache Hadoop Overview
  • Data Storage and Ingest
  • Data Processing
  • Data Analysis and Exploration
  • Other Ecosystem Tools
  • Introduction to the Hands-On Exercises
  • Apache Hadoop File Storage
  • Problems with Traditional

Large-Scale Systems

  • HDFS Architecture
  • Using HDFS
  • Apache Hadoop File Formats

Data Processing on an Apache Hadoop Cluster

  • YARN Architecture
  • Working With YARN

Importing Relational Data with Apache Sqoop

  • Apache Sqoop Overview
  • Importing Data
  • Importing File Options
  • Exporting Data

Apache Spark Basics

  • What is Apache Spark?
  • Using the Spark Shell
  • RDDs (Resilient Distributed Datasets)
  • Functional Programming in Spark

Working with RDDs

  • Creating RDDs
  • Other General RDD Operations

Aggregating Data with Pair RDDs

  • Key-Value Pair RDDs
  • Map-Reduce
  • Other Pair RDD Operations

Writing and Running Apache Spark Applications

  • Spark Applications vs. Spark Shell
  • Creating the SparkContext
  • Building a Spark Application

(Scala and Java)

  • Running a Spark Application
  • The Spark Application Web UI

Configuring Apache Spark Applications

  • Configuring Spark Properties
  • Logging

Parallel Processing in Apache Spark

  • Review: Apache Spark on a Cluster
  • RDD Partitions
  • Partitioning of File-Based RDDs
  • HDFS and Data Locality
  • Executing Parallel Operations
  • Stages and Tasks

RDD Persistence

  • RDD Lineage
  • RDD Persistence Overview
  • Distributed Persistence

Common Patterns in Apache Spark

Data Processing

  • Common Apache Spark Use Cases
  • Iterative Algorithms in Apache Spark
  • Machine Learning
  • Example: k-means

DataFrames and Spark SQL

  • Apache Spark SQL and the SQL Context
  • Creating DataFrames
  • Transforming and Querying DataFrames
  • Saving DataFrames
  • DataFrames and RDDs
  • Comparing Apache Spark SQL, Impala, and Hive-on-Spark
  • Apache Spark SQL in Spark 2.x

Message Processing with Apache Kafka

  • What is Apache Kafka?
  • Apache Kafka Overview
  • Scaling Apache Kafka
  • Apache Kafka Cluster Architecture
  • Apache Kafka Command Line Tools

Capturing Data with Apache Flume

  • What is Apache Flume?
  • Basic Flume Architecture
  • Flume Sources
  • Flume Sinks
  • Flume Channels
  • Flume Configuration

Integrating Apache Flume and Apache Kafka

  • Overview
  • Use Cases
  • Configuration

Apache Spark Streaming:

Introduction to DStreams

  • Apache Spark Streaming Overview
  • Example: Streaming Request Count
  • DStreams
  • Developing Streaming Applications

Apache Spark Streaming:

Processing Multiple Batches

  • Multi-Batch Operations
  • Time Slicing
  • State Operations
  • Sliding Window Operations

Apache Spark Streaming: Data Sources

  • Streaming Data Source Overview
  • Apache Flume and Apache Kafka

Data Sources

  • Example: Using a Kafka Direct Data Source

Conclusion

Contact us for more detail about our trainings and for all other enquiries!

Upcoming Trainings

Join our public courses in our Ireland facilities. Private class trainings will be organized at the location of your preference, according to your schedule.

Classroom / Virtual Classroom
09 June 2024
Dublin, Belfast, Cork
4 Days
Classroom / Virtual Classroom
15 June 2024
Dublin, Belfast, Cork
4 Days
Classroom / Virtual Classroom
09 August 2024
Dublin, Belfast, Cork
4 Days
Classroom / Virtual Classroom
24 August 2024
Dublin, Belfast, Cork
4 Days
Classroom / Virtual Classroom
12 October 2024
Dublin, Belfast, Cork
4 Days
Classroom / Virtual Classroom
16 October 2024
Dublin, Belfast, Cork
4 Days
Classroom / Virtual Classroom
24 October 2024
Dublin, Belfast, Cork
4 Days
Classroom / Virtual Classroom
22 October 2024
Dublin, Belfast, Cork
4 Days
Cloudera Developer for Spark and Hadoop Training Course in Ireland

Ireland is an island nation located in northwestern Europe. Its history is shaped by its position as a former British colony, as well as its rich cultural heritage, which includes a long tradition of storytelling, music, and dance. Ireland gained independence from Britain in 1922 and has since become a modern, prosperous country.

Today, Ireland is known for its beautiful landscapes, rich cultural heritage, and friendly people. Popular cities within the country include Dublin, Cork, and Galway, each with their own unique charm and character. The population of Ireland is estimated to be around 5 million people, with English and Irish being the two official languages. Ireland is also home to a vibrant tech sector, with many global tech companies choosing to locate their European headquarters in Dublin. With its mix of tradition and modernity, Ireland is a popular destination for visitors from all over the world.

Choose from our extensive selection of IT courses, covering programming, data analytics, software development, business skills, cloud computing, cybersecurity, project management. Our highly skilled instructors will deliver hands-on training and valuable insights at a location of your choice within Ireland.
Dublin is considered the technology center of Ireland. It is home to a thriving tech industry, with many global tech giants such as Google, Facebook, and Microsoft having their European headquarters in the city. Dublin's reputation as a tech hub is due in part to its favorable business environment, with a low corporate tax rate and a skilled workforce that is well-educated in science, technology, engineering, and mathematics (STEM) fields.

Dublin has also been proactive in supporting the growth of the technology sector, with initiatives such as the Dublin Commissioner for Startups and the Dublin Tech Summit, an annual event that brings together technology leaders from around the world.
We are one of the best! Bilginç IT Academy offers online, live virtual and classroom trainings in Ireland. We are delighted to assist market leaders as they shape the ever-changing and evolving digital landscape. We adapt new generation training methodologies to Ireland's needs. Enroll now and take your tech team to new heights.
Bilginç IT Academy’s coding classes in Ireland can help your team reach its full potential. Our courses, which are intended for tech firm employees, provide hands-on training in the most recent coding languages and frameworks, giving your team the knowledge they need to advance your company. Take your tech team to greater levels by enrolling right away.

Bilginç IT Academy All Rights Reserved

By using this website you agree to let us use cookies. For further information about our use of cookies, check out our Cookie Policy.