Data Science at Scale using Spark and Hadoop Training in Hong Kong

  • Learn via: Classroom / Virtual Classroom / Online
  • Duration: 3 Days
  • Price: Please contact for booking options
We can host this training at your preferred location. Contact us!

Data scientists build information platforms to provide deep insight and answer previously unimaginable questions. Spark and Hadoop are transforming how data scientists work by allowing interactive and iterative data analysis at scale.

Learn how Spark and Hadoop enable data scientists to help companies reduce costs, increase profits, improve products, retain customers, and identify new opportunities.

Cloudera University’s three-day course helps participants understand what data scientists do, the problems they solve, and the tools and techniques they use. Through in-class simulations, participants apply data science methods to real-world challenges in different industries and, ultimately, prepare for data scientist roles in the field.

There are no prerequisites for this course.

This course is suitable for developers, data analysts, and statisticians with basic knowledge  of Apache Hadoop: HDFS, MapReduce, Hadoop Streaming, and Apache Hive as well as experience working in Linux environments. Students should have proficiency in a scripting language; Python is strongly preferred, but familiarity with Perl or Ruby is sufficient

Through instructor-led discussion and interactive, hands-on exercises, participants will navigate the Hadoop ecosystem, and develop concrete skills such as:

  • How to identify potential business use cases where data science can provide impactful results
  • How to obtain, clean and combine disparate data sources to create a coherent picture for analysis
  • What statistical methods to leverage for data exploration that will provide critical insight into your data
  • Where and when to leverage Hadoop streaming and Apache Spark for data science pipelines
  • What machine learning technique to use for a particular data science project
  • How to implement and manage recommenders using Spark’s MLlib, and how to set up and evaluate data experiments
  • What are the pitfalls of deploying new analytics projects to production, at scale

Introduction

  • About This Course
  • About Cloudera
  • Course Logistics
  • Introductions

Data Science Overview

  • What Is Data Science?
  • The Growing Need for Data Science
  • The Role of a Data Scientist

Use Cases

  • Finance
  • Retail
  • Advertising
  • Defense and Intelligence
  • Telecommunications and Utilities
  • Healthcare and Pharmaceuticals

Project Lifecycle

  • Steps in the Project Lifecycle
  • Lab Scenario Explanation

Data Acquisition

  • Where to Source Data
  • Acquisition Techniques

Evaluating Input Data

  • Data Formats
  • Data Quantity
  • Data Quality

Data Transformation

  • File Format Conversion
  • Joining Data Sets
  • Anonymization

Data Analysis and Statistical Methods

  • Relationship Between Statistics and Probability
  • Descriptive Statistics
  • Inferential Statistics
  • Vectors and Matrices

Fundamentals of Machine Learning

  • Overview
  • The Three C’s of Machine Learning
  • Importance of Data and Algorithms
  • Spotlight: Naive Bayes Classifiers

Recommender Overview

  • What is a Recommender System?
  • Types of Collaborative Filtering
  • Limitations of Recommender Systems
  • Fundamental Concepts

Introduction to Apache Spark and MLlib

  • What is Apache Spark?
  • Comparison to MapReduce
  • Fundamentals of Apache Spark
  • Spark’s MLlib Package

Implementing Recommenders with MLlib

  • Overview of ALS Method for

Latent Factor Recommenders

  • Hyperparameters for ALS Recommenders
  • Building a Recommender in MLlib
  • Tuning Hyperparameters
  • Weighting

Experimentation and Evaluation

  • Designing Effective Experiments
  • Conducting an Effective Experiment
  • User Interfaces for Recommenders

Production Deployment and Beyond

  • Deploying to Production
  • Tips and Techniques for Working at Scale
  • Summarizing and Visualizing Results
  • Considerations for Improvement
  • Next Steps for Recommenders

Conclusion



Contact us for more detail about our trainings and for all other enquiries!

Upcoming Trainings

Join our public courses in our Hong Kong facilities. Private class trainings will be organized at the location of your preference, according to your schedule.

Classroom / Virtual Classroom
24 January 2025
Hong Kong, Kowloon, Tsuen Wan
3 Days
Classroom / Virtual Classroom
05 February 2025
Hong Kong, Kowloon, Tsuen Wan
3 Days
Classroom / Virtual Classroom
24 January 2025
Hong Kong, Kowloon, Tsuen Wan
3 Days
Classroom / Virtual Classroom
22 February 2025
Hong Kong, Kowloon, Tsuen Wan
3 Days
Classroom / Virtual Classroom
05 February 2025
Hong Kong, Kowloon, Tsuen Wan
3 Days
Classroom / Virtual Classroom
22 February 2025
Hong Kong, Kowloon, Tsuen Wan
3 Days
Classroom / Virtual Classroom
20 March 2025
Hong Kong, Kowloon, Tsuen Wan
3 Days
Classroom / Virtual Classroom
26 March 2025
Hong Kong, Kowloon, Tsuen Wan
3 Days
Data Science at Scale using Spark and Hadoop Training Course in Hong Kong

Hong Kong is officially known as the Hong Kong Special Administrative Region of the People's Republic of China (HKSAR) and is a city and special administrative region of China on the eastern Pearl River Delta in South China. Hong Kong is one of the most densely populated places in the world, with over 7.5 million population. The official languages of the HKSAR are Chinese and English. Hong Kong is a highly developed territory and ranks fourth on the United Nations Human Development Index and the residents of Hong Kong have the highest life expectancies in the world.

The best time to visit Hong Kong is from September to December, since the temperatures, averaging between 19 to 28 degree Celsius. During this outdoor activities-friendly travelling season, you can take a walk along Victoria Harbour, visit the islands of Lantau, Lamma and Cheung Chau and participate in the Mid-Autumn Festival. Top choices of the tourists to visit in Hong Kong are Big Buddha statue, Wong Tai Sin Temple, Repulse Bay and the Beaches and Hong Kong Disneyland.

Explore our diverse range of IT courses, encompassing programming, software development, cyber security, data science, business skills, and Agile/Scrum. Wherever you are in Hong Kong, our seasoned instructors will bring practical training and expert knowledge to your preferred training venue.
By using this website you agree to let us use cookies. For further information about our use of cookies, check out our Cookie Policy.