Data Science with R and SQL Server Training in New Zealand

Attendees should have basic understanding of data analysis and basic familiarity with SQL Server tools.

Course Format

This seminar consists of instructor presentations and individual work during labs. During labs, the attendees use mainly the R language.

Every attendee gets a .PDF printout of all slides and all code and solutions for the demos presented and for the lab exercises.

In addition, every attendee gets an electronic version of the Data Science with SQL Server Quick Start Guide book by Dejan Sarka, Packt, 2018.

Each attendee works on a pre-prepared computer on a virtual machine with the following software pre-installed:

• SQL Server 2017 or 2019 Database Engine with ML Services (In-Database)
• AdventureWorksDW2017 demo database
• Microsoft R Client
• RStudio IDE
• SQL Server Management Studio

Learning Outcomes

Attendees of this course learn to program with R from the scratch. Basic R code is introduced using the free R engine and RStudio IDE. A lifecycle of a data science project is explained in details. The attendees learn how to perform the data overview and do the most tedious task in a project, the data preparation task. After data overview and preparation, the analytical part begins with intermediate statistics in order to analyze associations between pairs of variables. Then the course introduces more advanced methods for researching linear dependencies.

Too many variables in a model can make its own problem. The course shows how to do feature selection, starting with the basics of matrix calculations. Then the course switches more advanced data mining and machine learning analyses, including supervised and unsupervised learning. The course also introduces the currently modern topics, including forecasting, text mining, and reinforcement learning.

Finally, the attendees also learn how to use the R code in SQL Server, Azure ML, and Power BI through labs, and how to use Python for inside all of the tools mentioned through demos.

Course Outline

Following an introduction the modules will be as follows:

1. Introducing data science and R
   1. What are statistics, data mining, machine learning…
   2. Data science projects and their lifetime
   3. Introducing R
   4. R tools
   5. R data structures

Lab 1

1. Introducing Python
   1. Basic syntax and objects
   2. Data manipulation with NumPy and Pandas
   3. Visualizations with matplotlib and seaborn libraries
   4. Data science with Scikit-Learn

Discussion: R vs Python

1. Data overview
   1. Datasets, cases and variables
   2. Types of variables
   3. Introductory statistics for discrete variables
   4. Descriptive statistics for continuous variables
   5. Basic graphs
   6. Sampling, confidence level, confidence interval

Lab 2

1. Data preparation
   1. Derived variables
   2. Missing values and outliers
   3. Smoothing and normalization
   4. Time series
   5. Training and test sets

Lab 3

1. Associations between two variables and visualizations of associations
   1. Covariance and correlation
   2. Contingency tables and chi-squared test
   3. T-test and analysis of variance
   4. Bayesian inference
   5. Linear models

Lab 4

1. Feature selection and matrix operations
   1. Feature selection in linear models
   2. Basic matrix algebra
   3. Principal component analysis
   4. Exploratory factor analysis

Lab 5

1. Unsupervised learning
   1. Hierarchical clustering
   2. K-means clustering
   3. Association rules

Lab 6

1. Supervised learning
   1. Neural Networks
   2. Logistic Regression
   3. Decision and regression trees
   4. Random forests
   5. Gradient boosting trees
   6. K-nearest neighbors

Lab 7

1. Modern topics
   1. Support vector machines
   2. Time series
   3. Text mining
   4. Deep learning
   5. Reinforcement learning

Lab 8

1. R in SQL Server and MS BI
   1. ML Services (In-Database) structure
   2. Executing external scripts in SQL Server
   3. Storing a model and performing native predictions
   4. R in Azure ML and Power BI

Lab 9