Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
0
50
100
200
TV
300
25
5
10
15
Sales
20
25
20
15
Sales
5
10
15
5
10
Sales
20
25
What is Statistical Learning?
0
10
20
30
40
50
0
20
Radio
40
60
80
100
Newspaper
Shown are Sales vs TV, Radio and Newspaper, with a blue
linearregression line fit separately
Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
CS 5620 Big Data Storage, Analytics and Visualization
Homework 2
May 18, 2016
Textbook: An Introduction to Statistical Learning: with Applications in R (Springer Texts in
Statistics) 1st ed. 2013, Corr. 5th printing 2015 Edition
1. Page 52: Q2
2. Page 54
Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
Book URLs:
1. Big Data: A Revolution That Will Transform How We Live, Work, and Think
Paperback March 4, 2014
Chapter 1:
https:/www.hodder.co.uk/assets/HodderStoughton/downloads/Big%20Data%20first%20ch.pdf
http:/pan.baidu.com/share/link?shareid=3120151779
Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
CS 5620 Big Data Storage, Analytics and Visualization
Homework 3
May 23, 2016
Textbook: An Introduction to Statistical Learning: with Applications in R (Springer Texts in
Statistics) 1st ed. 2013, Corr. 5th printing 2015 Edition
1. Page 120: Q1, Q3
2. Pag
Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
on ed
iti dat
Ed p
h &U
4t s e d
Re
vi
Hadoop: The Definitive Guide
Using Hadoop 2 exclusively, author Tom White presents new chapters
on YARN and several Hadooprelated projects such as Parquet, Flume,
Crunch, and Spark. Youll learn about recent changes
Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
DSO 530: Multiple Linear Regression
Abbass Al Sharif
Multiple Linear Regression
We will conitue working with the Boston dataset which is part of the MASS package. It recordes the median
value of houses for 506 neighborhoods around Boston. Now, we want to
Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
Advanced Analytics with Spark
Advanced Analytics with Spark
In this practical book, four Cloudera data scientists present a set of selfcontained patterns for performing largescale data analysis with Spark. The
authors bring Spark, statistical methods, an
Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
CS 562031414 Big Data: Storage, Analytics, and
Visualization
Syllabus, Procedures and Policies
May 17, 2016
Room: 146 UCM Summit Center
Time: 1:30 pm 3:30 pm TR
Instructor: Dr. Bo Li
Office: 151H CSC
Telephone: 6605436629
EMAIL: li@ucmo.edu
Office Hou
Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
Linear regression
Linear regression is a simple approach to supervised
learning. It assumes that the dependence of Y on
X1 , X2 , . . . Xp is linear.
1 / 48
Linear regression
(x) =is0a +
1 x1 approach
+ 2 x2 + .to. . supervised
p xp
Linear regression
s
Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
CS 5620 Course Project
Grade: 100 marks in total, while it accounts for 40% towards the final grade
Grading Policy:
Your grade is based on your presentation performance, in principle
Project submission is mainly for borderline case consideration and valid
Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
5/19/16
BIG DATA
(CS5620)
Introduction to MapReduce
Instructor: Dr. Yui Man Lui
Why MapReduce
1
5/19/16
Big Data
Big data is everywhere
There are 2,161,530,000,000 searches in 2013
92,100,000 pages mentioning Albert Einstein
Only 38,400 pages menti
Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
Map Reduce Computing
Anshuman Singh
Computing on cluster
High Performance Computing (HPC)
CPUintensive computing
Data moves across nodes to programs
Map Reduce Computing (MRC)
Dataintensive computing
Programs (Map and Reduce) move across nodes
to
Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
CS 5620 Big Data Storage, Analytics and Visualization Textbooks
1. Big Data: A Revolution That Will Transform How We Live, Work, and Think
Paperback March 4, 2014
by Viktor MayerSchnberger (Author), Kenneth Cukier (Author)
Paperback: 272 pages
Publisher:
Sri Chandrasekharendra Saraswathi Viswa Mahavidyalaya
BigData
ECE 1109c104

Fall 2016
CS 5620 Big Data Storage, Analytics and Visualization
Homework 1
May 16, 2016
1. Reading and write reading summary/notes for the following chapters
Selected chapters (within the scope of the Exam) from the Textbook Big Data: A
Revolution That Will Transfo