Chapter 5
Machine Learning for IoT
Farshad Firouzi, Bahar Farahani, Fangming Ye, and Mojtaba Barzegari
Develop a passion for learning. If you do, you will never cease
to grow.
Anthony J. D’Angelo
Contents
5.1 Fundamental of Machine Learning ....................................................... 244
5.1.1 Fundamental Terminologies ..................................................... 245
5.1.2 Review of Probability Theory ................................................... 247
5.1.3 Review of Linear Algebra ....................................................... 250
5.1.4 Supervised and Unsupervised Learning ........................................ 253
5.1.5 Machine Learning in IoT ........................................................ 254
5.1.6 Machine Learning Flow ......................................................... 256
5.2 Regression Analysis....................................................................... 260
5.2.1 Linear Regression ................................................................ 263
5.2.2 Regularization in Linear Regression ............................................ 264
5.2.3 Bayesian Linear Regression ..................................................... 269
5.3 Feature Selection .......................................................................... 270
5.3.1 Feature Selection Techniques ................................................... 271
5.3.2 Feature Extraction ............................................................... 276
5.4 Classification .............................................................................. 276
5.4.1 Measuring Performance for Classification Problems .......................... 276
5.4.2 Over- and Undersampling ....................................................... 280
5.4.3 K-Nearest Neighbor (KNN) ..................................................... 281
5.4.4 Logistic Regression .............................................................. 282
F. Firouzi ()
Department of ECE, Duke University, Durham, NC, USA
B. Farahani
Shahid Beheshti University, Tehran, Iran
F. Ye
Facebook, Menlo Park, USA
M. Barzegari
KU Leuven, Leuven, Belgium
© Springer Nature Switzerland AG 2020
F. Firouzi et al. (eds.), Intelligent Internet of Things,
https://doi.org/10.1007/978-3-030-30367-9_5
243
Machine Learning for IoT
Farshad Firouzi, Bahar Farahani, Fangming Ye, and Mojtaba Barzegari
Develop a passion for learning. If you do, you will never cease
to grow.
Anthony J. D’Angelo
Contents
5.1 Fundamental of Machine Learning ....................................................... 244
5.1.1 Fundamental Terminologies ..................................................... 245
5.1.2 Review of Probability Theory ................................................... 247
5.1.3 Review of Linear Algebra ....................................................... 250
5.1.4 Supervised and Unsupervised Learning ........................................ 253
5.1.5 Machine Learning in IoT ........................................................ 254
5.1.6 Machine Learning Flow ......................................................... 256
5.2 Regression Analysis....................................................................... 260
5.2.1 Linear Regression ................................................................ 263
5.2.2 Regularization in Linear Regression ............................................ 264
5.2.3 Bayesian Linear Regression ..................................................... 269
5.3 Feature Selection .......................................................................... 270
5.3.1 Feature Selection Techniques ................................................... 271
5.3.2 Feature Extraction ............................................................... 276
5.4 Classification .............................................................................. 276
5.4.1 Measuring Performance for Classification Problems .......................... 276
5.4.2 Over- and Undersampling ....................................................... 280
5.4.3 K-Nearest Neighbor (KNN) ..................................................... 281
5.4.4 Logistic Regression .............................................................. 282
F. Firouzi ()
Department of ECE, Duke University, Durham, NC, USA
B. Farahani
Shahid Beheshti University, Tehran, Iran
F. Ye
Facebook, Menlo Park, USA
M. Barzegari
KU Leuven, Leuven, Belgium
© Springer Nature Switzerland AG 2020
F. Firouzi et al. (eds.), Intelligent Internet of Things,
https://doi.org/10.1007/978-3-030-30367-9_5
243