[PYTHON] Machine learning course memo

Introduction [P01]

What is machine learning?

Technical research area that allows machines to learn their behavior from data

Differences between deep learning and traditional machine learning

Feature engineering was absorbed by the algorithm

Wave of democratization

(2)

Free lunch theorem The optimal algorithm depends on the data

Penalty term = harm

PCA: Principal component? ??

In the algorithm Regularization: holdout Before the algorithm Dimensionality reduction (feature extraction, feature selection) After the algorithm Cross-validation: kfold

StandardScaler() Subtract the mean and divide by the standard deviation

    from sklearn.model_selection import cross_val_score, KFold
# build models
kf = KFold(n_splits=3, shuffle=True, random_state=0)
for pipe_name, est in pipelines.items():
  cv_results = cross_val_score(est,
                                  X, y,
                                 cv=kf,
                                 scoring='r2')
    print('----------')
    print('algorithm:', pipe_name)
    print('cv_results:', cv_results)
    print('avg +- std_dev', cv_results.mean(),'+-', cv_results.std())

Supervised learning (regression) [P02]

Phase

To increase generalization ability

Regression algorithm

Dealing with overfitting

algorithm

Evaluation of regression model

Supervised learning (classification) [P03]

Classification algorithm

Classification model evaluation method

Data preprocessing and dimension reduction [P04]

Data preprocessing

Dimensionality reduction

  from sklearn.feature_selection import RFE
  selector = RFE(RandomForestRegressor(n_estimators=100, random_state=42), n_features_to_select=5)

Unsupervised learning [P06]

Clustering

Collect data with high similarity from data that has no correct answer k-means

Scheduled to be added

Recommended Posts

Machine learning course memo
[Memo] Machine learning
Machine learning
Practical machine learning system memo
<Course> Machine Learning Chapter 6: Algorithm 2 (k-means)
<Course> Machine Learning Chapter 7: Support Vector Machine
"Scraping & machine learning with Python" Learning memo
LPIC201 learning memo
Django Learning Memo
Machine learning classification
Machine Learning sample
Python & Machine Learning Study Memo: Environment Preparation
Machine learning beginners take Coursera's Deep learning course
<Course> Machine Learning Chapter 3: Logistic Regression Model
<Course> Machine Learning Chapter 1: Linear Regression Model
<Course> Machine learning Chapter 4: Principal component analysis
<Course> Machine Learning Chapter 2: Nonlinear Regression Model
Python & Machine Learning Study Memo ③: Neural Network
Python & Machine Learning Study Memo ④: Machine Learning by Backpropagation
Python & Machine Learning Study Memo ⑥: Number Recognition
Python module (Python learning memo ④)
About machine learning overfitting
Machine learning ⑤ AdaBoost Summary
Machine Learning: Supervised --AdaBoost
Machine learning logistic regression
Python & Machine Learning Study Memo ⑤: Classification of irises
Python & Machine Learning Study Memo ②: Introduction of Library
Machine learning support vector machine
Studying Machine Learning ~ matplotlib ~
Machine learning linear regression
Machine learning library dlib
Machine learning (TensorFlow) + Lotto 6
Somehow learn machine learning
Machine learning memo of a fledgling engineer Part 2
Python & Machine Learning Study Memo ⑦: Stock Price Forecast
Machine learning library Shogun
Machine learning rabbit challenge
Introduction to machine learning
Machine Learning: k-Nearest Neighbors
What is machine learning?
Python learning memo for machine learning by Chainer from Chapter 2
Python learning memo for machine learning by Chainer Chapters 1 and 2
Memo for building a machine learning environment using Python
Machine learning model considering maintainability
Machine learning learned with Pokemon
Data set for machine learning
Japanese preprocessing for machine learning
Python exception handling (Python learning memo ⑥)
Machine learning in Delemas (practice)
<Course> Deep Learning: Day2 CNN
Machine learning / classification related techniques
Machine Learning: Supervised --Linear Regression
Basics of Machine Learning (Notes)
Machine learning beginners tried RBM
[Machine learning] Understanding random forest
Machine learning with Python! Preparation
Machine Learning Study Resource Notepad
Machine learning ② Naive Bayes Summary
Understand machine learning ~ ridge regression ~.
Machine learning article summary (self-authored)
About machine learning mixed matrices