[PYTHON] Notes on machine learning (updated from time to time)

Learning flow

  1. Determining the content of implementation

  2. Obtain data

  3. Data preprocessing

  4. Method selection

  5. Hyperparameter selection

  6. Model learning

  7. Model evaluation → Go to 3, 4, 5

Reasons to separate training data and test data

・ At the time of system release All the data you have may be used as training data

・ If you want to evaluate accuracy Separate training data and test data, and evaluate test data with a model learned only from training data

Because the purpose of supervised learning is to predict unknown data

Underfitting and overfitting

Insufficient conformity

・ The prediction accuracy is low even for training data.

Overfitting

・ It fits well with the training data, but the prediction accuracy for the test data (unknown data) is low.

The most difficult part of machine learning is how to strike a good balance between underfitting and overfitting.

Recommended Posts

Notes on machine learning (updated from time to time)
Machine learning python code summary (updated from time to time)
[Updated from time to time] PostmarketOS related notes
[Note] AI / machine learning / python related websites [updated from time to time]
progate Python learning memo (updated from time to time)
vtkXMLUnstructuredGridReader Summary (updated from time to time)
vtkOpenFOAMReader Summary (Updated from time to time)
Engineer vocabulary (updated from time to time)
Tensorflow memo [updated from time to time]
Private Python handbook (updated from time to time)
Notes on running Azure Machine Learning locally
vtkClipPolyData / DataSet Summary (Updated from time to time)
Summary of vtkThreshold (updated from time to time)
[Updated from time to time] LetCode algorithm and library
Machine learning algorithms (from two-class classification to multi-class classification)
OpenFOAM post-processing cheat sheet (updated from time to time)
Useful help sites, etc. (updated from time to time)
Introduction to machine learning
Apache settings, log confirmation, etc. (* Updated from time to time)
[Updated from time to time] Review of Let Code NumPy
Notes on upgrading discord.py from async to rewrite version
I read the Chainer reference (updated from time to time)
An introduction to machine learning from a simple perceptron
An introduction to machine learning
Basics of Machine Learning (Notes)
Anaconda updated from 4.2.0 to 4.3.0 (python3.5 updated to python3.6)
(Updated from time to time) Summary of machine learning APIs that allow you to quickly build apps by Team AI
Super introduction to machine learning
[Updated from time to time] Summary of design patterns in Java
Introduction to machine learning Note writing
[Machine learning] Understanding uncorrelatedness from mathematics
Notes on how to use featuretools
Python (from first time to execution)
Introduction to Machine Learning Library SHOGUN
Notes on accessing dashDB from python
Notes on how to use doctest
Notes on how to write requirements.txt
How to collect machine learning data
Update Python on Mac from 2 to 3
[Machine learning] Understand from mathematics why the correlation coefficient ranges from -1 to 1.
Newton's method for machine learning (from one variable to multiple variables)
Summary of folders where Ruby, Python, PostgreSQL, etc. are installed on macOS (updated from time to time)
Introduction to Machine Learning: How Models Work
scikit-learn How to use summary (machine learning)
Reinforcement learning to learn from zero to deep
Record the steps to understand machine learning
Aiming to become a machine learning engineer from sales positions using MOOCs
Use machine learning APIs A3RT from Python
Learning notes from the beginning of Python 1
I installed Python 3.5.1 to study machine learning
Easy conversion from UTC to local time
Machine learning
Connecting from python to MySQL on CentOS 6.4
I tried to classify guitar chords in real time using machine learning
Personal notes and links about machine learning ① (Machine learning)
Introduction to ClearML-Easy to manage machine learning experiments-
Image alignment: from SIFT to deep learning
Machine learning with Pytorch on Google Colab
How to enjoy Coursera / Machine Learning (Week 10)
An introduction to Python for machine learning
Learning notes from the beginning of Python 2