[PYTHON] Machine learning and mathematical optimization

Machine learning and mathematical optimization

"I want to make a ** demand forecast ** for each convenience store x product." → Machine learning / statistical modeling-like story Prediction and elucidation of phenomena

"I want to maximize profits ** based on demand forecasts for each convenience store x product." → Mathematical optimization-like story Maximize profits (maximize / minimize KPIs after the phenomenon is elucidated)

Between machine learning and mathematical optimization: There is also the BanBit problem (reinforcement learning)

Decision-making steps and analytics reach

There are various levels of data science / AI / analytics

Decision-making steps ① Aggregation (what will happen) ② Explanation (why it happened) ③ Prediction (what will happen) ④ Decision making (what to do) ⑤ Action (actual action)

Achievement stage of analytics ① Descriptive analytics ② Diagnostic analytics ③ Predictive analytics ④ Prescription analytics (decision support by AI) ⑤ Prescription analytics (decision-making by AI)

Typically ① Aggregation (what happens) DWH / BI tool ① Descriptive analytics

Opportunity learning / statistical analysis performs (2) explanation (why it happened) and (3) prediction (what happens) ① Descriptive analytics ② Diagnostic analytics ③ Predictive analytics

④ Make decisions (what to do) and ⑤ Actions (actual actions) by mathematical optimization ① Descriptive analytics ② Diagnostic analytics ③ Predictive analytics ④ Prescription analytics (decision support by AI) ⑤ Prescription analytics (decision-making by AI)

Machine learning vs mathematical optimization

task Input to the system System mechanism System output Typical technology
Forecast / estimation ⭕️ Unknown → estimated ⭕️ Machine learning / statistics
optimisation The best one is unknown → Search ⭕️ I want to minimize / maximize 数理optimisation

How much can you do?

Description Forecast Decision support Decision making
Stock Trading (DayTrading) ○(HFT)
Supermarket purchasing plan ○ (Demand forecast) ○ (optimal purchasing)
Rental of construction equipment ○ (Demand forecast) ○ (Optimization of equipment deployment between branches) ○/?(Conflict of incentives between branches)
Commodity trade ○ (Price forecast) ○ (Suggestion of trading timing) ?? (Evaluation of political risk)
Agriculture ○ (Harvest forecast) ○(Fertilizer optimization)/?(sales plan)
M&A ?? (High individuality) ? ?

Prone to issue / operation dependence

Examples of problems that can be solved by mathematical optimization

・ Advertising allocation problem → Maximizing advertising effectiveness (CVR / CTR) ・ Vehicle delivery planning → (weight of one package, optimal route, etc.) ・ Factory production plan → Adjustment of raw materials and production volume ・ Cooperation with other factories, etc. ・ Administrative facility placement problem → (school, etc.) ・ War → (Efficient attack) ・ Portfolio → (Balance of risk / return ・ Risk can be reduced even with the same return) ・ Shift creation → (Adjustment of roles and burdens)

reference

DWH and BI tools   https://it-trend.jp/bi/article/bi_dwh

python3   numpy pulp

How to study About 50 optimization problems for application (book)

Recommended Posts

Machine learning and mathematical optimization
Machine learning
Significance of machine learning and mini-batch learning
Organize machine learning and deep learning platforms
Mathematical optimization RPG
[Machine learning] OOB (Out-Of-Bag) and its ratio
Personal notes and links about machine learning ① (Machine learning)
Python and machine learning environment construction (macOS)
[Memo] Machine learning
Machine learning classification
"OpenCV-Python Tutorials" and "Practical Machine Learning System"
Machine Learning sample
Summary of mathematical scope and learning resources required for machine learning and data science
Study machine learning and computer science. Resource list
Numerai Tournament-Fusion of Traditional Quants and Machine Learning-
[2nd] Learning typical problems-Study materials for learning mathematical optimization
Machine learning Training data division and learning / prediction / verification
About machine learning overfitting
Machine learning ⑤ AdaBoost Summary
Machine Learning: Supervised --AdaBoost
Machine learning logistic regression
Machine learning support vector machine
Studying Machine Learning ~ matplotlib ~
Machine learning linear regression
Machine learning library dlib
Machine learning (TensorFlow) + Lotto 6
Somehow learn machine learning
Machine learning library Shogun
Machine learning rabbit challenge
Introduction to machine learning
Machine Learning: k-Nearest Neighbors
What is machine learning?
"Apache Flink" new machine learning interface and Flink-Python module
[Machine learning] Understanding SVM from both scikit-learn and mathematics
Easy machine learning with scikit-learn and flask ✕ Web app
Python learning memo for machine learning by Chainer Chapters 1 and 2
Machine learning #k-nearest neighbor method and its implementation and various
Artificial intelligence, machine learning, deep learning to implement and understand
Practical machine learning with Scikit-Learn and TensorFlow-TensorFlow gave up-
[Part 1] What is optimization? --Study materials for learning mathematical optimization
Set up python and machine learning libraries on Ubuntu
[Machine learning] Start Spark with iPython Notebook and try MLlib
Machine learning model considering maintainability
Machine learning learned with Pokemon
Data set for machine learning
Japanese preprocessing for machine learning
Machine learning in Delemas (practice)
Ensemble learning and basket analysis
Machine learning / classification related techniques
Machine Learning: Supervised --Linear Regression
Music and Machine Learning Preprocessing MFCC ~ Mel Frequency Cepstrum Coefficient
Introduction to Machine Learning with scikit-learn-From data acquisition to parameter optimization
Build a machine learning scikit-learn environment with VirtualBox and Ubuntu
Basics of Machine Learning (Notes)
Machine learning beginners tried RBM
[Machine learning] Understanding decision trees from both scikit-learn and mathematics
[Machine learning] Understanding random forest
Machine learning with Python! Preparation
Machine Learning Study Resource Notepad
Machine learning ② Naive Bayes Summary
Personal memos and links related to machine learning ③ (BI / Visualization)