[PYTHON] A memo on how to overcome the difficult problem of capturing FX with AI

Consideration about exchange rate forecasts

We have started a semi-AI trading plan to recover the money lost in Forex.

FX market forecast problem

--The foreign exchange market is not a linear problem. Only simple parameters can be defined --If there are few explanatory variables, you can never make a highly versatile model. —— Due to the nature of the market, the overall market environment is different, so the same input can produce different results. ――This is something that computers are not particularly good at --Computers cannot understand abstract concepts like "behavior" and "market" --Even computers that play world-class chess don't even know what the actual chess is. --So the computer just knows how to win --Time-dependent and non-deterministic exchange rates are difficult for machine learning systems --You need to understand the market situation essentially ――Live trading is quite difficult considering the time required for learning and verification. --It doesn't make sense to simply build a model based on your ability to make accurate predictions (up or down) --99 small decisions can be wiped out by one big decision --To avoid this problem, use a method of retraining machine learning algorithms.

How to avoid the FX market forecast problem

① By using a flexible window, the selection bias associated with the in-sample / out-of-sample set is reduced. (2) The training will be a series of verification exercises so that the machine learning algorithm will always function properly even if the data sets are significantly different. In the process of establishing the true value and method of an algorithm, measuring backtesting performance should also be considered important.

――This approach is not fail-safe (always safe control) --Biased curve fitting (overfitting) and data mining (knowledge extraction technology) --To mitigate this, we used a huge dataset, performed a large number of data mining bias evaluation tests, and It is important to eliminate the possibility of accidental promising results (creating a semi-perfect market situation algorithm)

③ Based on the above, can you grasp the current market in real time and increase the chances of success with customizable algorithms? May

Conclusion

Currently under consideration, conclusions will be drawn soon

Recommended Posts

A memo on how to overcome the difficult problem of capturing FX with AI
How to run the practice code of the book "Creating a profitable AI with Python" on Google Colaboratory
A story about how to deal with the CORS problem
How to customize U-Boot with OSD335X on a custom board (memo)
[Introduction to Python] How to sort the contents of a list efficiently with list sort
How to publish a blog on Amazon S3 with the static Blog engine'Pelican'for Pythonista
How to access the contents of a Linux disk on a Mac (but read-only)
Checklist on how to avoid turning the elements of numpy's array with for
How to get a list of files in the same directory with python
[Introduction to Python] How to get the index of data with a for statement
A memo connected to HiveServer2 of EMR with python
A memo of how to use AIST supercomputer ABCI
A memo to visually understand the axis of pandas.Panel
How to operate Firefox with selenium on Windows Memo
How to set a shared folder with the host OS in CentOS7 on VirtualBOX
A memo of misunderstanding when trying to load the entire self-made module with Python3
The 15th offline real-time I tried to solve the problem of how to write with python
[Ubuntu] How to delete the entire contents of a directory
A memo on how to easily prepare a Linux exercise environment
Memo to get the value on the html-javascript side with jupyter
Finding a solution to the N-Queen problem with a genetic algorithm (2)
How to develop in a virtual environment of Python [Memo]
How to display a list of installable versions with pyenv
How to register a package on PyPI (as of September 2017)
How to find the scaling factor of a biorthogonal wavelet
Finding a solution to the N-Queen problem with a genetic algorithm (1)
How to connect the contents of a list into a string
How to deal with the problem that pandas 1.1.0 or later build fails on Alpine Linux
How to write offline real time I tried to solve the problem of F02 with Python
How to know the number of GPUs from python ~ Notes on using multiprocessing with pytorch ~
How to easily draw the structure of a neural network on Google Colaboratory using "convnet-drawer"
How to plot a lot of legends by changing the color of the graph continuously with matplotlib
How to insert a specific process at the start and end of spider with scrapy
A person who wants to clear the D problem with ABC of AtCoder tried to scratch
A memo that reproduces the slide show (gadget) of Windows 7 on Windows 10.
How to determine the existence of a selenium element in Python
A note on how to check the connection to the license server port
[Introduction to Python] How to split a character string with the split function
How to get the ID of Type2Tag NXP NTAG213 with nfcpy
How to send a file in one shot by connecting to a host on the other side of the platform with SCP in multiple stages
How easy is it to synthesize a drug on the market?
[Introduction to StyleGAN] I played with "The Life of a Man" ♬
Try to solve the N Queens problem with SA of PyQUBO
Here's a brief summary of how to get started with Django
For those of you who don't know how to set a password with Jupyter on Docker
[Memo] How to use BeautifulSoup4 (2) Display the article headline with Requests
How to check the memory size of a dictionary in Python
How to find the memory address of a Pandas dataframe value
How to use Jupyter on the front end of supercomputer ITO
I wanted to solve the ABC164 A ~ D problem with Python
How to display the CPU usage, pod name, and IP address of a pod created with Kubernetes
A command to easily check the speed of the network on the console
Node.js: How to kill offspring of a process started with child_process.fork ()
How to intercept or tamper with the SSL communication of the actual iOS device by a proxy
How to update the python version of Cloud Shell on GCP
[Memo] How to use BeautifulSoup4 (3) Display the article headline with class_
How to send a request to the DMM (FANZA) API with python
[NNabla] How to remove the middle tier of a pre-built network
I want to solve the problem of memory leak when outputting a large number of images with Matplotlib
Upload data to s3 of aws with a command and update it, and delete the used data (on the way)
The 16th offline real-time how to write problem was solved with Python