[PYTHON] I tried to predict the victory or defeat of the Premier League using the Qore SDK

Introduction

This is Qiita's first post. Since I am almost a beginner in data analysis, I think there are many mistakes, so please point out. This time, I used Qore SDK from Qauntum Core Co., Ltd.

How to use the Qore SDK is explained in the following article. The world of reservoir computing ~ with Qore ~ Introduction of Qore SDK and detection of arrhythmia with Qore

The content of the effort will be the prediction of victory or defeat in the Soccer Premier League. Specifically, it will be a task to predict the result of the match played in 2019-2020 using the data of 2010-2018.

The dataset was downloaded from the following site. http://football-data.co.uk/englandm.php

Data preprocessing

I posted all the datasets and pre-processing on GitHub, so please refer to this. https://github.com/obameyan/QoreSDK-Premire-League

Since it is difficult to describe all of the preprocessing here, only the data before preprocessing and the data after preprocessing are described. To briefly explain what I did, I converted the data so that it could be thrown into the Qore SDK as time series data, taking into consideration various factors such as the opponent team, the result of the match, the number of goals, the number of goals scored, and the hat trick.

The following is the data before preprocessing. (Display only part)

import pandas as pd

#Original data
raw_data = pd.read_csv('./data/PremierLeague/2018-19.csv') #Only a part is described
raw_data.head()

Next is the data after preprocessing. (Display only part)

import pandas as pd

#It is not the original data because it is in the middle of the data
data=pd.read_csv("./data/PremierLeague/allAtt_onehot_large_train.csv") #Training data
dataT=pd.read_csv("./data/PremierLeague/allAtt_onehot_large_test.csv") #test data

#Data after preprocessing
data = data[['HTGS','ATGS','HTP','ATP','HM1','AM1', 'DiffLP','final1']]
dataT = dataT[['HTGS','ATGS','HTP','ATP','HM1','AM1','DiffLP','final1']]
df = data[200:210]

Pretreatment with Qore SDK

Here, we will perform preprocessing using the Qore SDK. Specifically, use qore_sdk.utils.sliding_window () to convert the training data dimension to (number of data, time, actual data) and the correct label dimension to (number of data, 1).

from qore_sdk.utils import sliding_window

x = np.array(data)
x_t = np.array(dataT)

x_train = np.array(x[:, :7])
x_test = np.array(x_t[:, :7])
y_train = np.array(x[:, 7])
y_test = np.array(x_t[:, 7])

X, y= sliding_window(x_train, 10, 5, axis=0, y=y_train,y_def='mode', y_axis=0)
X_test, y_test = sliding_window(x_test, 10, 5, axis=0, y=y_test,y_def='mode', y_axis=0)
print(X.shape, y.shape, X_test.shape, y_test.shape)
>>  (653, 10, 7), (653, 1), (159, 10, 7), (159, 1)

Learning and prediction using the Qore SDK

Enter the account information issued here.

from qore_sdk.client import WebQoreClient

username = '*****'
password = '*****'
endpoint = '*****'

client = WebQoreClient(username, password, endpoint=endpoint)

Let's actually learn.

client.classifier_train(X, y)
>> {'res': 'ok', 'train_time': 0.8582723140716553}

I was able to learn in an instant. Next, check the accuracy using test data.

res = client.classifier_predict(X_test)
report = classification_report(y_test, res['Y'])
print(report)

              precision    recall  f1-score   support

         0.0       0.73      0.90      0.81       104
         1.0       0.68      0.38      0.49        55

   accuracy                            0.72       159
   macro avg       0.71      0.64      0.65       159
weighted avg       0.71      0.72      0.70       159

The accuracy was 72%. To be honest, it's a subtle accuracy, but I think this is a pre-processing problem ... I thought that the data should be inflated and the correlation should be considered more carefully before preprocessing ...

Summary

I wanted to do data analysis on a daily basis, but I couldn't do anything about it, but I am grateful to Quantum Core for giving me the opportunity to perform this kind of data analysis. I would also like to take this opportunity to continue taking on the challenge of data analysis.