[PYTHON] Launching a machine learning environment using Google Compute Engine (GCE)

Thing you want to do

I started to feel the limits of doing machine learning on my Windows PC, so I wanted to transfer it to the cloud and use various software and libraries freely with high performance and Linux, so I was able to do it for the time being while researching various things. Instead of a memorandum for the time being.

 Since I want to do it on Google Cloud Platform because I use Big Query (BQ), the cloud uses GCE as the title suggests.

 I've been using Jupyter Notebook since I was doing it on Windows, so I want to use it in the cloud as well.
 But with Google Cloud Datalab, Python is hard to use in 2.x. .. .. So I decided to put Jupyter Notebook on GCE.

Launching GCE environment

https://console.cloud.google.com/compute/　 Go to "VM Instance> Create Instance"

 It's very easy to do. The points to note are as follows

 -The default boot disk is Debian, so change to Ubuntu 16.04 LTS
 -CPU / memory seems to be adjustable later, so it's appropriate
 -Allow HTTP / HTTPS traffic because I want to access it with Jupyter Notebook
 -Set up a firewall as well

After that, start the instance and select "Connect"> "Open in browser window" to make an SSH connection.

Installed software libraries

For the time being, so that you can use Jupyter Notebook & machine learning. The rest is a library for connecting to BigQuery.

Access from Jupyter notebook

From the command line, just do the following (Port should be set by firewall)

jupyter notebook --ip=0.0.0.0 --port=8888 --no-browser

After that, if you access with ip: port, you will reach the usual Jupyter Notebook screen. It seems that you can also set token and password.

Referenced site

[Set up Anaconda + IPython + Tensorflow + Julia on a Google Compute Engine VM] (https://haroldsoh.com/2016/04/28/set-up-anaconda-ipython-tensorflow-julia-on-a-google-compute-engine-vm/)

Recommended Posts

Launching a machine learning environment using Google Compute Engine (GCE)
Build a machine learning environment
Memo for building a machine learning environment using Python
Build a Python execution environment using GPU with GCP Compute engine
Creating a development environment for machine learning
[Detailed version] Creating a comfortable Python environment with Google Compute Engine (Ubuntu 16.04)
A story about simple machine learning using TensorFlow
Build a Python machine learning environment with a container
Until launching a boat race triple prediction site using machine learning and Flask
Build a machine learning Python environment on Mac OS
Installation of TensorFlow, a machine learning library from Google
Build a machine learning application development environment with Python
Create a machine learning environment from scratch with Winsows 10
Build a machine learning environment natively on Windows 10 (x64)
How to set up a Google Colab environment with Coursera's advanced machine learning courses
Build a machine learning environment using PyCharm on Ubuntu environment (TensorFlow will also be introduced!)
How to quickly create a machine learning environment using Jupyter Notebook with UbuntuServer 16.04 LTS
Build a python machine learning study environment on macOS sierra
Build a machine learning environment on mac (pyenv, deeplearning, opencv)
Build an environment for machine learning using Python on MacOSX
Build a machine learning scikit-learn environment with VirtualBox and Ubuntu
I tried using Tensorboard, a visualization tool for machine learning
Machine learning environment construction macbook 2021
Build a PyData environment for a machine learning study session (January 2017)
How to quickly create a machine learning environment using Jupyter Notebook on macOS Sierra with anaconda
[Tutorial] Make a named entity extractor in 30 minutes using machine learning
How about Anaconda for building a machine learning environment in Python?
Building a Windows 7 environment for getting started with machine learning with Python
Perform morphological analysis in the machine learning environment launched by GCE
Building a development environment with Maven on Google App Engine [Java]
Using properties files with Flexible Environment Java 8 on Google App Engine
Build a go environment using Docker
Inversely analyze a machine learning model
Creating a learning model using MNIST
Application development using Azure Machine Learning
[Definitive Edition] Building an environment for learning "machine learning" using Python on Windows
Aiming to become a machine learning engineer from sales positions using MOOCs
[Definitive Edition] Building an environment for learning "machine learning" using Python on Mac
Building a machine learning environment with Tellus GPU server (Sakura high-power computing)
Python & Machine Learning Study Memo: Environment Preparation
Stock price forecast using machine learning (scikit-learn)
[Machine learning] LDA topic classification using scikit-learn
Building a virtual environment using homebrew + pyenv-virtualenv
[Machine learning] FX prediction using decision trees
A story about machine learning with Kyasuket
pyenv-Building a pypy environment using virtualenv (MacOSX)
[Python] Create a Batch environment using AWS-CDK
[Machine learning] Supervised learning using kernel density estimation
Python and machine learning environment construction (macOS)
Machine learning with Pytorch on Google Colab
Stock price forecast using machine learning (regression)
Build AI / machine learning environment with Python
[Machine learning] Regression analysis using scikit learn
[Super Introduction] Machine learning using Python-From environment construction to implementation of simple perceptron-
Creating a position estimation model for the Werewolf Intelligence Tournament using machine learning
A memorandum of method often used in machine learning using scikit-learn (for beginners)