[PYTHON] Environment construction: GCP + Docker

Environment construction memorandum

Set up a container on GCP and build an analysis environment. I don't know yet, but I will summarize how I made it for myself.

About GCP

Please read the following article about GCP because it is very well organized. I read up to the third part of this series to get a general idea of what it looks like. [[Introduction to GCP, Part 1] Must-read for engineers! What is Google Cloud Platform (GCP) that I can't ask you anymore? ] 1

Account creation is described in Part 2. [[Introduction to GCP, Part 2] First, start here! Preparation for Google Cloud Platform (GCP)! ] 2

Description of GCE [[Introduction to GCP, Part 3] Not difficult! How to launch an instance on Google Compute Engine (GCE)! ] 3

GCE instance creation

[Building a calculation environment for Kaggle with GCP and Docker] 4 [Building a GPU environment for Kaggle with GCP + Docker] 5 I mainly referred to 2 articles, but I couldn't find the Deep Learning VM. I created a normal instance.

The following items were tampered with on the GCE instance creation screen --Machine type 8vCPU

Note: If you use GPU, you need to edit the assignment. [Questions about editing assignments] 6 -> [Launch a GCP Deep Learning VM instance] 7 We will respond within 2 business days after you apply! I got an email saying that, but it was within the day.

You can use Pytorch NVIDIA GPU Notebook with MaketPlace.

Connect to your instance from the Cloud SDK

This was also referred to the article in the previous section. In addition, I also referred to [Introduction article: Jupyter analysis environment created by GCE (Google Compute Engine)] 8 Jupyter environment construction (Docker).

Check access information [here] 9 For instance firewall settings [here] 10

End of construction

This puts it in the rest of 100 language processing knocks.

Task

--Being able to write a Dockerfile that has been downloaded --Deep Learning VM could not be found --I was going to check the GPU with torch, but I forgot (at the moment)

Recommended Posts

Environment construction: GCP + Docker
Docker + Django + React environment construction
[Linux] Docker environment construction on Redhat
Data science environment construction with Docker
[docker] python3.5 + numpy + matplotlib environment construction
Django environment construction
Emacs-based environment construction
Linux environment construction
Python environment construction
Environment construction (python)
django environment construction
CodeIgniter environment construction
python environment construction
Python --Environment construction
Python environment construction
Golang environment construction
python environment construction
Word2vec environment construction
Analytical environment construction with Docker (jupyter notebook + PostgreSQL)
Django project environment construction
python windows environment construction
Go language environment construction
ConoHa environment construction memo
homebrew python environment construction
PyData related environment construction
Anaconda-4.2.0-python3 environment construction (Mac)
Python development environment construction
YOLO v4 environment construction ①
Pillow environment construction --For Docker + iPython (and OpenCV)
pyenv + fish environment construction
python2.7 development environment construction
BigGorilla environment construction memo
grip environment construction onCentOS6.5
Anaconda environment construction memo
Golang environment construction [goenv]
Mac environment construction Python
Docker under proxy environment
Pyxel environment construction (Mac)
Python environment construction @ Win7
Virtual environment construction with Docker + Flask (Python) + Jupyter notebook
[Python] OpenCV environment construction with Docker (cv2.imshow () also works)
From Kafka to KSQL --Easy environment construction with docker
WSL2 environment construction example Python, Node.js, Java, git-secrets, Docker
Pepper-kun remote control environment construction with Docker + IPython Notebook
Python + Anaconda + Pycharm environment construction
About Linux environment construction (CentOS)
PyTorch C ++ (LibTorch) environment construction
Anaconda environment construction on CentOS7
Django development environment construction memo
First LAMP environment construction (Linux)
Python environment construction (Windows10 + Emacs)
CI environment construction ~ Python edition ~
[Memo] Construction of cygwin environment
ML environment construction with Miniconda
Python environment construction For Mac
Anaconda3 python environment construction procedure
Anaconda3 × Pycharm environment construction memo
Prepare python3 environment with Docker
Python3 environment construction (for beginners)
Python environment construction and TensorFlow
NumPy and matplotlib environment construction