[PYTHON] Easily build a GCP environment for Kaggle at high speed

Great features have been added to GCP

Previously, I wrote an article Building a GCP environment for Kaggle easily. This time, I found an easier way to build it, so I'll write it as an improved version of the previous article. スクリーンショット 2019-12-18 1.54.25.png A function called a notebook has been added to the lower AI platform. What this is is that you can get it ready to use without having to do the work of getting the jupyter notebook introduced in the previous article. To be precise, Jupyter Lab will be launched, but if you have used jupyter notebook, you will soon be familiar with it.

About how to use

You can set up an instance by pressing the button called New Instance at the top. This instance seems to be shared with GCE. スクリーンショット 2019-12-18 1.58.29.png In this environment, you can select the framework you want to use and set up the execution environment as easily as the Deep learning VM.

After setting up the instance, click Open JUPYTER LAB. スクリーンショット 2019-12-18 2.06.04.png If you select Notebook here, jupyter notebook will be launched. It's really easy, isn't it: smiley:

After that, you can enter commands from Terminal, and you can also create a Python file from Text File and rename it to .py without any problem.

As for files, the GUI is maintained so you can easily upload and download them.

in conclusion

With this feature implemented, it's much easier to create a computational environment on GCP. Recently, Kaggle's Kernel has strict usage restrictions, so I think that many people are using Google Colab, but since you can get a coupon for 30,000 yen, I think it's a good idea to take this opportunity to get started with GCP. I will. If you have any questions, please feel free to comment. P.S I'm currently using this feature in a competition, but apparently there's a problem handling large files. For example, if you try to download a heavy file from Jupyter lab, it will download a clearly smaller file, or if you try to pip install PyTorch, it will stop halfway. The workaround is to use gsutil to write to storage or create an instance with PyTorch from the beginning ... I look forward to future improvements!

Recommended Posts

Easily build a GCP environment for Kaggle at high speed
Easily build a development environment with Laragon
Create a Python development environment locally at the fastest speed (for beginners)
[Mac] Build a Python 3.x environment at the fastest speed using Docker
Build a Kubernetes environment for development on Ubuntu
Build a mruby development environment for ESP32 (Linux)
Build a python environment for each directory with pyenv-virtualenv
I want to easily build a model-based development environment
How to build a development environment for TensorFlow (1.0.0) (Mac)
Build a Django environment for Win10 (with virtual space)
[Memo] Build a development environment for Django + Nuxt.js with Docker
Build a web API server at explosive speed using hug
Build a LAMP environment [CentOS 7]
Build a machine learning environment
Build GPU environment with GCP and kaggle official image (docker)
Build a Python environment offline
Build a Flask development environment at low cost using Docker
Build a PyData environment for a machine learning study session (January 2017)
Build a python environment on CentOS 7.7 for your home server
Build and test a CI environment for multiple versions of Python
Build a local development environment for Lambda + Python using Serverless Framework
Make a rain notification bot for Hangouts Chat at explosive speed
Try using virtualenv, which can build a virtual environment for Python
Build a Python execution environment using GPU with GCP Compute engine
[DynamoDB] [Docker] Build a development environment for DynamoDB and Django with docker-compose
A script that downloads AWS RDS log files at high speed
Build a go environment using Docker
Build a python3 environment on CentOS7
Build a version control environment for Python, Ruby, Perl, Node.js on UNIX
Quickly build a python environment for deep learning and data science (Windows)
[BigQuery] Load a part of BQ data into pandas at high speed
How to build a sphinx translation environment
Build a python environment on MacOS (Catallina)
Build a Tensorflow environment with Raspberry Pi [2020]
Let's create a virtual environment for Python
Build a TOP screen for Django users
I want to build a Python environment
Build a Fast API environment with docker-compose
[Mac] Building a virtual environment for Python
[Linux] Build a jenkins environment with Docker
A tool for easily entering Python code
Building a conda environment for ROS users
Build a python virtual environment with pyenv
Build a Python + OpenCV environment on Cloud9
Build a modern Python environment with Neovim
Building a Python development environment for AI development
Creating a development environment for machine learning
[Linux] Build a Docker environment with Amazon Linux 2
A small story that outputs table data in CSV format at high speed
Build a local development environment with WSL + Docker Desktop for Windows + docker-lambda + Python
I built an AWS Chalice development environment with docker and tried deploying a serverless application at super high speed