Get images of great find / 47 sites using Python (Part 2/2: I published the target list on github)

Postscript after publication of the article

As a skeleton, I uploaded an empty folder under jpg to the github repository by region (region)-by prefecture (2020/11/3, 11:30). I think this saved me a little time.

In response to the previous article

In response to previous article, the target list has been released on github. We decided that it would be better for us to obtain and publish the script as a reference rather than to publish the script and increase the access to find / 47 unnecessarily. The image is not an open post but a screening method, and 1080 images seems to have settled down once, so this should be enough for the time being.

File description

I think 02.csv is easy to write a simple script and get an image.

--First column: Download destination (acquisition source) URL --Second column: Specifying example when saving the download zip file by region and prefecture in the jpg directory directly under (a faithful reproduction of the find / 47 hierarchy. I prepared a skeleton in the github repository, so if you don't mind Please use)

01.csv is the prototype of 02.csv. This is the output of the previous article.

--First column: Regional classification code used by find / 47. 0 is Hokkaido, 7 is Kyushu Okinawa --Second column: State code used by find / 47. 0 is Hokkaido, 46 is Okinawa --Third column: Distinguished name uniquely given to the image by find / 47 --Column 4: Maximum size offered (downloadable) of xl, l, m, s. If you don't need up to xl and want to save storage space, change this to s. After a quick look, size s and size m seem to be provided in all images. Some images of size l are not provided (although some).

For wallpaper purposes, it is recommended to get it step by step for each region or prefecture, or to get only the index line of the specified integer multiple by FizzBuzz.

So far, it was a simple explanation that only those who can see the contents of the CSV file and this explanation and the implementation of image acquisition can use it. Thank you for your understanding.

Precautions

If you use 02.csv to acquire images as they are, 1080 images will be obtained at the maximum resolution (mostly XL) that can be acquired for each image. The required storage capacity in this case is around 10GB or more. The downloaded zip file contains the image jpeg file and the description txt file, and even if you delete the original zip and txt and leave only the jpeg, you will need about 10GB. Also, if I put enough access weights to get all 1080 images, it took one night (about 8-10 hours) to complete in my operation. The image is for reference of the file name and size as it is taken out from the zip. image.png

Supplement

We will check the latest status from time to time to see if it has increased from 1080, and will update the list on github. Also, with the next 2+ articles as the final episode, I will briefly touch on the setting to automatically change the wallpaper using variety.

Recommended Posts

Get images of great find / 47 sites using Python (Part 2/2: I published the target list on github)
Get images of great find / 47 sites using Python (1/2: until target list creation)
[Python] I wrote the route of the typhoon on the map using folium
Find the geometric mean of n! Using Python
Explanation of the concept of regression analysis using python Part 2
Cut a part of the string using a Python slice
[python] Get the list of classes defined in the module
Explanation of the concept of regression analysis using Python Part 1
[Python] Get the list of ExifTags names of Pillow library
I tried to find the entropy of the image with python
Try to get the function list of Python> os package
Since Python 1.5 of Discord, I can't get a list of members
[Python] I tried collecting data using the API of wikipedia
[Python3] List of sites that I referred to when I started Python
Let's measure the test coverage of pushed python code on GitHub.
I tried using the COTOHA API (there is code on GitHub)
I studied with Kaggle Start Book on the subject of kaggle [Part 1]
[python] Get the rank of the values in List in ascending / descending order
I tried to get a list of AMI Names using Boto3
Get and set the value of the dropdown menu using Python and Selenium
Get the number of readers of a treatise on Mendeley in Python
A super introduction to Django by Python beginners! Part 2 I tried using the convenient functions of the template
About the basics list of Python basics
Get the width of the div on the server side with Selenium + PhantomJS + Python
I tried to get the batting results of Hachinai using image processing
I measured 6 methods to get the index of the maximum value (minimum value) of the list
I tried to get the authentication code of Qiita API with Python.
Download all the images attached to the body of the pull request on Github
Get the list of packages for the specified user from the packages registered on PyPI
Get and estimate the shape of the head using Dlib and OpenCV with python
I measured the speed of list comprehension, for and while with python2.7.
Get the column list & data list of CASTable
I didn't know the basics of Python
[python] Get a list of instance variables
The Python project template I think of.
Study on Tokyo Rent Using Python (3-1 of 3)
[Python] Get the character code of the file
Get the EDINET code list in Python
[Python] Get a list of folders only
Get rid of DICOM images in Python
[Python] I tried to judge the member image of the idol group using Keras
[Circuit x Python] How to find the transfer function of a circuit using Lcapy
I want to use Python in the environment of pyenv + pipenv on Windows 10
I installed Pygame with Python 3.5.1 in the environment of pyenv on OS X
Get the size of the image file on the web (Python3, no additional library required)
Visualize the timeline of the number of issues on GitHub assigned to you in Python
Python script to get a list of input examples for the AtCoder contest
I made a script to record the active window using win32gui of Python
How to get a list of files in the same directory with python