[PYTHON] The story of creating a site that lists the release dates of books

The source code is posted on Github

The other day, I released a site called "HonBa ~ Book Search ~", so let's look back on the site production and find improvements! Yeah! Something (?)

What I used this time

．python (beautifulSoup4 selenium)

. TypeScript

・ HTML

・ SCSS

Rough flow of the site

Scraping information with python, exporting with CSV

↓

Arrange CSV data with TypeScript and generate a table

What I used to implement the function, but I stumbled during the completion and implementation

TypeScript

TypeScript was convenient after all. However, to be honest, I wondered if I wouldn't force myself to use it for personal development of this scale.

Document.getElementbyId in TypeScript

When you want to use TypeScript I found some articles that said, "If you add a mold to the JS that you have already made, it's OK!"

the property ‘hoge' does not exist on value of type 'htmlelement'

For details, this article was easy to understand. https://qiita.com/Sekky0905/items/a88721f2af41050c93f2

SCSS This was extremely convenient. I want to continue using it from now on. The main points that I found useful were ・ Programming language-like block description is possible

-You can import another file and output it as one CSS.

It is two points. When importing another file, it was convenient to make Header and Footer another file.

Impressions and improvements

To be honest, scraping python took the most time, but it was a lot of fun. After all it is fun to develop something

As an improvement point ・ I got it in CSV, but should I use it as a DB (please tell me the details)

・ I think it would be even better if we created a function to delay notifications in Slack, LINE, etc.

・ I want to automatically schedule scraping in Python.

I think these three.

Recommended Posts

The story of creating a site that lists the release dates of books
A story that reduces the effort of operation / maintenance
The story of Django creating a library that might be a little more useful
A story that analyzed the delivery of Nico Nama.
The story of creating a VIP channel for in-house chatwork
The story of creating a database using the Google Analytics API
The story of writing a program
A story that struggled to handle the Python package of PocketSphinx
The story of the release work of the application that Google does not tell
The story of making a module that skips mail with python
The story of blackjack A processing (python)
The story of making a tool that runs on Mac and Windows at the game development site
The story of creating a bot that displays active members in a specific channel of slack with python
A story that visualizes the present of Qiita with Qiita API + Elasticsearch + Kibana
The story of developing a web application that automatically generates catchphrases [MeCab]
The story of making a package that speeds up the operation of Juman (Juman ++) & KNP
A story about creating a program that will increase the number of Instagram followers from 0 to 700 in a week
One liner that lists the colors of matplotlib
The story of making a lie news generator
A story of creating 16 * 16 dots from a Digimon photo
The story of making a mel icon generator
The story of creating (probably) the smallest skill that implements personalization and in-skill billing
The story of IPv6 address that I want to keep at a minimum
The story of making a box that interconnects Pepper's AL Memory and MQTT
The story of making a web application that records extensive reading with Django
The story of making a Line Bot that tells us the schedule of competitive programming
The story of creating Botonyan that returns the contents of Google Docs in response to a specific keyword on Slack
The story of launching a Minecraft server from Discord
[Python] A program that counts the number of valleys
Make a BOT that shortens the URL of Discord
# Function that returns the character code of a string
The story of making a music generation neural network
A story that struggled with the common set HTTP_PROXY = ~
The story of sys.path.append ()
Generate that shape of the bottom of a PET bottle
Super simple: A collection of shells that output dates
A story about changing the master name of BlueZ
The story that the return value of tape.gradient () was None
Zip 4 Gbyte problem is a story of the past
[Python] A program that compares the positions of kangaroos.
Now in Singapore The story of creating a LineBot and wanting to do a memorable job
Creating a Python script that supports the e-Stat API (ver.2)
The story of making a question box bot with discord.py
A Python script that compares the contents of two directories
The story of building Zabbix 4.4
[Apache] The story of prefork
I tried to make a site that makes it easy to see the update information of Azure
Let's summarize the basic functions of TensorFlow by creating a neural network that learns XOR gates
A story that verified whether the number of coronas is really increasing rapidly among young people
A story that is a little addicted to the authority of the directory specified by expdp (for beginners)
A memo that reproduces the slide show (gadget) of Windows 7 on Windows 10.
When incrementing the value of a key that does not exist
A story stuck with the installation of the machine learning library JAX
The story that the version of python 3.7.7 was not adapted to Heroku
pandas Fetch the name of a column that contains a specific character
The story that a hash error came out when using Pipenv
A formula that simply calculates the age from the date of birth
The story of making a standard driver for db with python.
A function that measures the processing time of a method in python
I made a slack bot that notifies me of the temperature
A story that supports electronic scoring of exams with image recognition