This time, I set and learned Python learning as an internal goal.
I was curious about scraping technology, so I will summarize it.
Scraping is a technology that extracts arbitrary information from a website.
By scraping, information on the web is automatically collected.
However, it does not mean that any information published on the web can be stored in the database.
It is equipped with the following technologies.
-Change the format to store in the database ・ Structural analysis of the site to eliminate unnecessary information such as advertisements and extract necessary information ・ Technology to access pages that require login
Recommended Posts