| Applicable chapter | Chapter 3: Society Supported by Information Systems |
|---|---|
| Applicable section | Network crimes |
| Information gathering and research | |
| To | Think about the advantages and disadvantages of the technology called "web scraping" from the user's point of view |
In this class, A to C will be used to evaluate individual lessons.
| Correspondence according to grades and A achievement requirements | |
|---|---|
| Student requirements for A | You will be able to explain what each line of code used in this class is doing, and you will be able to scrape other sites. You can also use web scraping based on the site rules and the correct usage of the API. |
| Support for C students | Assists in understanding line by line of the code used in this class. We will support you until you know the dangers of web scraping and can explain how to use it properly according to your website. |
What kind of technology is web scraping? Let's also list the advantages and disadvantages.
======= (shared in class) ========
Let's try the web scraping code actually written in python and see what value is returned.
What kind of tag information (li tag, img tag, etc.) ** would you like to extract ** from what site ** and ** with this web scraping? ??
――I wish I could scrape instagram and extract photos of individual users ... ――I wish I could scrape Twitter and Facebook to extract individual user posts ... ――I want to scrape a company's Tech blog, extract titles, and deepen my knowledge from the wording ...
Nowadays, there are more things I want to do with web scraping.
Since it is a technology that makes it easy to access personal information, SNS such as Instagram has established rules regarding scraping and API usage.
Choose three large social networking sites like instagram and Twitter, and survey the wording of the scraping rules. Based on the survey, first talk to your neighbors about how to use them with the right decisions, and then exchange ideas with the members in the same table as soon as they share each other. Also, as a confirmation of attendance, ** Please comment on today's knowledge and impressions of the class in this article **.
Recommended Posts