[GO] [Language processing 100 knocks 2020] Summary of answer examples by Python

Introduction

2020 version of 100 knocks of language processing, which is famous as a collection of problems of natural language processing, has been released. In this article, I will introduce 100 examples of answers in Python. Feel free to comment if you have any questions, such as mistakes or better ways. All answer notebooks are available on github.

Advance preparation

We use Google Colaboratory for answers. For details on how to set up and use Google Colaboratory, see this article. However, no special settings are required and you can use it immediately if you have a Google account.

Chapter 1: Preparatory movement

Review some advanced topics in programming languages while working on subjects dealing with text and strings.

Chapter 1 Questions and Answers

Chapter 2: UNIX Commands

Experience useful UNIX tools for research and data analysis. Through these reimplements, you will experience the ecosystem of existing tools while improving your programming skills.

Chapter 2 Questions and Answers

Chapter 3: Regular Expressions

By applying regular expressions to the markup description on Wikipedia pages, various information and knowledge can be extracted.

[Chapter 3 Questions and Answers] (https://qiita.com/yamaru/items/255d0c5dcb2d1d4ccc14)

Chapter 4: Morphological analysis

Apply a morphological analyzer to Natsume Soseki's novel "I Am a Cat" to find the statistics of the words in the novel.

[Chapter 4 Questions and Answers] (https://qiita.com/yamaru/items/e06014b146a18e97ca59)

Chapter 5: Dependency Analysis

Apply the dependency analyzer to "I am a cat" and experience the operation of the dependency tree and syntactic analysis.

[Chapter 5 Questions and Answers] (https://qiita.com/yamaru/items/48dcc527f433c22e0af9)

Chapter 6: Machine Learning

Build a document classifier by machine learning. In addition, you will learn how to evaluate machine learning methods.

Chapter 6 Questions and Answers

Chapter 7: Word Vector

Learn how to handle word vectors through word similarity calculation and word analogy. In addition, you will experience clustering and vector visualization.

Chapter 7 Questions and Answers

Chapter 8: Neural Net

Learn how to use the deep learning framework and implement categorization based on neural networks.

Chapter 8 Questions and Answers

Chapter 9: RNN, CNN

Implement recurrent neural networks (RNNs) and convolutional neural networks (CNNs) using deep learning frameworks.

Preparing to answer

Chapter 10: Machine Translation

Build a neural machine translation model using existing tools.

Preparing to answer

in conclusion

100 Language Processing Knock is designed so that you can learn not only natural language processing itself, but also basic data processing and general-purpose machine learning. Even those who are studying machine learning in online courses will be able to practice very good output, so please try it.

Recommended Posts

[Language processing 100 knocks 2020] Summary of answer examples by Python
100 language processing knocks 2020 [00 ~ 89 answer]
Language processing 100 knocks 00 ~ 09 Answer
[Chapter 5] Introduction to Python with 100 knocks of language processing
[Chapter 3] Introduction to Python with 100 knocks of language processing
[Chapter 2] Introduction to Python with 100 knocks of language processing
[Chapter 4] Introduction to Python with 100 knocks of language processing
100 Language Processing Knock Chapter 1 by Python
Summary of multi-process processing of script language
100 language processing knocks (2020): 40
100 language processing knocks (2020): 32
100 language processing knocks (2020): 35
100 language processing knocks (2020): 47
100 language processing knocks (2020): 39
100 language processing knocks (2020): 22
Language processing 100 knocks-22: Extraction of category names
100 language processing knocks (2020): 26
100 language processing knocks (2020): 34
100 language processing knocks (2020): 42
100 language processing knocks (2020): 29
100 language processing knocks (2020): 49
100 language processing knocks 06 ~ 09
100 language processing knocks (2020): 43
100 language processing knocks (2020): 24
Grayscale by matrix-Reinventor of Python image processing-
100 language processing knocks (2020): 45
Summary of library hosting pages by language
100 language processing knocks (2020): 10-19
100 language processing knocks (2020): 30
100 language processing knocks (2020): 00-09
100 language processing knocks (2020): 31
100 language processing knocks (2020): 48
100 language processing knocks (2020): 44
100 language processing knocks (2020): 41
100 language processing knocks (2020): 37
100 language processing knocks (2020): 25
100 language processing knocks (2020): 23
100 language processing knocks (2020): 33
100 language processing knocks (2020): 20
100 language processing knocks (2020): 27
100 language processing knocks (2020): 46
100 language processing knocks (2020): 21
100 language processing knocks (2020): 36
Japanese language processing by Python3 (5) Ensemble learning of different models by Voting Classifier
Getting started with Python with 100 knocks on language processing
100 amateur language processing knocks: 41
100 amateur language processing knocks: 71
100 language processing knock 2020 [00 ~ 39 answer]
100 amateur language processing knocks: 56
100 amateur language processing knocks: 24
100 amateur language processing knocks: 50
100 language processing knock 2020 [00-79 answer]
100 language processing knock 2020 [00 ~ 69 answer]
100 amateur language processing knocks: 59
100 amateur language processing knocks: 70
100 amateur language processing knocks: 62
100 amateur language processing knocks: 60
100 amateur language processing knocks: 92
100 amateur language processing knocks: 30
100 amateur language processing knocks: 06
100 amateur language processing knocks: 84