[PYTHON] Add a dictionary to MeCab
I'm sorry, I'm a beginner to post to Qiita, so I think the layout is strange. I would be grateful if you could give me some advice on layout and writing.
【Overview】
Procedure for adding a new word (user dictionary) to MeCab
【environment】
Mac OS X
【Notes】
- It is assumed that MeCab is installed
- The directory where the MeCab dictionary is stored differs depending on the environment, so check the directory location for each (in most cases, it is in / usr / local / lib / mecab / dic / ipadic).
- If you do not rewrite macabrc, you need to pass the path every time you execute the user dictionary (mecab -u user.dic). Open / usr / local / etc / mecabrc with an editor and rewrite as follows
userdic = /usr/local/lib/mecab/dic/ipadic/user.dic(left;Erase)
[File description]
1.create_dic.py (Program for creating newword_dic.csv from newword_list.txt for Python 3.X)
create_dic.py
if __name__ == "__main__":
fin = open("newword_list.txt")
fout = open("newword_dic.csv","w")
for line in fin:
line=line.rstrip('\n')
word = line.split(',')
cost = int(max(-36000, -400*len(word[0])**1.5))
fout.write("%s,-1,-1,%d,noun,General,*,*,*,*,*,*,%s,%s\n" % (word[0],cost,word[1],word[1]))
fin.close()
fout.close()
2.newword_list.txt (list containing new words. Basically only this text file can be edited)
Sword Art Online, Sword Art Online Mankind has declined, mankind has declined Magical Girl Lyrical Nanoha, Magical Girl Lyrical Nanoha Artificial intelligence, artificial intelligence
- newword_dic.csv (MeCab format dictionary)
【procedure】
- Add a new word to newword_list.txt as in the example (Example: Magical Girl Lyrical Nanoha, Mahousho Jorikaru Nanoha)
- Create a MeCab dictionary (newword_dic.csv) from newword_list.txt
python create_dic.py
- Compile newword_dic.csv into a format (.dic) that can be used with MeCab and add it to the dictionary.
sudo /usr/local/libexec/mecab/mecab-dict-index -d /usr/local/lib/mecab/dic/ipadic -u user.dic -f utf8 -t utf8 newword_dic.csv
- Move the added dictionary to the directory where the MeCab system dictionary exists.
sudo mv user.dic /usr/local/lib/mecab/dic/ipadic
- Start mecab from the terminal
If so, the user dictionary is correctly added to MeCab
References
http://tseiya.hatenablog.com/entry/2012/09/19/191114
Recommended Posts