Introduced binding of MeCab (Wakame seaweed) and Python to Windows 7 64bit (2016/08/18)
Introduction
I thought it was harder than I thought to introduce MeCab to Windows 7 64bit, so I will post it as a memorandum.
MeCab is a morphological analysis tool. It basically does the following: ――It divides Japanese sentences into morphemes (the smallest blocks that make sense) ――It analyzes the part of speech of morphemes
1st line: Entered text, 3rd line and below: Result
The information I referred to is below (Thank you!): -[Create an environment of 64bit Windows + python 2.7 + MeCab 0.996](http://qiita.com/h_kabocha/items/5bee9e9b852aed11411b#%E3%81%AF%E3%81%98%E3%82%81%E3 % 81% AB) -Windows 64bit, mecab-python
What you need for installation
- python 2.7.11
- Microsoft Visual Studio 2015
- mecab-0.996.exe
- mecab-0.996.tar.gz
- mecab-python-0.996.tar.gz
procedure
1. Download and install all "Requirements for installation"
You can download mecab-0.996.exe, mecab-0.996.tar.gz, mecab-python-0.996.tar.gz from here.
2. Install MeCab main unit
Execute mecab-0.996.exe and write environment variables.
- Run mecab-0.996.exe. The character code of the dictionary is utf-8 (because it is versatile and I am used to it).
- Add
C: \ Mecab \ binto the environment variable PATH - Create a new environment variable MECABRC and set
C: \ Mecab \ etc \ mecabrc - Create if there is no Mecab directory under
C:(state ofC: \ Mecab \)
--At this time, create bin and sdk folders under Mecab folder -* Please check the environment variables as they may differ from one to another.
(Added on 2016/8/18) When you execute mecab-0.996.exe, a MeCab folder will be created under `C: \ Program Files (x86) \`.
If you put that folder in ``` C: ` ``, you don't need to do number 4. I noticed while writing the article ... orz </ font>
3. Modify and build MeCab source
Here, when I was looking at the information I was referring to, there was a mistake in specifying the file, and it took time to match it to my PC. (I didn't have much knowledge, so I uninstalled it twice and did it the third time lol) Expand
- mecab-0.996.tar.gz
- Fixed some files in mecab-0.996 / src folder. Please change (old) and below to (new) and below
- Makefile.msvc.in modified for Windows 7 64bit
- 6th line / MACHINE: X86 → / MACHINE: X64
Makefile.msvc.inLDFLAGS = /nologo /OPT:REF /OPT:ICF /LTCG /NXCOMPAT /DYNAMICBASE /MACHINE:X86 ADVAPI32.LIB LDFLAGS = /nologo /OPT:REF /OPT:ICF /LTCG /NXCOMPAT /DYNAMICBASE /MACHINE:X64 ADVAPI32.LIB- 8th line -DDIC_VERSION = @ DIC_VERSION @ → -DDIC_VERSION = 102
Makefile.msvc.in(Old)-DDLL_EXPORT -DHAVE_GETENV -DHAVE_WINDOWS_H -DDIC_VERSION=@DIC_VERSION@ \ (new)-DDLL_EXPORT -DHAVE_GETENV -DHAVE_WINDOWS_H -DDIC_VERSION=102 \</ li>
- 9th line -DVERSION = "" @ VERSION @ "" "→ -DVERSION =" \ " 0.996 </ font> " "
Makefile.msvc.in(Old)-DVERSION="\"@VERSION@\"" -DPACKAGE="\"mecab\"" \ (new)-DVERSION="\"0.996\"" -DPACKAGE="\"mecab\"" \</ li>
- Line 11 "" c: \ Program Files \ mecab \ etc \ mecabrc \ "" → "" c: \ mecab \ etc \ mecabrc \ "" </ font>
- Please specify the location of mecabrc
Makefile.msvc.in(Old)-DMECAB_DEFAULT_RC="\"c:\\Program Files\\mecab\\etc\\mecabrc\"" (new)-DMECAB_DEFAULT_RC="\"c:\\mecab\\etc\\mecabrc\""</ li>
- feature_index.cpp Line 356 size_t → unsigned int </ font>
feature_index.cpp(Old) case't': os_ << (size_t)path->rnode->char_type; break; (New) case't': os_ << (unsigned int)path->rnode->char_type; break;</ li>
- writer.cpp 260th line size_t → unsigned int </ font>
writer.cpp(Old) case'L': *os << (size_t)lattice->size(); break; (New) case'L': *os << (unsigned int)lattice->size(); break;</ li>
- mecab.h Line 1125 #ifndef SIWG → #ifndef SWIG </ font>
mecab.h(Old)#ifndef SIWG (new)#ifndef SWIG</ li>
- common.h Added to include part #include
</ font> mecab.h(new)#include <iterator></ ul>
- Build in mecab-0.996 / src. Please do so with administrator privileges at the command prompt.
> call "C:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\vcvarsall.bat" amd64 > nmake -f Makefile.msvc.inPlease specify the directory that contains
- vcvarsall.bat </ font> (in my case Microsoft Visual Studio 14.0 or lower)
If
- vcvarsall.bat </ font> is not included, it means "There is no C compiler in which Python is compiled" </ strong>. If you are using Python 2.7, please download the compiler from here.
- For details, [Summary when called Unable to find vcvarsall.bat in Python](http://isiz.hateblo.jp/entry/2015/08/22/Python%E3%81%A7Unable_to_find_vcvarsall.bat % E3% 81% A8% E8% A8% 80% E3% 82% 8F% E3% 82% 8C% E3% 82% 8B% E9% 9A% 9B% E3% 81% AE% E3% 81% BE% E3 Please refer to% 81% A8% E3% 82% 81)
</ ul>
- Please copy the following files built in mecab-0.996 / src under
C: \ Mecab \ bin.- libmecab.dll
- mecab-cost-train.exe
- mecab-dict-gen.exe
- mecab-dict-index.exe
- mecab-system-eval.exe
- mecab-test-gen.exe
</ ul>
- Please copy the following files built in mecab-0.996 / src under
C: \ Mecab \ sdk.- mecab.h
- libmecab.lib
This completes the build.
4. Setup of mecab for python
Rewrite Python for Windows, which only works on Unix. Extract
- mecab-python-0.996.tar.gz </ li>
- Rewrite setup.py as follows.
setup.py#!/usr/bin/env python from distutils.core import setup,Extension,os setup(name = "mecab-python", version = "0.996", py_modules=["MeCab"], ext_modules = [ Extension("_MeCab", ["MeCab_wrap.cxx",], include_dirs=[r"C:\Mecab\sdk"], library_dirs=[r"C:\Mecab\sdk"], libraries=["libmecab"]) ])For the
- include_dirs and library_dirs directories, specify the sdk folder created in 2-4.
</ li> </ ul>
- Build and create a build folder.
> python setup.py build</ li>
- Install. Various files are copied to Lib \ site-packages where python is installed.
> python setup.py install
- include_dirs and library_dirs directories, specify the sdk folder created in 2-4.
5. Put the dictionary and mecabrc in the Mecab file
C:\Mecab\C below:\Program Files (x86)\Copy the etc and dic folders in MeCab and put them in.That's all! # Try out I immediately tried it with Python. I was able to enter the US military base at an event in Yokosuka recently, so this is the text. #### **`text.txt`** ```txt It was fun to visit the US military base in Yokosuka!Python on the command prompt.
>python Python 2.7.11 > import MeCab > import sys > m = MeCab.Tagger('mecabrc') > f = open('text.txt','r') > text = f.read().decode('utf-8') > f.close() > f = open('result.txt','w') > f.write(m.parse(text.encode('utf-8'))) > f.close()The result looks like this
Recommended Posts
- vcvarsall.bat </ font> is not included, it means "There is no C compiler in which Python is compiled" </ strong>. If you are using Python 2.7, please download the compiler from here.
- 8th line -DDIC_VERSION = @ DIC_VERSION @ → -DDIC_VERSION = 102