Class TokenInfoDictionaryBuilder
- java.lang.Object
-
- org.apache.lucene.analysis.ko.util.TokenInfoDictionaryBuilder
-
class TokenInfoDictionaryBuilder extends java.lang.Object
-
-
Field Summary
Fields Modifier and Type Field Description private java.lang.String
encoding
private java.text.Normalizer.Form
normalForm
private int
offset
Internal word id - incrementally assigned as entries are read and added.
-
Constructor Summary
Constructors Constructor Description TokenInfoDictionaryBuilder(java.lang.String encoding, boolean normalizeEntries)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description TokenInfoDictionaryWriter
build(java.nio.file.Path dir)
private TokenInfoDictionaryWriter
buildDictionary(java.util.List<java.nio.file.Path> csvFiles)
-
-
-
Method Detail
-
build
public TokenInfoDictionaryWriter build(java.nio.file.Path dir) throws java.io.IOException
- Throws:
java.io.IOException
-
buildDictionary
private TokenInfoDictionaryWriter buildDictionary(java.util.List<java.nio.file.Path> csvFiles) throws java.io.IOException
- Throws:
java.io.IOException
-
-