Skip to content

KarlKangYu/tokenizer

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
data
data
 
 
README
README
 
 
alps-service-commons-1.0-SNAPSHOT.jar
alps-service-commons-1.0-SNAPSHOT.jar
 
 
voa.txt
voa.txt
 
 
voa_sent.txt
voa_sent.txt
 
 
voa_token.txt
voa_token.txt
 
 

Repository files navigation

1. 分句
   java -classpath alps-service-commons-1.0-SNAPSHOT.jar com.kikatech.alps.tool.SentenceDetectTool true voa.txt voa_sent.txt
   三个参数，分别是 是否要替换全角符号为半角 输入文件 输出文件

2. 分词
   java -classpath alps-service-commons-1.0-SNAPSHOT.jar com.kikatech.alps.tool.TokenizerTool  voa_sent.txt voa_token.txt
   两个参数， 输入文件 输出文件

About

No description, website, or topics provided.

Resources

Readme
Activity

Stars

0 stars

Watchers

1 watching

Forks

1 fork
Report repository

Releases

No releases published

Packages

No packages published