platform/upstream/libpinyin.git
13 years agorefine gen ngram and gen deleted ngram
Peng Wu [Tue, 31 May 2011 02:58:06 +0000 (10:58 +0800)]
refine gen ngram and gen deleted ngram

13 years agoremove zero uni-gram item in export interpolation
Peng Wu [Tue, 31 May 2011 02:38:30 +0000 (10:38 +0800)]
remove zero uni-gram item in export interpolation

13 years agofixes a typo
Peng Wu [Mon, 30 May 2011 09:41:42 +0000 (17:41 +0800)]
fixes a typo

13 years agofixes gen k mixture model
Peng Wu [Mon, 30 May 2011 09:37:53 +0000 (17:37 +0800)]
fixes gen k mixture model

13 years agofixes prune k mixture model
Peng Wu [Thu, 26 May 2011 02:44:37 +0000 (10:44 +0800)]
fixes prune k mixture model

13 years agotemporarily fixes gen k mixture model
Peng Wu [Wed, 25 May 2011 07:17:49 +0000 (15:17 +0800)]
temporarily fixes gen k mixture model

13 years agorefine gen k mixture model
Peng Wu [Wed, 25 May 2011 05:15:59 +0000 (13:15 +0800)]
refine gen k mixture model

13 years agofixes a typo
Peng Wu [Wed, 25 May 2011 04:59:18 +0000 (12:59 +0800)]
fixes a typo

13 years agoremove <start> in \1-gram in conversion tool
Peng Wu [Wed, 25 May 2011 02:50:31 +0000 (10:50 +0800)]
remove <start> in \1-gram in conversion tool

13 years agoadd '\n' to k mixture model to interpolation model
Peng Wu [Tue, 24 May 2011 08:10:12 +0000 (16:10 +0800)]
add '\n' to k mixture model to interpolation model

13 years agofixes merge k mixture model
Peng Wu [Tue, 24 May 2011 07:56:11 +0000 (15:56 +0800)]
fixes merge k mixture model

13 years agorefine gen k mixture model
Peng Wu [Tue, 24 May 2011 05:30:58 +0000 (13:30 +0800)]
refine gen k mixture model

13 years agofixes m_N in magic header of gen k mixture model
Peng Wu [Tue, 24 May 2011 03:20:51 +0000 (11:20 +0800)]
fixes m_N in magic header of gen k mixture model

13 years agofixes merge k mixture model
Peng Wu [Tue, 24 May 2011 03:15:42 +0000 (11:15 +0800)]
fixes merge k mixture model

13 years agoremove some global varibles in gen k mixture model
Peng Wu [Tue, 24 May 2011 03:08:02 +0000 (11:08 +0800)]
remove some global varibles in gen k mixture model

13 years agore-fine gen k mixture model
Peng Wu [Tue, 24 May 2011 02:55:41 +0000 (10:55 +0800)]
re-fine gen k mixture model

13 years agofixes tag utility cpp
Peng Wu [Tue, 24 May 2011 02:40:22 +0000 (10:40 +0800)]
fixes tag utility cpp

13 years agofixes validate k mixture model
Peng Wu [Mon, 23 May 2011 09:10:03 +0000 (17:10 +0800)]
fixes validate k mixture model

13 years agofixes gen k mixture model
Peng Wu [Mon, 23 May 2011 08:23:25 +0000 (16:23 +0800)]
fixes gen k mixture model

13 years agofixes import/export tools
Peng Wu [Mon, 23 May 2011 04:24:29 +0000 (12:24 +0800)]
fixes import/export tools

13 years agowrite validate k mixture model tool
Peng Wu [Mon, 23 May 2011 03:38:14 +0000 (11:38 +0800)]
write validate k mixture model tool

13 years agoremove tag utility header in tools from utils
Peng Wu [Fri, 20 May 2011 03:07:59 +0000 (11:07 +0800)]
remove tag utility header in tools from utils

13 years agomove tag utility to src/storage
Peng Wu [Fri, 20 May 2011 03:02:55 +0000 (11:02 +0800)]
move tag utility to src/storage

13 years agowrite k mixture model to interpolation conversion tool
Peng Wu [Thu, 19 May 2011 05:36:10 +0000 (13:36 +0800)]
write k mixture model to interpolation conversion tool

13 years agowrote import k mixture model
Peng Wu [Wed, 18 May 2011 05:59:29 +0000 (13:59 +0800)]
wrote import k mixture model

13 years agobegin to write import k mixture model
Peng Wu [Tue, 17 May 2011 07:57:44 +0000 (15:57 +0800)]
begin to write import k mixture model

13 years agoadd \end line to export k mixture model
Peng Wu [Tue, 17 May 2011 03:25:41 +0000 (11:25 +0800)]
add \end line to export k mixture model

13 years agoadd missing n_1 in export k mixture model
Peng Wu [Mon, 16 May 2011 11:19:02 +0000 (19:19 +0800)]
add missing n_1 in export k mixture model

13 years agofixes print_help
Peng Wu [Mon, 16 May 2011 07:15:22 +0000 (15:15 +0800)]
fixes print_help

13 years agorefine export interpolation
Peng Wu [Mon, 16 May 2011 06:59:05 +0000 (14:59 +0800)]
refine export interpolation

13 years agowrote export k mixture model
Peng Wu [Mon, 16 May 2011 06:57:18 +0000 (14:57 +0800)]
wrote export k mixture model

13 years agobegin to write export k mixture model
Peng Wu [Mon, 16 May 2011 06:12:47 +0000 (14:12 +0800)]
begin to write export k mixture model

13 years agomove token string conversion function to taglib
Peng Wu [Mon, 16 May 2011 06:11:05 +0000 (14:11 +0800)]
move token string conversion function to taglib

13 years agoadd cmd options for merge k mixture model
Peng Wu [Fri, 13 May 2011 02:49:13 +0000 (10:49 +0800)]
add cmd options for merge k mixture model

13 years agoadd berkeley db sync
Peng Wu [Fri, 13 May 2011 02:35:07 +0000 (10:35 +0800)]
add berkeley db sync

13 years agorefine merge k mixture model
Peng Wu [Thu, 12 May 2011 07:05:58 +0000 (15:05 +0800)]
refine merge k mixture model

13 years agowrite merge k mixture model in progress
Peng Wu [Thu, 12 May 2011 06:56:00 +0000 (14:56 +0800)]
write merge k mixture model in progress

13 years agowrite merge_two_phrase_array function
Peng Wu [Thu, 12 May 2011 03:48:25 +0000 (11:48 +0800)]
write merge_two_phrase_array function

13 years agorefine gen k mixture model
Peng Wu [Thu, 12 May 2011 02:19:36 +0000 (10:19 +0800)]
refine gen k mixture model

13 years agobegin to write merge k mixture model.
Peng Wu [Wed, 11 May 2011 08:23:31 +0000 (16:23 +0800)]
begin to write merge k mixture model.

13 years agofixes a typo
Peng Wu [Wed, 11 May 2011 07:54:49 +0000 (15:54 +0800)]
fixes a typo

13 years agorefine gen k mixture model
Peng Wu [Wed, 11 May 2011 05:47:29 +0000 (13:47 +0800)]
refine gen k mixture model

13 years agoadd cmd line options to gen k mixture model
Peng Wu [Tue, 10 May 2011 07:05:16 +0000 (15:05 +0800)]
add cmd line options to gen k mixture model

13 years agowrite main for gen k mixture model
Peng Wu [Tue, 10 May 2011 06:03:31 +0000 (14:03 +0800)]
write main for gen k mixture model

13 years agoadd enter at file tail
Peng Wu [Tue, 10 May 2011 05:54:22 +0000 (13:54 +0800)]
add enter at file tail

13 years agouse binary format of phrase large table
Peng Wu [Tue, 10 May 2011 05:50:55 +0000 (13:50 +0800)]
use binary format of phrase large table

13 years agowrite gen k mixture model in progress
Peng Wu [Tue, 10 May 2011 05:31:36 +0000 (13:31 +0800)]
write gen k mixture model in progress

13 years agofixes a typo in the load method of flexible ngram
Peng Wu [Tue, 10 May 2011 05:12:36 +0000 (13:12 +0800)]
fixes a typo in the load method of flexible ngram

13 years agofixes compile for gen k mixture model
Peng Wu [Mon, 9 May 2011 06:32:13 +0000 (14:32 +0800)]
fixes compile for gen k mixture model

13 years agobegin to write gen k mixture model
Peng Wu [Mon, 9 May 2011 06:05:28 +0000 (14:05 +0800)]
begin to write gen k mixture model

13 years agofixes linebuf
Peng Wu [Mon, 9 May 2011 03:20:20 +0000 (11:20 +0800)]
fixes linebuf

13 years agofixes cmd line options for gen_deleted_ngram
Peng Wu [Fri, 6 May 2011 02:31:28 +0000 (10:31 +0800)]
fixes cmd line options for gen_deleted_ngram

13 years agorefine gen ngram
Peng Wu [Thu, 5 May 2011 05:11:50 +0000 (13:11 +0800)]
refine gen ngram

13 years agoadd cmd line options to prune k mixture model
Peng Wu [Thu, 5 May 2011 03:32:55 +0000 (11:32 +0800)]
add cmd line options to prune k mixture model

13 years agorefine attach method in flexible n-gram
Peng Wu [Thu, 5 May 2011 03:13:34 +0000 (11:13 +0800)]
refine attach method in flexible n-gram

13 years agowrote prune k mixture model
Peng Wu [Wed, 4 May 2011 05:45:16 +0000 (13:45 +0800)]
wrote prune k mixture model

13 years agobegin to write prune k mixture model
Peng Wu [Wed, 4 May 2011 03:35:30 +0000 (11:35 +0800)]
begin to write prune k mixture model

13 years agorefine k mixture model
Peng Wu [Wed, 4 May 2011 03:25:00 +0000 (11:25 +0800)]
refine k mixture model

13 years agopolish flexible n-gram
Peng Wu [Tue, 3 May 2011 08:28:58 +0000 (16:28 +0800)]
polish flexible n-gram

13 years agofixes some error
Peng Wu [Tue, 3 May 2011 07:58:09 +0000 (15:58 +0800)]
fixes some error

13 years agoadd flexible n-gram signature check
Peng Wu [Tue, 3 May 2011 07:51:48 +0000 (15:51 +0800)]
add flexible n-gram signature check

13 years agofixes source code file permissions
Peng Wu [Tue, 3 May 2011 03:13:55 +0000 (11:13 +0800)]
fixes source code file permissions

13 years agouse errno
Peng Wu [Thu, 28 Apr 2011 07:04:46 +0000 (15:04 +0800)]
use errno

13 years agoadd options to estimate k mixture model
Peng Wu [Thu, 28 Apr 2011 05:46:02 +0000 (13:46 +0800)]
add options to estimate k mixture model

13 years agowrote estimate k mixture model
Peng Wu [Thu, 28 Apr 2011 03:36:47 +0000 (11:36 +0800)]
wrote estimate k mixture model

13 years agoadd remove method to flexible n-gram
Peng Wu [Wed, 27 Apr 2011 09:01:08 +0000 (17:01 +0800)]
add remove method to flexible n-gram

13 years agowrite compute interpolation for flexible bi-gram
Peng Wu [Wed, 27 Apr 2011 08:11:06 +0000 (16:11 +0800)]
write compute interpolation for flexible bi-gram

13 years agofixes code style
Peng Wu [Wed, 27 Apr 2011 07:50:40 +0000 (15:50 +0800)]
fixes code style

13 years agobegin to write estimate k mixture model parameters
Peng Wu [Wed, 27 Apr 2011 06:49:24 +0000 (14:49 +0800)]
begin to write estimate k mixture model parameters

13 years agoclear retval for flexible n-gram
Peng Wu [Wed, 27 Apr 2011 06:29:31 +0000 (14:29 +0800)]
clear retval for flexible n-gram

13 years agoadd magic number for k mixture model
Peng Wu [Wed, 27 Apr 2011 06:07:55 +0000 (14:07 +0800)]
add magic number for k mixture model

13 years agofixes import interpolation
Peng Wu [Mon, 25 Apr 2011 10:11:30 +0000 (18:11 +0800)]
fixes import interpolation

13 years agodefine k mixture model bi-gram
Peng Wu [Mon, 25 Apr 2011 07:54:42 +0000 (15:54 +0800)]
define k mixture model bi-gram

13 years agoadd flexible_ngram.h and k_mixture_model.h to Makefile.am
Peng Wu [Wed, 20 Apr 2011 06:54:01 +0000 (14:54 +0800)]
add flexible_ngram.h  and k_mixture_model.h to Makefile.am

13 years agoadd test cases to bi-gram
Peng Wu [Wed, 20 Apr 2011 06:24:44 +0000 (14:24 +0800)]
add test cases to bi-gram

13 years agoadd load/save bi-gram db
Peng Wu [Wed, 20 Apr 2011 06:22:23 +0000 (14:22 +0800)]
add load/save bi-gram db

13 years agoadd an assert to bi-gram
Peng Wu [Tue, 19 Apr 2011 03:09:16 +0000 (11:09 +0800)]
add an assert to bi-gram

13 years agoadd more test cases
Peng Wu [Tue, 19 Apr 2011 02:33:36 +0000 (10:33 +0800)]
add more test cases

13 years agofixes phrase large table
Peng Wu [Tue, 19 Apr 2011 02:12:12 +0000 (10:12 +0800)]
fixes phrase large table

13 years agoadd asserts to gen ngram
Peng Wu [Mon, 18 Apr 2011 09:54:39 +0000 (17:54 +0800)]
add asserts to gen ngram

13 years agorefine bigram load
Peng Wu [Mon, 18 Apr 2011 09:36:06 +0000 (17:36 +0800)]
refine bigram load

13 years agofixes test phrase table.
Peng Wu [Mon, 18 Apr 2011 09:16:47 +0000 (17:16 +0800)]
fixes test phrase table.

13 years agouse new bi-gram
Peng Wu [Mon, 18 Apr 2011 08:59:03 +0000 (16:59 +0800)]
use new bi-gram

13 years agorefine bi-gram
Peng Wu [Mon, 18 Apr 2011 08:29:17 +0000 (16:29 +0800)]
refine bi-gram

13 years agorefine bi-gram
Peng Wu [Mon, 18 Apr 2011 08:16:59 +0000 (16:16 +0800)]
refine bi-gram

13 years agoadd more test cases for n-gram
Peng Wu [Mon, 18 Apr 2011 07:46:15 +0000 (15:46 +0800)]
add more test cases for n-gram

13 years agoadd insert/remove array item to flexible bi-gram
Peng Wu [Mon, 18 Apr 2011 07:42:21 +0000 (15:42 +0800)]
add insert/remove array item to flexible bi-gram

13 years agorefine insert/set freq
Peng Wu [Mon, 18 Apr 2011 06:37:21 +0000 (14:37 +0800)]
refine insert/set freq

13 years agoadd insert/remove freq to bi-gram
Peng Wu [Mon, 18 Apr 2011 06:25:42 +0000 (14:25 +0800)]
add insert/remove freq to bi-gram

13 years agoadd more test cases for get/set array header
Peng Wu [Fri, 15 Apr 2011 09:13:24 +0000 (17:13 +0800)]
add more test cases for get/set array header

13 years agoadd get/set array header to flexible bi-gram
Peng Wu [Fri, 15 Apr 2011 05:51:02 +0000 (13:51 +0800)]
add get/set array header to flexible bi-gram

13 years agowrite k mixture model
Peng Wu [Wed, 13 Apr 2011 06:18:55 +0000 (14:18 +0800)]
write k mixture model

13 years agofixes a warning
Peng Wu [Fri, 8 Apr 2011 06:42:08 +0000 (14:42 +0800)]
fixes a warning

13 years agoadd test case
Peng Wu [Fri, 8 Apr 2011 04:23:25 +0000 (12:23 +0800)]
add test case

13 years agoadd test case for flexible ngram
Peng Wu [Thu, 7 Apr 2011 06:07:18 +0000 (14:07 +0800)]
add test case for flexible ngram

13 years agowrite flexible n-gram
Peng Wu [Thu, 7 Apr 2011 05:47:05 +0000 (13:47 +0800)]
write flexible n-gram

13 years agoadd get/set array item methods
Peng Wu [Wed, 6 Apr 2011 06:47:57 +0000 (14:47 +0800)]
add get/set array item methods

13 years agoadd retrieve all and search methods
Peng Wu [Wed, 6 Apr 2011 06:07:22 +0000 (14:07 +0800)]
add retrieve all and search methods

13 years agoadd get/set array header methods
Peng Wu [Wed, 6 Apr 2011 05:33:11 +0000 (13:33 +0800)]
add get/set array header methods

13 years agorefine code
Peng Wu [Wed, 6 Apr 2011 05:23:25 +0000 (13:23 +0800)]
refine code