platform/upstream/libpinyin.git
13 years agobegin to write n-gram segment
Peng Wu [Wed, 3 Nov 2010 08:12:20 +0000 (16:12 +0800)]
begin to write n-gram segment

13 years agofixes a typo
Peng Wu [Wed, 3 Nov 2010 06:39:20 +0000 (14:39 +0800)]
fixes a typo

13 years agofixes compile errors
Peng Wu [Tue, 2 Nov 2010 08:11:28 +0000 (16:11 +0800)]
fixes compile errors

13 years agoadd print help to ngseg
Peng Wu [Tue, 2 Nov 2010 08:01:46 +0000 (16:01 +0800)]
add print help to ngseg

13 years agofixes a typo
Peng Wu [Tue, 2 Nov 2010 08:00:57 +0000 (16:00 +0800)]
fixes a typo

13 years agobegin to write ngseg
Peng Wu [Tue, 2 Nov 2010 07:32:42 +0000 (15:32 +0800)]
begin to write ngseg

13 years agofixes convert to utf8 in phrase lookup
Peng Wu [Mon, 1 Nov 2010 11:44:22 +0000 (19:44 +0800)]
fixes convert to utf8 in phrase lookup

13 years agoRevert "strength reduce"
Peng Wu [Mon, 1 Nov 2010 09:08:05 +0000 (17:08 +0800)]
Revert "strength reduce"

13 years agore-write convert to utf8 in phrase lookup
Peng Wu [Mon, 1 Nov 2010 08:54:06 +0000 (16:54 +0800)]
re-write convert to utf8 in phrase lookup

13 years agowrite final step for phrase lookup
Peng Wu [Mon, 1 Nov 2010 08:38:11 +0000 (16:38 +0800)]
write final step for phrase lookup

13 years agowrite search unigram and bigram in phrase lookup
Peng Wu [Mon, 1 Nov 2010 08:08:42 +0000 (16:08 +0800)]
write search unigram and bigram in phrase lookup

13 years agorefine phrase lookup header file
Peng Wu [Mon, 1 Nov 2010 07:46:59 +0000 (15:46 +0800)]
refine phrase lookup header file

13 years agostrength reduce
Peng Wu [Mon, 1 Nov 2010 07:46:26 +0000 (15:46 +0800)]
strength reduce

13 years agofixes compile error
Peng Wu [Mon, 1 Nov 2010 07:07:45 +0000 (15:07 +0800)]
fixes compile error

13 years agofixes a typo
Peng Wu [Fri, 29 Oct 2010 07:13:35 +0000 (15:13 +0800)]
fixes a typo

13 years agofixes compile error
Peng Wu [Fri, 29 Oct 2010 07:08:56 +0000 (15:08 +0800)]
fixes compile error

13 years agowrite get_best_match for phrase lookup
Peng Wu [Fri, 29 Oct 2010 07:01:23 +0000 (15:01 +0800)]
write get_best_match for phrase lookup

13 years agoadd comment
Peng Wu [Fri, 29 Oct 2010 07:00:54 +0000 (15:00 +0800)]
add comment

13 years agowrite phrase lookup in progress
Peng Wu [Fri, 29 Oct 2010 03:17:56 +0000 (11:17 +0800)]
write phrase lookup in progress

13 years agopolish code
Peng Wu [Fri, 29 Oct 2010 02:40:33 +0000 (10:40 +0800)]
polish code

13 years agoadd phrase_lookup.cpp
Peng Wu [Fri, 29 Oct 2010 02:06:32 +0000 (10:06 +0800)]
add phrase_lookup.cpp

13 years agoswitch to pinyin.h
Peng Wu [Wed, 27 Oct 2010 03:28:35 +0000 (11:28 +0800)]
switch to pinyin.h

13 years agofixes makefiles
Peng Wu [Wed, 27 Oct 2010 03:22:38 +0000 (11:22 +0800)]
fixes makefiles

13 years agomove segment and training tools to utils
Peng Wu [Wed, 27 Oct 2010 03:12:41 +0000 (11:12 +0800)]
move segment and training tools to utils

13 years agodefine the phrase lookup interface
Peng Wu [Wed, 27 Oct 2010 03:11:38 +0000 (11:11 +0800)]
define the phrase lookup interface

13 years agobegin to write phrase lookup header
Peng Wu [Tue, 19 Oct 2010 06:48:33 +0000 (14:48 +0800)]
begin to write phrase lookup header

13 years agore-factor lookup sub-directory
Peng Wu [Mon, 18 Oct 2010 08:46:38 +0000 (16:46 +0800)]
re-factor lookup sub-directory

13 years agobegin to write phrase lookup header file
Peng Wu [Mon, 18 Oct 2010 06:17:51 +0000 (14:17 +0800)]
begin to write phrase lookup header file

13 years agofixes pinyin lookup header
Peng Wu [Mon, 18 Oct 2010 05:35:16 +0000 (13:35 +0800)]
fixes pinyin lookup header

13 years agofixes compile warnings
Peng Wu [Fri, 15 Oct 2010 06:32:12 +0000 (14:32 +0800)]
fixes compile warnings

13 years agofixes compile warnings for printf
Peng Wu [Thu, 14 Oct 2010 06:58:50 +0000 (14:58 +0800)]
fixes compile warnings for printf

13 years agoswitch to pinyin.h for tests
Peng Wu [Thu, 14 Oct 2010 06:53:48 +0000 (14:53 +0800)]
switch to pinyin.h for tests

13 years agofixes compile warning for pinyin_lookup.h
Peng Wu [Thu, 14 Oct 2010 06:46:11 +0000 (14:46 +0800)]
fixes compile warning for pinyin_lookup.h

13 years agoswitch to pinyin.h for utils
Peng Wu [Thu, 14 Oct 2010 06:42:59 +0000 (14:42 +0800)]
switch to pinyin.h for utils

13 years agoadd pinyin.h
Peng Wu [Thu, 14 Oct 2010 06:39:38 +0000 (14:39 +0800)]
add pinyin.h

13 years agoadd comment to pinyin_lookup.h
Peng Wu [Thu, 14 Oct 2010 06:18:48 +0000 (14:18 +0800)]
add comment to pinyin_lookup.h

13 years agofixes issues when rename lookup.h to pinyin_lookup.h
Peng Wu [Wed, 13 Oct 2010 07:22:12 +0000 (15:22 +0800)]
fixes issues when rename lookup.h to pinyin_lookup.h

13 years agorename lookup.h to pinyin_lookup.h
Peng Wu [Wed, 13 Oct 2010 07:14:13 +0000 (15:14 +0800)]
rename lookup.h to pinyin_lookup.h

13 years agoincrease total freq in single gram when importing interpolation model
Peng Wu [Wed, 13 Oct 2010 02:50:53 +0000 (10:50 +0800)]
increase total freq in single gram when importing interpolation model

13 years agowrite parse bigram
Peng Wu [Tue, 12 Oct 2010 08:02:12 +0000 (16:02 +0800)]
write parse bigram

13 years agowrite parse unigram for import tool
Peng Wu [Tue, 12 Oct 2010 06:49:54 +0000 (14:49 +0800)]
write parse unigram for import tool

13 years agoadd error printf
Peng Wu [Tue, 12 Oct 2010 06:20:23 +0000 (14:20 +0800)]
add error printf

13 years agowrite import interpolation in progress
Peng Wu [Mon, 11 Oct 2010 07:06:20 +0000 (15:06 +0800)]
write import interpolation in progress

13 years agofixes compile warnings
Peng Wu [Mon, 11 Oct 2010 06:37:55 +0000 (14:37 +0800)]
fixes compile warnings

13 years agofixes a typo
Peng Wu [Mon, 11 Oct 2010 06:34:56 +0000 (14:34 +0800)]
fixes a typo

13 years agofixes a typo
Peng Wu [Mon, 11 Oct 2010 05:46:50 +0000 (13:46 +0800)]
fixes a typo

13 years agofixes export interpolation
Peng Wu [Mon, 11 Oct 2010 05:33:05 +0000 (13:33 +0800)]
fixes export interpolation

13 years agobegin to write import interpolation model.
Peng Wu [Mon, 11 Oct 2010 05:31:02 +0000 (13:31 +0800)]
begin to write import interpolation model.

13 years agore-factor phrase large table
Peng Wu [Sat, 9 Oct 2010 07:07:58 +0000 (15:07 +0800)]
re-factor phrase large table

13 years agore-factor pinyin large table
Peng Wu [Sat, 9 Oct 2010 07:05:09 +0000 (15:05 +0800)]
re-factor pinyin large table

13 years agoadd comments
Peng Wu [Sat, 9 Oct 2010 02:21:56 +0000 (10:21 +0800)]
add comments

13 years agore-factor taglib_add_tag interface
Peng Wu [Sat, 9 Oct 2010 02:14:44 +0000 (10:14 +0800)]
re-factor taglib_add_tag interface

13 years agofixes split_line
Peng Wu [Fri, 8 Oct 2010 10:28:29 +0000 (18:28 +0800)]
fixes split_line

13 years agoswitch to split_line
Peng Wu [Fri, 8 Oct 2010 09:50:19 +0000 (17:50 +0800)]
switch to split_line

13 years agoadd some required tags check
Peng Wu [Thu, 30 Sep 2010 07:22:43 +0000 (15:22 +0800)]
add some required tags check

13 years agoadd required check.
Peng Wu [Thu, 30 Sep 2010 07:08:07 +0000 (15:08 +0800)]
add required check.

13 years agowrite taglib_read
Peng Wu [Thu, 30 Sep 2010 06:47:04 +0000 (14:47 +0800)]
write taglib_read

13 years agoadd duplicate entry check in taglib_add_tag
Peng Wu [Thu, 30 Sep 2010 02:41:11 +0000 (10:41 +0800)]
add duplicate entry check in taglib_add_tag

13 years agofixes a typo
Peng Wu [Wed, 29 Sep 2010 07:38:37 +0000 (15:38 +0800)]
fixes a typo

13 years agowrite tag lib in progress
Peng Wu [Wed, 29 Sep 2010 06:20:27 +0000 (14:20 +0800)]
write tag lib in progress

13 years agofixes a typo
Peng Wu [Mon, 27 Sep 2010 08:45:29 +0000 (16:45 +0800)]
fixes a typo

13 years agodesign tag utility
Peng Wu [Mon, 27 Sep 2010 08:00:46 +0000 (16:00 +0800)]
design tag utility

13 years agofixes compile warnings
Peng Wu [Mon, 27 Sep 2010 08:00:09 +0000 (16:00 +0800)]
fixes compile warnings

13 years agofixes compile warnings.
Peng Wu [Mon, 27 Sep 2010 07:58:59 +0000 (15:58 +0800)]
fixes compile warnings.

13 years agore-fine the tag utility header
Peng Wu [Tue, 21 Sep 2010 02:31:59 +0000 (10:31 +0800)]
re-fine the tag utility header

13 years agoadd taglib interface
Peng Wu [Fri, 17 Sep 2010 08:17:25 +0000 (16:17 +0800)]
add taglib interface

13 years agofixes compile warnings
Peng Wu [Tue, 14 Sep 2010 08:20:18 +0000 (16:20 +0800)]
fixes compile warnings

13 years agoadd test case for compat method
Peng Wu [Tue, 14 Sep 2010 08:10:33 +0000 (16:10 +0800)]
add test case for compat method

13 years agoadd compat method for phrase index
Peng Wu [Tue, 14 Sep 2010 08:05:05 +0000 (16:05 +0800)]
add compat method for phrase index

13 years agore-factor gen_ngram
Peng Wu [Tue, 14 Sep 2010 03:25:52 +0000 (11:25 +0800)]
re-factor gen_ngram

13 years agore-factor gen_unigram
Peng Wu [Tue, 14 Sep 2010 03:05:19 +0000 (11:05 +0800)]
re-factor gen_unigram

13 years agorm mmseg from make file
Peng Wu [Mon, 13 Sep 2010 06:58:05 +0000 (14:58 +0800)]
rm mmseg from make file

13 years agorm mmseg
Peng Wu [Mon, 13 Sep 2010 06:57:17 +0000 (14:57 +0800)]
rm mmseg

13 years agofixes mmseg
Peng Wu [Mon, 13 Sep 2010 06:55:14 +0000 (14:55 +0800)]
fixes mmseg

13 years agomake spseg run
Peng Wu [Fri, 10 Sep 2010 09:28:07 +0000 (17:28 +0800)]
make spseg run

13 years agowrite the shortest path segment
Peng Wu [Fri, 10 Sep 2010 06:39:40 +0000 (14:39 +0800)]
write the shortest path segment

13 years agocombine into libpinyin.a
Peng Wu [Thu, 9 Sep 2010 06:32:45 +0000 (14:32 +0800)]
combine into libpinyin.a

13 years agoWIP of spseg
Peng Wu [Thu, 9 Sep 2010 06:15:08 +0000 (14:15 +0800)]
WIP of spseg

13 years agofixes compile errors
Peng Wu [Wed, 8 Sep 2010 10:13:51 +0000 (18:13 +0800)]
fixes compile errors

13 years agowrite shortest path segment in progress
Peng Wu [Wed, 8 Sep 2010 10:02:00 +0000 (18:02 +0800)]
write shortest path segment in progress

13 years agobegin to add shortest path segment
Peng Wu [Tue, 7 Sep 2010 07:12:16 +0000 (15:12 +0800)]
begin to add shortest path segment

13 years agoadd generating phrase index file
Peng Wu [Tue, 7 Sep 2010 06:15:41 +0000 (14:15 +0800)]
add generating phrase index file

13 years agoadd test case
Peng Wu [Tue, 7 Sep 2010 02:43:10 +0000 (10:43 +0800)]
add test case

13 years agoadd load/store method to phrase table
Peng Wu [Mon, 6 Sep 2010 08:13:14 +0000 (16:13 +0800)]
add load/store method to phrase table

13 years agore-factor pinyin table
Peng Wu [Mon, 6 Sep 2010 08:12:34 +0000 (16:12 +0800)]
re-factor pinyin table

13 years agofixes a typo
Peng Wu [Thu, 2 Sep 2010 06:33:23 +0000 (14:33 +0800)]
fixes a typo

13 years agoadd test case for phrase table
Peng Wu [Thu, 2 Sep 2010 06:32:27 +0000 (14:32 +0800)]
add test case for phrase table

13 years agoadd safe check for load_text.
Peng Wu [Wed, 1 Sep 2010 09:04:38 +0000 (17:04 +0800)]
add safe check for load_text.

13 years agobegin to write phrase large table test case
Peng Wu [Wed, 1 Sep 2010 07:32:15 +0000 (15:32 +0800)]
begin to write phrase large table test case

13 years agoadd test phrase to Makefile.am
Peng Wu [Wed, 1 Sep 2010 07:18:53 +0000 (15:18 +0800)]
add test phrase to Makefile.am

13 years agoadd load_text to phrase large table
Peng Wu [Wed, 1 Sep 2010 06:46:03 +0000 (14:46 +0800)]
add load_text to phrase large table

13 years agofini add/remove index
Peng Wu [Tue, 31 Aug 2010 07:37:10 +0000 (15:37 +0800)]
fini add/remove index

13 years agobegin to add add_index/remove_index.
Peng Wu [Fri, 27 Aug 2010 06:24:02 +0000 (14:24 +0800)]
begin to add add_index/remove_index.

13 years agoclean up code
Peng Wu [Fri, 27 Aug 2010 05:17:40 +0000 (13:17 +0800)]
clean up code

13 years agofixes a typo
Peng Wu [Fri, 27 Aug 2010 03:22:24 +0000 (11:22 +0800)]
fixes a typo

13 years agofixes search in phrase large table.
Peng Wu [Thu, 26 Aug 2010 07:57:27 +0000 (15:57 +0800)]
fixes search in phrase large table.

13 years agoadd search to phrase large table.
Peng Wu [Thu, 26 Aug 2010 07:41:42 +0000 (15:41 +0800)]
add search to phrase large table.

13 years agore-factor pinyin phrase
Peng Wu [Thu, 26 Aug 2010 03:05:46 +0000 (11:05 +0800)]
re-factor pinyin phrase

13 years agofixes compile errors
Peng Wu [Wed, 25 Aug 2010 09:53:07 +0000 (17:53 +0800)]
fixes compile errors

13 years agowrite phrase large table in progress
Peng Wu [Wed, 25 Aug 2010 09:39:04 +0000 (17:39 +0800)]
write phrase large table in progress