platform/upstream/libpinyin.git
11 years agoadd enum PHRASE_INDEX_LIBRARIES
Peng Wu [Tue, 19 Feb 2013 04:54:35 +0000 (12:54 +0800)]
add enum PHRASE_INDEX_LIBRARIES

11 years agofixes crash
Peng Wu [Mon, 18 Feb 2013 06:36:13 +0000 (14:36 +0800)]
fixes crash

11 years agoFixes issue reported by fundawang:
Peng Wu [Sun, 17 Feb 2013 09:28:43 +0000 (17:28 +0800)]
Fixes issue reported by fundawang:
https://github.com/libpinyin/libpinyin/issues/33

merge libpinyin-0.8.0-link.patch.

11 years agomove data files to libdir
Peng Wu [Sat, 16 Feb 2013 03:40:23 +0000 (11:40 +0800)]
move data files to libdir

11 years agofixes typo
Peng Wu [Tue, 5 Feb 2013 03:41:37 +0000 (11:41 +0800)]
fixes typo

11 years agore-factor load/save
Peng Wu [Mon, 4 Feb 2013 10:11:41 +0000 (18:11 +0800)]
re-factor load/save

11 years agoadd mmap support
Peng Wu [Mon, 4 Feb 2013 09:39:18 +0000 (17:39 +0800)]
add mmap support

11 years agoadd back ng
Peng Wu [Mon, 4 Feb 2013 06:01:40 +0000 (14:01 +0800)]
add back ng

11 years agofixes gen_extra_enter
Peng Wu [Fri, 1 Feb 2013 06:08:57 +0000 (14:08 +0800)]
fixes gen_extra_enter

11 years agoupdate ngseg
Peng Wu [Fri, 1 Feb 2013 04:38:27 +0000 (12:38 +0800)]
update ngseg

11 years agoupdate spseg
Peng Wu [Fri, 1 Feb 2013 04:27:46 +0000 (12:27 +0800)]
update spseg

11 years agoupdate download url
Peng Wu [Wed, 30 Jan 2013 02:52:12 +0000 (10:52 +0800)]
update download url

11 years agofixes incomplete pinyin
Peng Wu [Fri, 25 Jan 2013 04:16:19 +0000 (12:16 +0800)]
fixes incomplete pinyin

11 years agoremove genpinyins.awk
Peng Wu [Mon, 14 Jan 2013 07:15:22 +0000 (15:15 +0800)]
remove genpinyins.awk

11 years agocode re-factor
Peng Wu [Mon, 14 Jan 2013 07:15:05 +0000 (15:15 +0800)]
code re-factor

11 years agowrite genpinyins.py
Peng Wu [Mon, 14 Jan 2013 07:09:18 +0000 (15:09 +0800)]
write genpinyins.py

11 years agocode re-factor
Peng Wu [Mon, 14 Jan 2013 05:55:00 +0000 (13:55 +0800)]
code re-factor

11 years agoclean up configure.ac
Peng Wu [Mon, 31 Dec 2012 02:54:30 +0000 (10:54 +0800)]
clean up configure.ac

11 years agofixes autogen.sh
Peng Wu [Tue, 18 Dec 2012 03:20:25 +0000 (11:20 +0800)]
fixes autogen.sh

11 years agoa safe guard for chewing
Peng Wu [Tue, 11 Dec 2012 06:15:49 +0000 (14:15 +0800)]
a safe guard for chewing

11 years agofixes pinyin_translate_token
Peng Wu [Wed, 5 Dec 2012 03:35:17 +0000 (11:35 +0800)]
fixes pinyin_translate_token

11 years agoremove pinyin_get_pinyins_from_token
Peng Wu [Wed, 5 Dec 2012 03:07:53 +0000 (11:07 +0800)]
remove pinyin_get_pinyins_from_token

11 years agoremove pinyin_translate_token
Peng Wu [Wed, 5 Dec 2012 03:05:05 +0000 (11:05 +0800)]
remove pinyin_translate_token

11 years agoremove pinyin_clear_constraint*
Peng Wu [Wed, 5 Dec 2012 03:01:27 +0000 (11:01 +0800)]
remove pinyin_clear_constraint*

11 years agoadd comments
Peng Wu [Tue, 4 Dec 2012 05:01:01 +0000 (13:01 +0800)]
add comments

11 years agowrite pinyin_token_*
Peng Wu [Tue, 4 Dec 2012 03:05:33 +0000 (11:05 +0800)]
write pinyin_token_*

11 years agoadd comments
Peng Wu [Tue, 4 Dec 2012 02:10:02 +0000 (10:10 +0800)]
add comments

11 years agowrite pinyin_get_chewing/pinyin_string
Peng Wu [Tue, 4 Dec 2012 02:04:09 +0000 (10:04 +0800)]
write pinyin_get_chewing/pinyin_string

11 years agoadd test cases for pinyin_mask_out
Peng Wu [Mon, 3 Dec 2012 04:47:51 +0000 (12:47 +0800)]
add test cases for pinyin_mask_out

11 years agoadd mask out test cases to ngram
Peng Wu [Thu, 29 Nov 2012 06:36:31 +0000 (14:36 +0800)]
add mask out test cases to ngram

11 years agoadd mask out test cases to chewing/pharse table
Peng Wu [Thu, 29 Nov 2012 06:35:08 +0000 (14:35 +0800)]
add mask out test cases to chewing/pharse table

11 years agofixes a typo
Peng Wu [Wed, 28 Nov 2012 02:50:35 +0000 (10:50 +0800)]
fixes a typo

11 years agoadd const modifiers
Peng Wu [Wed, 28 Nov 2012 02:24:10 +0000 (10:24 +0800)]
add const modifiers

11 years agoindent phrase_index.cpp
Peng Wu [Mon, 26 Nov 2012 04:26:32 +0000 (12:26 +0800)]
indent phrase_index.cpp

11 years agoadd license
Peng Wu [Mon, 19 Nov 2012 03:35:34 +0000 (11:35 +0800)]
add license

11 years agofixes constraints array
Peng Wu [Thu, 15 Nov 2012 03:44:37 +0000 (11:44 +0800)]
fixes constraints array

11 years agofixes poke the next constraint
Peng Wu [Wed, 14 Nov 2012 08:10:32 +0000 (16:10 +0800)]
fixes poke the next constraint

11 years agofixes one step constraint in get_best_match
Peng Wu [Wed, 14 Nov 2012 07:31:11 +0000 (15:31 +0800)]
fixes one step constraint in get_best_match

11 years agomark format version as 0.8.0
Peng Wu [Mon, 12 Nov 2012 06:36:40 +0000 (14:36 +0800)]
mark format version as 0.8.0

11 years agowrite pinyin_mask_out
Peng Wu [Mon, 12 Nov 2012 06:06:06 +0000 (14:06 +0800)]
write pinyin_mask_out

11 years agowrite mask out for facade tables
Peng Wu [Mon, 12 Nov 2012 05:27:12 +0000 (13:27 +0800)]
write mask out for facade tables

11 years agowrite mask out for chewing large table
Peng Wu [Thu, 8 Nov 2012 04:14:49 +0000 (12:14 +0800)]
write mask out for chewing large table

11 years agowrite mask out for phrase large table2
Peng Wu [Wed, 7 Nov 2012 05:51:36 +0000 (13:51 +0800)]
write mask out for phrase large table2

11 years agofixes pinyin_load_phrase_library
Peng Wu [Wed, 7 Nov 2012 05:05:48 +0000 (13:05 +0800)]
fixes pinyin_load_phrase_library

11 years agowrite remove index
Peng Wu [Tue, 6 Nov 2012 03:42:15 +0000 (11:42 +0800)]
write remove index

11 years agore-factor remove index in progress
Peng Wu [Tue, 6 Nov 2012 03:12:19 +0000 (11:12 +0800)]
re-factor remove index in progress

11 years agowrite get length
Peng Wu [Mon, 5 Nov 2012 05:55:34 +0000 (13:55 +0800)]
write get length

11 years agowrite get length in progress
Peng Wu [Mon, 5 Nov 2012 05:41:01 +0000 (13:41 +0800)]
write get length in progress

11 years agoadd comments
Peng Wu [Wed, 31 Oct 2012 05:23:28 +0000 (13:23 +0800)]
add comments

11 years agowrite Bigram::mask_out
Peng Wu [Tue, 30 Oct 2012 09:33:08 +0000 (17:33 +0800)]
write Bigram::mask_out

11 years agowrite SingleGram::mask_out
Peng Wu [Tue, 30 Oct 2012 08:18:21 +0000 (16:18 +0800)]
write SingleGram::mask_out

11 years agowrite mask out method
Peng Wu [Fri, 26 Oct 2012 06:49:11 +0000 (14:49 +0800)]
write mask out method

11 years agowrite FacadePhraseIndex::merge_with_mask
Peng Wu [Fri, 26 Oct 2012 06:15:23 +0000 (14:15 +0800)]
write FacadePhraseIndex::merge_with_mask

11 years agore-factor phrase index
Peng Wu [Fri, 26 Oct 2012 04:06:43 +0000 (12:06 +0800)]
re-factor phrase index

11 years agowrite mask_out_phrase_index_logger
Peng Wu [Thu, 25 Oct 2012 07:09:40 +0000 (15:09 +0800)]
write mask_out_phrase_index_logger

11 years agomove back get_first_token
Peng Wu [Mon, 22 Oct 2012 08:31:42 +0000 (16:31 +0800)]
move back get_first_token

11 years agofixes utils helper
Peng Wu [Mon, 22 Oct 2012 04:16:37 +0000 (12:16 +0800)]
fixes utils helper

11 years agorename evals.text to evals2.text
Peng Wu [Mon, 22 Oct 2012 03:31:17 +0000 (11:31 +0800)]
rename evals.text to evals2.text

11 years agoupdate cmake
Peng Wu [Mon, 22 Oct 2012 02:36:03 +0000 (10:36 +0800)]
update cmake

11 years agomove get_first_token to spseg
Peng Wu [Sat, 20 Oct 2012 08:26:02 +0000 (16:26 +0800)]
move get_first_token to spseg

11 years agorefine reduce_tokens
Peng Wu [Fri, 19 Oct 2012 08:11:47 +0000 (16:11 +0800)]
refine reduce_tokens

11 years agoupdate pinyin_iterator_add_phrase
Peng Wu [Fri, 19 Oct 2012 07:44:41 +0000 (15:44 +0800)]
update pinyin_iterator_add_phrase

11 years agoupdate pinyin_guess_sentence_with_prefix
Peng Wu [Fri, 19 Oct 2012 07:16:10 +0000 (15:16 +0800)]
update pinyin_guess_sentence_with_prefix

11 years agorename pinyin_lookup_token to pinyin_lookup_tokens
Peng Wu [Fri, 19 Oct 2012 07:04:30 +0000 (15:04 +0800)]
rename pinyin_lookup_token to pinyin_lookup_tokens

11 years agowrite reduce_tokens
Peng Wu [Fri, 19 Oct 2012 07:00:17 +0000 (15:00 +0800)]
write reduce_tokens

11 years agofixes utils helper
Peng Wu [Fri, 19 Oct 2012 05:44:33 +0000 (13:44 +0800)]
fixes utils helper

11 years agoclean up code
Peng Wu [Fri, 19 Oct 2012 04:24:06 +0000 (12:24 +0800)]
clean up code

11 years agoupdate utils helper
Peng Wu [Fri, 19 Oct 2012 04:18:04 +0000 (12:18 +0800)]
update utils helper

11 years agoupdate eval correction rate
Peng Wu [Fri, 19 Oct 2012 04:17:03 +0000 (12:17 +0800)]
update eval correction rate

11 years agoupdate gen k mixture model
Peng Wu [Fri, 19 Oct 2012 04:01:01 +0000 (12:01 +0800)]
update gen k mixture model

11 years agoupdate gen deleted ngram
Peng Wu [Fri, 19 Oct 2012 03:53:35 +0000 (11:53 +0800)]
update gen deleted ngram

11 years agoupdate gen ngram
Peng Wu [Fri, 19 Oct 2012 03:50:19 +0000 (11:50 +0800)]
update gen ngram

11 years agoclean up gen unigram
Peng Wu [Fri, 19 Oct 2012 03:49:14 +0000 (11:49 +0800)]
clean up gen unigram

11 years agoupdate data/Makefile.am
Peng Wu [Fri, 19 Oct 2012 03:11:45 +0000 (11:11 +0800)]
update data/Makefile.am

11 years agoupdate ngseg
Peng Wu [Thu, 18 Oct 2012 09:57:39 +0000 (17:57 +0800)]
update ngseg

11 years agoupdate tag utility
Peng Wu [Thu, 18 Oct 2012 08:53:28 +0000 (16:53 +0800)]
update tag utility

11 years agoupdate utils helper
Peng Wu [Thu, 18 Oct 2012 08:50:24 +0000 (16:50 +0800)]
update utils helper

11 years agoupdate k mixture model to interpolation
Peng Wu [Thu, 18 Oct 2012 08:42:52 +0000 (16:42 +0800)]
update k mixture model to interpolation

11 years agoupdate import k mixture model
Peng Wu [Thu, 18 Oct 2012 08:31:38 +0000 (16:31 +0800)]
update import k mixture model

11 years agoupdate import interpolation
Peng Wu [Thu, 18 Oct 2012 08:30:30 +0000 (16:30 +0800)]
update import interpolation

11 years agoupdate tag utility
Peng Wu [Thu, 18 Oct 2012 05:27:18 +0000 (13:27 +0800)]
update tag utility

11 years agoupdate export k mixture model
Peng Wu [Thu, 18 Oct 2012 05:10:29 +0000 (13:10 +0800)]
update export k mixture model

11 years agoupdate export interpolation
Peng Wu [Thu, 18 Oct 2012 04:59:04 +0000 (12:59 +0800)]
update export interpolation

11 years agobump version 0.8.91
Peng Wu [Wed, 17 Oct 2012 06:31:28 +0000 (14:31 +0800)]
bump version 0.8.91

11 years agobump version 0.7.92 0.7.92
Peng Wu [Mon, 15 Oct 2012 02:20:22 +0000 (10:20 +0800)]
bump version 0.7.92

11 years agofixes memory leak in test pinyin
Peng Wu [Thu, 11 Oct 2012 09:30:07 +0000 (17:30 +0800)]
fixes memory leak in test pinyin

11 years agofixes memory leak in pinyin.cpp
Peng Wu [Thu, 11 Oct 2012 09:29:42 +0000 (17:29 +0800)]
fixes memory leak in pinyin.cpp

11 years agofixes memory leak in test pinyin lookup
Peng Wu [Thu, 11 Oct 2012 05:49:26 +0000 (13:49 +0800)]
fixes memory leak in test pinyin lookup

11 years agofixes memory leak in facade chewing table
Peng Wu [Thu, 11 Oct 2012 05:47:31 +0000 (13:47 +0800)]
fixes memory leak in facade chewing table

11 years agofixes memory leak in facade phrase table2
Peng Wu [Thu, 11 Oct 2012 05:36:24 +0000 (13:36 +0800)]
fixes memory leak in facade phrase table2

11 years agofixes memory leak in test chewing table
Peng Wu [Wed, 10 Oct 2012 10:07:21 +0000 (18:07 +0800)]
fixes memory leak in test chewing table

11 years agofixes memory leak in chewing large table
Peng Wu [Wed, 10 Oct 2012 10:06:51 +0000 (18:06 +0800)]
fixes memory leak in chewing large table

11 years agofixes memory leak in phrase large table2
Peng Wu [Wed, 10 Oct 2012 09:02:52 +0000 (17:02 +0800)]
fixes memory leak in phrase large table2

11 years agore-factor phrase lookup
Peng Wu [Wed, 10 Oct 2012 05:55:07 +0000 (13:55 +0800)]
re-factor phrase lookup

11 years agofixes test_parser2 again
Peng Wu [Tue, 9 Oct 2012 06:16:47 +0000 (14:16 +0800)]
fixes test_parser2 again

11 years agofixes memory leak in test_parser2
Peng Wu [Tue, 9 Oct 2012 05:58:49 +0000 (13:58 +0800)]
fixes memory leak in test_parser2

11 years agofixes memory leak in test_ngram
Peng Wu [Tue, 9 Oct 2012 05:33:38 +0000 (13:33 +0800)]
fixes memory leak in test_ngram

11 years agofixes memory leak in test_memory_chunk
Peng Wu [Tue, 9 Oct 2012 05:22:08 +0000 (13:22 +0800)]
fixes memory leak in test_memory_chunk

11 years agodetect corrupted phrase index log file
Peng Wu [Mon, 8 Oct 2012 05:51:37 +0000 (13:51 +0800)]
detect corrupted phrase index log file

11 years agoimproves test_pinyin output
Peng Wu [Mon, 8 Oct 2012 04:41:56 +0000 (12:41 +0800)]
improves test_pinyin output