unicode: add description of UTF8-state-machine
authorDavid Herrmann <dh.herrmann@googlemail.com>
Fri, 14 Sep 2012 16:01:34 +0000 (18:01 +0200)
committerDavid Herrmann <dh.herrmann@googlemail.com>
Fri, 14 Sep 2012 16:01:34 +0000 (18:01 +0200)
commite9f39be3e858f00ce23b53266084beabd51ae703
treeff577e3ea65b24cb32c940469d511c682f982611
parent468e265138a121299348393d47ec1b51ea9fe258
unicode: add description of UTF8-state-machine

A short comment on how the UTF8 state machine works and why it does not do
any sophisticated error recovery.

Signed-off-by: David Herrmann <dh.herrmann@googlemail.com>
src/unicode.c