toke.c: Remove redundant checks
authorKarl Williamson <public@khwilliamson.com>
Sun, 11 Nov 2012 21:45:19 +0000 (14:45 -0700)
committerKarl Williamson <public@khwilliamson.com>
Sun, 11 Nov 2012 22:34:03 +0000 (15:34 -0700)
commit55025e0373118aae3b91192b1eb95b1aad0d6c9d
treeee9ca4f450268797d79b69dc42aac5ae4ec8b1bf
parent3b721c4fa6c962f50c70cd5bc0c5cf5d3de95e0e
toke.c: Remove redundant checks

This code is redundant, as the whole string has been checked earlier for
valid utf8ness, or we assume that the internal Perl handler, charnames,
is correctly returning valid utf8.
toke.c