[clangd] Use tokenize instead of raw lexer in SourceCode/lex
authorKadir Cetinkaya <kadircet@google.com>
Thu, 27 Feb 2020 14:10:54 +0000 (15:10 +0100)
committerKadir Cetinkaya <kadircet@google.com>
Fri, 28 Feb 2020 08:38:26 +0000 (09:38 +0100)
commit98bb094c1e0580833a79d60dbc853bd1a43aa1a6
tree406fa66dbf5196a4241faf91f5656987ad7b5e3e
parent7a9d00f261a5fcc739fcde86849374c86bc9420b
[clangd] Use tokenize instead of raw lexer in SourceCode/lex

Reviewers: hokein, sammccall

Subscribers: ilya-biryukov, MaskRay, jkorous, arphaman, usaxena95, cfe-commits

Tags: #clang

Differential Revision: https://reviews.llvm.org/D75249
clang-tools-extra/clangd/SourceCode.cpp