[Syntax] Add mapping from spelled to expanded tokens for TokenBuffer
authorMarcel Hlopko <hlopko@google.com>
Tue, 7 Apr 2020 12:58:10 +0000 (14:58 +0200)
committerDmitri Gribenko <gribozavr@gmail.com>
Tue, 7 Apr 2020 13:07:16 +0000 (15:07 +0200)
commit1bf055c9891f1a5ab2ff6a04348bd83fcc0a9cde
treebcc42336b3e7ce0f25b13cfbb22fa34308d33df5
parentd66afd6dde542dc373f87e07fe764c071fe20d76
[Syntax] Add mapping from spelled to expanded tokens for TokenBuffer

Summary:
Same restrictions apply as in the other direction: macro arguments are
not supported yet, only full macro expansions can be mapped.

Taking over from https://reviews.llvm.org/D72581.

Reviewers: gribozavr2, sammccall

Reviewed By: gribozavr2

Subscribers: cfe-commits

Tags: #clang

Differential Revision: https://reviews.llvm.org/D77209
clang/include/clang/Tooling/Syntax/Tokens.h
clang/lib/Tooling/Syntax/Tokens.cpp
clang/unittests/Tooling/Syntax/TokensTest.cpp
clang/unittests/Tooling/Syntax/TreeTest.cpp