bors 024c25dc79 Auto merge of #60763 - matklad:tt-parser, r=petrochenkov ...

Move token tree related lexer state to a separate struct

Just a types-based refactoring.

We only used a bunch of fields when tokenizing into a token tree, so let's move them out of the base lexer

2019-05-16 04:15:12 +00:00

..

lexer

Auto merge of #60763 - matklad:tt-parser, r=petrochenkov

2019-05-16 04:15:12 +00:00

attr.rs

Use SmallVec in TokenStreamBuilder.

2019-03-29 09:32:58 +11:00

classify.rs

Move literal parsing code into a separate file

2019-05-11 16:03:16 +03:00

diagnostics.rs

move some functions from parser.rs to diagostics.rs

2019-05-01 19:54:48 +08:00

literal.rs

Address comments + Fix tests

2019-05-11 17:06:55 +03:00

mod.rs

Auto merge of #60763 - matklad:tt-parser, r=petrochenkov

2019-05-16 04:15:12 +00:00

parser.rs

Auto merge of #60630 - nnethercote:use-Symbol-more, r=petrochenkov

2019-05-13 00:28:38 +00:00

token.rs

Auto merge of #60767 - Centril:rollup-4cbsb73, r=Centril

2019-05-12 20:28:19 +00:00

unescape_error_reporting.rs

introduce unescape module

2019-05-02 15:31:57 +03:00

unescape.rs

introduce unescape module

2019-05-02 15:31:57 +03:00