8 Commits

Author	SHA1	Message	Date
Ed Page	f4d9018a48	feat(lexer): Allow including frontmatter with 'tokenize'	2025-07-09 16:42:27 -05:00
Chayim Refael Friedman	8ca5ad6bdd	Fix proc macro server handling of strings with minuses ... It used to decompose them thinking they were numbers.	2025-06-11 01:03:35 +03:00
Lukas Wirth	02a788bfaa	Deduplicate code in proc-macro-srv	2025-06-05 07:25:15 +02:00
Lukas Wirth	04f88362af	Remote dangling file	2025-05-19 13:08:29 +02:00
Chayim Refael Friedman	ceba289f80	Store token trees in contiguous Vec instead of as a tree ... I expected this to be faster (due to less allocations and better cache locality), but benchmarked it is not (neither it is slower). Memory usage, however, drops by ~50mb (of `analysis-stats .`). I guess tt construction is just not hot. This also simplifies using even less memory for token trees by compressing equal span, which I plan to do right after. Some workflows are more easily expressed with a flat tt, while some are better expressed with a tree. With the right helpers, though (which was mostly a matter of trial and error), even the worst workflows become very easy indeed.	2025-01-02 19:21:46 +02:00
Lukas Wirth	93024ad411	Switch token trees to use Symbols	2024-07-16 10:11:59 +02:00
Lukas Wirth	e846c04fbe	Encode ident rawness and literal kind separately in tt::Leaf	2024-07-15 12:24:40 +02:00
Lukas Wirth	0b88dfc8b1	Rename proc-macro-srv::server to server_impl	2024-06-30 15:36:46 +02:00