On 7/21/21 7:43 AM, Perry E. Metzger wrote:
Thought I would note that there's a substantial literature now on
incremental parsing, especially the sort that is needed for editor
tools. One doesn't need to reinvent the algorithms, they're out there
waiting to be used. The Tree Sitter project is based on previous
published work.
There is indeed a big literature! I wish there were a bigger
literature on *composable* incremental parsers though. IMHO, what we
need is an incremental GLR system (yes, GLR is bad worst-case, but
it's not a practical concern) that spits out a parse *forest* which we
then pare down to a parse tree with ad-hoc syntactic consistency
rules. Something like this naturally supports multi-language modes and
incorporation of out-of-band semantic information.