Repository navigation
Feature: Implement a lexer #49
Description
This requires 3 things...
-
ILexer: processes each line individually and lexes it. -
Lexer: an internal class that implementsILexer -
Line: aref structthat has a span and an index (the index at which the line starts in the matching buffer) -> Feature: Implement aStringBuffer#48 andIBufferhave to be adapted to support this
The lexer has to be performant (both speed and allocations) and avoid doing a job that doesn't belong to it (the previous lexer actually already normalized some things, being counter-producent or counter-productive or however you say that).
And that's it.
Metadata
Metadata
Assignees
Labels
No labels
Type
Fields
Effort
E: Very High
Platform
Web/BrowserWeb/WASM
Projects
- Status
Activity
StringBuffer#48#49: Prepare project for lexer development in the following days
#49: Add structures that the lexer depends on
mf366-dev commentedon Jul 4, 2026
This has been slowed down by #50 but it's still in development.
#49 and #50: Implement lexer and source error structures and improve …
chore: Remove useless comments and update security policy
23 remaining items
perf(lexer)!: Refactor the lexer for performance (using UTF-8 and ASC…
perf(lexer)!: Refactor the lexer for performance (using UTF-8 and ASC…
feat(lexer)!: Fully implement the UTF-8 lexer [3/3]
feat(lexer)!: Implement the UTF-8 lexer (#74)
mf366-dev commentedon Aug 12, 2026
Done (#74).
mf366-dev commentedon Aug 13, 2026
Now for testing.
mf366-dev commentedon Aug 13, 2026
This has moved to Codeberg.