Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Explore using tree sitter for syntax highlighting #210475

Open
alexr00 opened this issue Apr 16, 2024 · 4 comments
Open

Explore using tree sitter for syntax highlighting #210475

alexr00 opened this issue Apr 16, 2024 · 4 comments
Assignees
Labels
exploration grammar Syntax highlighting grammar
Milestone

Comments

@alexr00
Copy link
Member

alexr00 commented Apr 16, 2024

Goals of the explorations:

@alexr00
Copy link
Member Author

alexr00 commented May 3, 2024

Some notes on incremental parsing:

  • Per Can web-tree-sitter actually do async parsing? tree-sitter/tree-sitter#2118, it looks like we can set a timeout so that each call to parse times-out, with the parsing progress preserved for the next call to parse.
  • I've confirmed that this is the case; however, it appears to be broken in the latest version of web-tree-sitter. Going back to 0.22.2 works (latest is 0.22.5).
  • There does not appear to be any significant time penalty for setting a timeout.

@hediet FYI.

@alexr00
Copy link
Member Author

alexr00 commented May 6, 2024

Opened tree-sitter/tree-sitter#3341 for the above issue.

@alexr00
Copy link
Member Author

alexr00 commented May 28, 2024

After some discussion, we've decided to first understand the performance of using tree-sitter to parse files. #213565 contains that work.

@alexr00
Copy link
Member Author

alexr00 commented May 28, 2024

We also need new internal editor API to write a more optimal parse function, which @rebornix may help with.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
exploration grammar Syntax highlighting grammar
Projects
None yet
Development

No branches or pull requests

1 participant