Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve indexing experience #13

Open
lgrz opened this issue Oct 23, 2018 · 0 comments
Open

Improve indexing experience #13

lgrz opened this issue Oct 23, 2018 · 0 comments
Labels
index

Comments

@lgrz
Copy link
Contributor

lgrz commented Oct 23, 2018

The current process for creating an index is rudimentary. A possible better alternative would be to have a single binary program that performs of the details of constructing the index rather than the current situation where the user must invoke each index component separately.

For the time that Indri is still depended upon for index construction stemming information should also be extracted so that it may be possible in future to support stemming of queries internally.
@lgrz lgrz added the index label Oct 23, 2018
@lgrz lgrz mentioned this issue Jul 8, 2019
Open
@lgrz lgrz added this to the 0.1.0-beta milestone Mar 8, 2020
lgrz added a commit that referenced this issue Apr 4, 2020
@lgrz
Merge various indexing programs into one
6041ffc 
This moves most of the indexing logic into a single program `indexer`.
The handles creation of the lexicon, postings, document forward index
and document lengths.

This simplifies the overall process for creating a new index. See #13
@lgrz lgrz removed this from the 0.1.0-beta milestone May 7, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
index
Milestone
No milestone
Development

No branches or pull requests
1 participant
@lgrz