How to download spacy NLP models using rye?

[saona-raimundo]

SpaCy is a Python NLP library.
Since models are big, they use a special pipeline to download them.
A basic example is

> python -m spacy download en_core_web_trf

// main.py
import spacy
nlp = spacy.load("en_core_web_trf")
import en_core_web_trf
nlp = en_core_web_trf.load()
doc = nlp("This is a sentence.")
print([(w.text, w.pos_) for w in doc])

from https://spacy.io/models

I have trouble running the special download pipeline of SpaCy through rye.
How would you make it work?

[goschtl]

Hi,

it's easy you can just use this one

rye run python -m spacy download en_core_web_trf

you have to make sure that pip is also installed via

rye add pip

HTH
Christian

[saona-raimundo]

Thank you!

My full command history was

rye init --script <project-name>
cd <project-name>
rye add pip
rye add spacy
rye sync
rye run python -m spacy download en_core_web_trf

[limarta]

It seems that after pip installs a model, rye is not informed and thus the pyproject.toml doesn't have the downloaded model. Indeed rye proceeds to uninstall en_core_web_trf after a rye sync or rye add x. Is it possible to prevent rye from removing the downloaded model, say, like adding it to the pyproject.toml?