How to unimport or remove an imported folder?

[spookylukey]

When prompted by pyright, I pressed "i" to import a folder X containing source code and many directories, which I didn't mean to. Now, whenever I run lsp-pyright (in a completely different project, with its own pyrightconfig.json), I get:
"Watching all the files in X would require adding watches to 2554 directories, so watching the repo may slow Emacs down. Do you want to watch all the files in X (y or n)"

I have to type "n" every time. Somehow this is being cached somewhere, but I can't figure out where. How can I clear things out or remove this? I don't just want to customize a variable, I want to get back to a clean slate.

Thanks.

[matzebond]

Does lsp-workspace-folders-remove help?