-
Notifications
You must be signed in to change notification settings - Fork 33
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support of registered files (DuckDB-WASM) in vgplot #130
Comments
spren9er
changed the title
Support of registered files (DuckDB-WASM) in _vgplot_
Support of registered files (DuckDB-WASM) in vgplot
Jul 5, 2023
I won’t be able to take a closer look at this until next week (the issue is that Mosaic interprets the table name as
|
Thanks, first workaround (creating a view for it) worked out. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Data loading helpers create DuckDB tables/views from parquet, JSON or CSV files. Unfortunately, this process can take a while when data is big. Sometimes — in DuckDB-WASM — it is nicer to register files and run queries directly on them (see
registerFileURL
). Query performance on DuckDB tables is optimal, but queries on parquet files are fast, too.Here, we try to use a registered CSV file (via HTTP) in vgplot:
Note, that references of mosaic clients point now to registered file
athletes.csv
, not a DuckDB table anymore.This works! However, currently not all marks from vgplot are supported with registered files. Connected marks (e.g.
area
,line
) don't work. When replacing above markbarX
byan error is raised:
I think the reason is probably due to some preprocessing of table name, see here. This logic conflicts with registered file name. I tried changing name of registered file
athletes.csv
, but if I omit.csv
suffix, then DuckDB-WASM interprets reference as table.It would be great if vgplot fully works with registered files (via HTTP(S), S3, local storage, etc.).
The text was updated successfully, but these errors were encountered: