-
-
Notifications
You must be signed in to change notification settings - Fork 212
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
BrokenPipeError when instert too large array #405
Comments
@pulina should we close this issue as completed? |
@xzkostyan Clickhouse still reset connection after receiving to much data and clickhouse-driver still do not have docs about it or proper catching of this error. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the bug
For column Array(FixedString(16)) when inserting records that cumulative binary size of data for single column is greater then MAX_STRINGS_SIZE cause clickhouse to raise TOO_LARGE_STRING_SIZE error. And when connection with no compression is established instead of getting
clickhouse_driver.errors.ServerException
. we getBrokenPipeError: [Errno 32] Broken pipe
error on:To Reproduce
And as far as i can tell without deep knowledge about cython problem is located somewhere here
clickhouse-driver/clickhouse_driver/bufferedwriter.pyx
Line 86 in f088802
Expected behavior
Best solution is when this is possible is slice this string into chunks that can be processed by clickhouse. I have no knowlage about clickhouse native protocol itself so I am not sure this is possible at all. Or when above solution is not possible just throw
clickhouse_driver.errors.ServerException
and inform about this behavior here: https://clickhouse-driver.readthedocs.io/en/latest/types.html#array-t .Versions
The text was updated successfully, but these errors were encountered: