Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[E-3113][E-3113] string column length is too large: total_length=4295007622, element_ number=269558077 #34971

Open
2 of 3 tasks
chentyhehe opened this issue May 16, 2024 · 1 comment

Comments

@chentyhehe
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

Version

doris-2.1.0-rc11-91efb6a43d

What's Wrong?

When doing large data volume aggregation, the data volume is about 10,000 data to go and 4 million data to do cross grouping, often there will be such an error: [E-3113][E-3113] string column length is too large: total_length=4295007622, element_ number=2695580770#
doris::Exception::Exception(int, std::basic_string_view<char, std::char_traits > const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/unique_ptr.h:173
1# doris::Exception::Exception<unsigned long&, unsigned long&>(int, std::basic_string_view<char, std::char_traits > const&, unsigned long&, unsigned long&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:187
2# doris::vectorized::ColumnString::insert_range_from(doris::vectorized::IColumn const&, unsigned long, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/vec/columns/column_string.cpp:0
3# doris::Status doris::vectorized::MutableBlock::merge_impldoris::vectorized::Block&(doris::vectorized::Block&) at /home/zcp/repo_center/doris_release/doris/be/src/vec/common/cow.h:132
4# doris::Status doris::vectorized::MutableBlock::mergedoris::vectorized::Block&(doris::vectorized::Block&) at /home/zcp/repo_center/doris_release/doris/be/src/vec/core/block.h:506
5# doris::vectorized::HashJoinNode::sink(doris::RuntimeState*, doris::vectorized::Block*, bool) at /home/zcp/repo_center/doris_release/doris/be/src/vec/exec/join/vhash_join_node.cpp:0
6# doris::vectorized::HashJoinNode::_materialize_build_side(doris::RuntimeState*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
7# doris::vectorized::VJoinNodeBase::open(doris::RuntimeState*) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:1147
8# doris::vectorized::HashJoinNode::open(doris::RuntimeState*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
9# doris::vectorized::HashJoinNode::_probe_side_open_thread(doris::RuntimeState*, std::promisedoris::Status) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
10# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
11# doris::Thread::supervise_thread(void
) at /var/local/ldb_toolchain/bin/../usr/include/pthread.h:562
12# ?
13# clone

What You Expected?

I'd like to know why and how to fix it, or what version to upgrade to that will fix the problem

How to Reproduce?

No response

Anything Else?

I searched issue,and found someone saying that the problem was fixed in version 2.0.4, but my version is much larger than 2.0.4

!!!!!please please I'm in a hurry.

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@KerYooz
Copy link

KerYooz commented May 29, 2024

2.1.2 There is also this issue, which seems to be related to the windowing function

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants