Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: When I create index for Milvus, Milvus hang. #15705

Closed
1 task done
JackLCL opened this issue Feb 23, 2022 · 11 comments
Closed
1 task done

[Bug]: When I create index for Milvus, Milvus hang. #15705

JackLCL opened this issue Feb 23, 2022 · 11 comments
Assignees
Labels
kind/bug Issues or changes related a bug triage/accepted Indicates an issue or PR is ready to be actively worked on.
Milestone

Comments

@JackLCL
Copy link
Contributor

JackLCL commented Feb 23, 2022

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version:2.0 GA
- Deployment mode(standalone or cluster):cluster
- SDK version(e.g. pymilvus v2.0.0rc2):pymilvus 2.0.0
- OS(Ubuntu or CentOS): ubuntu
- CPU/Memory: 12cpu 64G
- GPU: 
- Others:

Current Behavior

I follow this link to start Milvus cluster.
After starting Milvus cluster, I run hello_milvus.py successfully.
I didn't do any operations for 4 days on this cluster.
Today I run hello_milvus.py again, but it hangs at creating an index.
image

All pods in cluster look well:
image

Expected Behavior

I can run hello_milvus.py successfully.

Steps To Reproduce

1. start Milvus cluster 
2. don't do anything for 4 days
3. run hello_milvus.py

Anything else?

No response

@JackLCL JackLCL added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Feb 23, 2022
@yanliang567
Copy link
Contributor

@JackLCL please upload the logs for milvus pods

@JackLCL
Copy link
Contributor Author

JackLCL commented Feb 23, 2022

@xiaofan-luan
Copy link
Contributor

/assign @DragonDriver

@xiaofan-luan xiaofan-luan added triage/accepted Indicates an issue or PR is ready to be actively worked on. and removed needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Feb 27, 2022
@xiaofan-luan xiaofan-luan added this to the 2.0.2 milestone Feb 27, 2022
@xiaofan-luan
Copy link
Contributor

@DragonDriver any progress?

@xiaofan-luan xiaofan-luan modified the milestones: 2.0.2, 2.1 Apr 4, 2022
@stale
Copy link

stale bot commented May 4, 2022

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

@stale stale bot added the stale indicates no udpates for 30 days label May 4, 2022
@longjiquan
Copy link
Contributor

I'm so sorry for the late reply. It seems that the log of indexcoord is not complete, I can't see any index-related logs in indexcoord. Apologize again that I didn't focus on this issue. @JackLCL

@stale stale bot removed the stale indicates no udpates for 30 days label May 7, 2022
@longjiquan
Copy link
Contributor

$ cat indexcoord.log | wc -l
45100
$ cat indexcoord.log | grep "watchMetaLoop" | wc -l
45100

@JackLCL JackLCL closed this as completed May 12, 2022
@learningpro
Copy link

why close this issue, I faced this bug as well. It's not hard to reproduce this issue, just do as your document says https://milvus.io/docs/v2.1.x/example_code.md

@ThomasAlxDmy
Copy link

Same here, ran into this issue. It seems like sometimes queries hang forever even given some client timeouts. Would be good to understand what's going on and see errors.

@yanliang567
Copy link
Contributor

this issue was verified fixed on 2.2, please retry on 2.2.2, and if it reproduced to you, feel free to file a new issue with full milvus logs.

@LoriZhuka28
Copy link

LoriZhuka28 commented May 17, 2024

I got the same issue with pymilvus 2.3.6. Any suggestion?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Issues or changes related a bug triage/accepted Indicates an issue or PR is ready to be actively worked on.
Projects
None yet
Development

No branches or pull requests

7 participants