-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Panic randomly occurs on node shutdown, leading to unclean shutdown #1661
Comments
This might be related to ethereum/go-ethereum#27509 and applying ethereum/go-ethereum#27665 might help alleviating this issue. It seems that this panic message is not completely random and there are some situations where its probability gets high, which means just repeating |
Expected behaviour
Panic should not happen on normal node shutdown.
Actual behaviour
panic: sync: WaitGroup is reused before previous Wait has returned
randomly happens on node shutdown, leading to unclean shutdown and data loss on the node.I stop one of the non-validator nodes once in a day to safely take a disk snapshot.
I have observed this panic message once in a month or two.
Steps to reproduce the behaviour
Launch a QBFT cluster and schedule a normal shutdown once in a day.
Sometimes
panic: sync: WaitGroup is reused before previous Wait has returned
message appears on node shutdown, causing data loss on the node.The text was updated successfully, but these errors were encountered: