-
Notifications
You must be signed in to change notification settings - Fork 635
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
gRPC - GetStatusAsync throws DeadlineExceeded exception after cleaning EventStore #3761
Comments
Hi @Keethanjan , could you confirm that the cluster has started correctly? You can do this by ensuring that there is 1 Leader and 2 Followers in the cluster either through the admin UI or through the HTTP gossip endpoint ( If the cluster is stable, then can you ensure that the projections subsystem has started correctly? You can do that a couple of ways:
|
In the admin UI all the nodes are up and running and alive The projections are also running In the log file I can't find the line Sub System '"Projections"'. However I can find the following line: {"@t":"2023-03-07T07:24:59.0045348+00:00","@mt":"========== [{httpEndPoint}] Sub System '{subSystemName}' initialized.","@l":"Information","@i":1147237149,"httpEndPoint":"IPADDRESS:2113","subSystemName":"Projections" And in the error file the following line is visible: |
Did you ever figure this out @Keethanjan ? |
Describe the bug
After cleaning and restarting the EventStore service (with 3 nodes) the calls to EventStore fails with DeadlineExceeded. Even with multiple retries, increasing the timeout for each call and waiting 30 seconds after EventStore is started does not resolve this issue.
To Reproduce
Steps to reproduce the behavior:
The line which makes this call is:
var projectionDetails = await _client.GetStatusAsync(name, userCredentials: new UserCredentials(userCredentials.UserName, userCredentials.Password), deadline: TimeSpan.FromMinutes(1)).ConfigureAwait(false);
Expected behavior
The status is returned so we can verify if the projections should be started/stopped.
Actual behavior
Sometimes an exception is thrown. The exception client side is DeadlineExceeded. See screenshot for the exception on the server side.
Config/Logs/Screenshots
The error log:
EventStore details
Additional context
Our final goal is to start with EventStore from scratch. And after EventStore has been started the system projection 'by_category' should be enabled. The other system projections should be disabled.
We've also tried to just make the call to disable/enable the projections without receiving the status first. This however resulted in the same exception.
The stacktrace on client side:
The text was updated successfully, but these errors were encountered: