Intermittent failure on ocis wrapper

[amrita-shrestha]

Describe the bug

Build: https://drone.owncloud.com/owncloud/ocis/34924/29/5

 Scenario Outline: get the list of resources with depth infinity                           # /drone/src/tests/acceptance/features/apiDepthInfinity/propfind.feature:28
    Given using <dav-path-version> DAV path                                                 # FeatureContext::usingOldOrNewDavPath()
    When user "Alice" lists the resources in "/" with depth "infinity" using the WebDAV API # FeatureContext::userListsTheResourcesInPathWithDepthUsingTheWebdavApi()
    Then the HTTP status code should be "207"                                               # FeatureContext::thenTheHTTPStatusCodeShouldBe()
    And the last DAV response for user "Alice" should contain these nodes                   # FeatureContext::theLastDavResponseShouldContainTheseNodes()
      | name                                                      |
      | textfile0.txt                                             |
      | welcome.txt                                               |
      | simple-folder/                                            |
      | simple-folder/textfile0.txt                               |
      | simple-folder/welcome.txt                                 |
      | simple-folder/simple-empty-folder/                        |
      | simple-folder/simple-folder1/                             |
      | simple-folder/simple-folder1/simple-folder2               |
      | simple-folder/simple-folder1/textfile0.txt                |
      | simple-folder/simple-folder1/welcome.txt                  |
      | simple-folder/simple-folder1/simple-folder2/textfile0.txt |
      | simple-folder/simple-folder1/simple-folder2/welcome.txt   |

    Examples:
      | dav-path-version |
      | old              |
      │
      ╳  Server error: `DELETE http://ocis-server:5200/rollback` resulted in a `500 Internal Server Error` response:
      ╳  {"message":"Unable to start oCIS server","status":"ERROR"}
      ╳   (GuzzleHttp\Exception\ServerException)
      │
      └─ @AfterScenario @env-config # OcisConfigContext::rollbackOcis()
      | new              |
      │
      ╳  Fatal error: Cannot connect to the ociswrapper at the moment, make sure that ociswrapper is running before proceeding with the test run.
      ╳  cURL error 28: Operation timed out after 60027 milliseconds with 0 bytes received (see https://curl.haxx.se/libcurl/c/libcurl-errors.html) for http://ocis-server:5200/rollback (Behat\Testwork\Call\Exception\FatalThrowableError)
      │
      └─ @AfterScenario @env-config # OcisConfigContext::rollbackOcis()
      | spaces           |

  Scenario Outline: get the list of resources of a folder with depth infinity                           # /drone/src/tests/acceptance/features/apiDepthInfinity/propfind.feature:53
    Given using <dav-path-version> DAV path                                                             # FeatureContext::usingOldOrNewDavPath()
    When user "Alice" lists the resources in "simple-folder" with depth "infinity" using the WebDAV API # FeatureContext::userListsTheResourcesInPathWithDepthUsingTheWebdavApi()
    Then the HTTP status code should be "207"                                                           # FeatureContext::thenTheHTTPStatusCodeShouldBe()
    And the last DAV response for user "Alice" should contain these nodes                               # FeatureContext::theLastDavResponseShouldContainTheseNodes()
      | name                                                      |
      | simple-folder/textfile0.txt                               |
      | simple-folder/welcome.txt                                 |
      | simple-folder/simple-folder1/                             |
      | simple-folder/simple-folder1/simple-folder2               |
      | simple-folder/simple-folder1/textfile0.txt                |
      | simple-folder/simple-folder1/welcome.txt                  |
      | simple-folder/simple-folder1/simple-folder2/textfile0.txt |
      | simple-folder/simple-folder1/simple-folder2/welcome.txt   |

    Examples:
      | dav-path-version |
      | old              |
      | new              |
      | spaces           |
      │
      ╳  Server error: `DELETE http://ocis-server:5200/rollback` resulted in a `500 Internal Server Error` response:
      ╳  {"message":"Unable to start oCIS server","status":"ERROR"}
      ╳   (GuzzleHttp\Exception\ServerException)
      │
      └─ @AfterScenario @env-config # OcisConfigContext::rollbackOcis()

  Scenario: get the list of resources in a folder shared through public link with depth infinity                   # /drone/src/tests/acceptance/features/apiDepthInfinity/propfind.feature:74
    Given the config "OCDAV_ALLOW_PROPFIND_DEPTH_INFINITY" has been set to "true"                                  # OcisConfigContext::theConfigHasBeenSetTo()
      Fatal error: Cannot connect to the ociswrapper at the moment, make sure that ociswrapper is running before proceeding with the test run.
      cURL error 28: Operation timed out after 60020 milliseconds with 0 bytes received (see https://curl.haxx.se/libcurl/c/libcurl-errors.html) for http://ocis-server:5200/config (Behat\Testwork\Call\Exception\FatalThrowableError)
    Given using new DAV path                                                                                       # FeatureContext::usingOldOrNewDavPath()
    And using SharingNG                                                                                            # FeatureContext::usingSharingNG()
    And the following configs have been set:                                                                       # OcisConfigContext::theConfigHasBeenSetToValue()
      | config                                       | value |
      | OCDAV_ALLOW_PROPFIND_DEPTH_INFINITY          | true  |
      | OCIS_SHARING_PUBLIC_SHARE_MUST_HAVE_PASSWORD | false |
    And user "Alice" has created the following resource link share:                                                # SharingNgContext::userHasCreatedTheFollowingResourceLinkShare()
      | resource        | simple-folder |
      | space           | Personal      |
      | permissionsRole | view          |
    When the public lists the resources in the last created public link with depth "infinity" using the WebDAV API # FeatureContext::thePublicListsTheResourcesInTheLastCreatedPublicLinkWithDepthUsingTheWebdavApi()
    Then the HTTP status code should be "207"                                                                      # FeatureContext::thenTheHTTPStatusCodeShouldBe()
    And the last public link DAV response should contain these nodes                                               # FeatureContext::theLastPublicDavResponseShouldContainTheseNodes()
      | name                                        |
      | textfile0.txt                               |
      | welcome.txt                                 |
      | simple-folder1/                             |
      | simple-folder1/welcome.txt                  |
      | simple-folder1/simple-folder2               |
      | simple-folder1/textfile0.txt                |
      | simple-folder1/simple-folder2/textfile0.txt |
      | simple-folder1/simple-folder2/welcome.txt   |

oCIS Logs:

2024/05/14 06:51:51 [ociswrapper] Stopping oCIS server...
{"level":"error","service":"storage-publiclink","server":"reva","time":"2024-05-14T06:51:51Z","message":"Shutting down server"}
{"level":"error","service":"groups","server":"groups","time":"2024-05-14T06:51:51Z","message":"Shutting down server"}
{"level":"error","service":"storage-system","server":"reva","time":"2024-05-14T06:51:51Z","message":"Shutting down server"}
{"level":"error","service":"storage-shares","server":"reva","time":"2024-05-14T06:51:51Z","message":"Shutting down server"}
2024/05/14 06:51:51 [ociswrapper] Restarting oCIS server...
2024/05/14 06:51:52 INFO memory is not limited, skipping: %v package=github.com/KimMachineGun/automemlimit/memlimit !BADKEY="memory is not limited"
2024/05/14 06:51:55 [ociswrapper] All services are up
2024/05/14 06:51:58 [ociswrapper] oCIS server is ready to accept requests
{"level":"error","service":"storage-users","pkg":"rgrpc","traceid":"c9ec34ef3666b636b576b3ddb17fd021","error":"node.Xattr /root/.ocis/storage/users/spaces/67/795bbc-ed3b-4ff7-b4a8-1dc7a3ef6a7d/nodes/67/79/5b/bc/-ed3b-4ff7-b4a8-1dc7a3ef6a7d user.ocis.name: no data available","id":"67795bbc-ed3b-4ff7-b4a8-1dc7a3ef6a7d","time":"2024-05-14T06:52:01Z","message":"could not read node"}
{"level":"error","service":"storage-users","pkg":"rgrpc","traceid":"c9ec34ef3666b636b576b3ddb17fd021","error":"node.Xattr /root/.ocis/storage/users/spaces/67/795bbc-ed3b-4ff7-b4a8-1dc7a3ef6a7d/nodes/67/79/5b/bc/-ed3b-4ff7-b4a8-1dc7a3ef6a7d user.ocis.name: no data available","status":{"code":15,"message":"error listing spaces","trace":"c9ec34ef3666b636b576b3ddb17fd021"},"filters":[{"type":2,"Term":{"Id":{"opaque_id":"a4c09af3-29b7-4dd5-8f66-9841046ba05c$67795bbc-ed3b-4ff7-b4a8-1dc7a3ef6a7d!67795bbc-ed3b-4ff7-b4a8-1dc7a3ef6a7d"}}},{"type":4,"Term":{"SpaceType":"+grant"}}],"time":"2024-05-14T06:52:01Z","message":"failed to list storage spaces"}
2024/05/14 06:52:01 [ociswrapper] Stopping oCIS server...
{"level":"error","service":"storage-publiclink","server":"reva","time":"2024-05-14T06:52:01Z","message":"Shutting down server"}
2024/05/14 06:52:02 [ociswrapper] Restarting oCIS server...
2024/05/14 06:52:02 INFO memory is not limited, skipping: %v package=github.com/KimMachineGun/automemlimit/memlimit !BADKEY="memory is not limited"
2024/05/14 06:52:05 [ociswrapper] All services are up
2024/05/14 06:52:39 http: proxy error: context canceled
{"level":"error","service":"graph","request-id":"ociswrapper-1715669525388","error":"rpc error: code = Canceled desc = context canceled","time":"2024-05-14T06:52:39Z","message":"could not get drives: transport error"}
{"level":"error","service":"storage-shares","pkg":"rgrpc","traceid":"db0393364c9c57d741c314a8f880896a","user-agent":"grpc-go/1.63.2","from":"tcp://127.0.0.1:40984","uri":"/cs3.storage.provider.v1beta1.ProviderAPI/ListStorageSpaces","start":"14/May/2024:06:52:14 +0000","end":"14/May/2024:06:52:39 +0000","time_ns":25090454737,"code":"Canceled","time":"2024-05-14T06:52:39Z","message":"sharesstorageprovider: error calling ListReceivedSharesRequest: sharesstorageprovider: error calling ListReceivedSharesRequest: rpc error: code = Canceled desc = context canceled"}
2024/05/14 06:52:40 [ociswrapper] 30 seconds timeout waiting for oCIS server