Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate rclone bucket emptying delay #459

Open
0x2b3bfa0 opened this issue Mar 24, 2022 · 1 comment · May be fixed by #469
Open

Investigate rclone bucket emptying delay #459

0x2b3bfa0 opened this issue Mar 24, 2022 · 1 comment · May be fixed by #469
Assignees
Labels
p2-nice-to-have Low priority research Waiting for team investigation technical-debt Refactoring, linting & tidying

Comments

@0x2b3bfa0
Copy link
Member

This issue was solved by reverting partially the change the introduced the regression, but the exact causes are still unknown.

The bucket emptying method introduced with #420 returns almost immediately, but files take a few minutes more to disappear. I suspect that rclone is using some trickery to empty the bucket in the server side (e.g. expiration time) and returns as soon as the deletion begins.

Can be reproduced with v0.10.0 in a storage.workdir filled with files:

mkdir --parents stress/{1..10}/{1..10}/{1..10}
yes | head | tee stress/{1..10}/{1..10}/{1..10}/file
@0x2b3bfa0 0x2b3bfa0 changed the title Investigate #452 & #453 Investigate rclone bucket emptying delay Mar 24, 2022
@0x2b3bfa0 0x2b3bfa0 self-assigned this Mar 24, 2022
@0x2b3bfa0 0x2b3bfa0 added technical-debt Refactoring, linting & tidying p2-nice-to-have Low priority research Waiting for team investigation labels Mar 24, 2022
This was referenced Mar 24, 2022
@casperdcl
Copy link
Contributor

I just got #452 on v0.10.0 despite having just 1 file (no folders) to sync (fixed by v0.10.3)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
p2-nice-to-have Low priority research Waiting for team investigation technical-debt Refactoring, linting & tidying
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants