Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

minimize storage impact from logging #123

Open
yarikoptic opened this issue Feb 4, 2022 · 1 comment
Open

minimize storage impact from logging #123

yarikoptic opened this issue Feb 4, 2022 · 1 comment

Comments

@yarikoptic
Copy link
Member

#122 enabled logging into a file at DEBUG level, which could come of great use for troubleshooting in case of errors.

But each log file is about 19MB and in a day we already amassed 0.5GB of them. Clearly it is a bit "wasteful" and we should do something about that. Some ideas

  • keep the log only if run errored out and otherwise remove (should probably be possible to setup I bet)
  • gzipping folds it to ~10% of its size. May be we should store them gzipped anyways -- why to waste space (although IIRC this partition also has file system level compression enabled)

@jwodder -- wdyt?

@jwodder
Copy link
Member

jwodder commented Feb 4, 2022

@yarikoptic Deleting the logfile on successful exit seems easier to implement.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants