Skip to content
This repository has been archived by the owner on Apr 24, 2023. It is now read-only.

Batch writes of instance exit codes #901

Open
shamsimam opened this issue Jun 27, 2018 · 0 comments
Open

Batch writes of instance exit codes #901

shamsimam opened this issue Jun 27, 2018 · 0 comments

Comments

@shamsimam
Copy link
Contributor

shamsimam commented Jun 27, 2018

Is your feature request related to a problem? Please describe.

This line in scheduler.c;lj seems problematic:
(datomic/transact-with-retries conn [[:db/add instance-id :instance/exit-code (int exit-code)]])))))

Reduces the overhead of writing to datomic via batching.

Describe the solution you'd like

Use a process similar to the progress messages or sandbox syncer to aggregate and reduce number of transactions sent to datomic.

Describe alternatives you've considered

None.

Additional context

We are wary of the load we are putting on datomic. There is a feeling that aggregating transactions mitigates against the scenario of overloading datomic.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants