feat: Hot CAS Entries - Implement CAS access metrics recorder #1465

amishra-u · 2023-10-02T20:32:44Z

https://docs.google.com/document/d/12fSpsr_UnOOoeZU0zS4KT0IVQhDoQYUsoIO0f-YA__Q/edit#heading=h.gxowpjqc6bbi

werkt

Please incorporate usage of this new class into this PR - separating them leaves this as an orphaned commit with no obvious introduction of behavior.

werkt · 2023-10-31T13:45:08Z

src/main/java/build/buildfarm/cas/cfc/CASAccessMetricsRecorder.java

+ private void updateReadCount() {
+ Stopwatch stopwatch = Stopwatch.createStarted();
+ Map<Digest, AtomicInteger> lastIntervalReadCount;
+ lock.writeLock().lock(); // Ensure all threads writes to new interval.


Use try-with-resources for these blocks

The ReadWriteLock doesn't implements AutoCloseable. so moved the closeable logic into separate method.
i.e runWithLock.

amishra-u · 2023-10-31T20:48:20Z

Please incorporate usage of this new class into this PR - separating them leaves this as an orphaned commit with no obvious introduction of behavior.

Sure, will merge all the PRs. There may be too many files to review :(

author Anshuman Mishra <[email protected]> 1696277984 -0700 committer Anshuman Mishra <[email protected]> 1700707781 -0800 parent 90439ca author Anshuman Mishra <[email protected]> 1696277984 -0700 committer Anshuman Mishra <[email protected]> 1700707757 -0800 parent 90439ca author Anshuman Mishra <[email protected]> 1696277984 -0700 committer Anshuman Mishra <[email protected]> 1700707511 -0800 feat: Hot CAS Entries - Implement CAS access metrics recorder Log on write errors Use integer ids for Sqlite bidirectional index The cost in size for a single table bidirectional index is vast compared to the use of 3nf integer keys. Experimental estimates offer a decrease in file size of 90%. Update graceful shutdown functionality to better handle worker terminations (bazelbuild#1462) Manipulate worker set directly in RSB Avoid dependency on subscriber to update state changes when removing workers. This prevents an NPE which will occur invariably when workers are allowably configured with subscribeToBackplane: false. Remove publishTtlMetric option The individual metric controls for ttl are not necessary either for performance or feature support. Use Files' attributes acquisition mechanism for modified time. Config-compatible behavior for publishTtlMetric Correct logging advisements for current Java Java logging definitions must now match java.util.logging.config.file, update these specifications in our README.md Rename GracefulShutdownTest Remove WebController Interrupt+Join operationQueuer/dispatchMonitor Use interrupt to halt the OperationQueuer. Join on both operationQueuer and dispatchMonitor before instance stop return. Present operationNames by stage Include Match and Report Result stages in output Record the active operationName occupying slots in each of the stages and present them with WorkerProfile Avoid several unnecessary casts with interfaces for operation slot stages. Remove subscribeToBackplane, adjust failsafe op A shard server is impractical without operation subscription, partition subscription confirmation between servers and workers. The failsafe execution is configuration that is likely not desired on workers. This change removes the failsafe behavior from workers via backplane config, and relegates the setting of failsafe boolean to server config. If the option is restored for workers, it can be added to worker configs so that configs may continue to be shared between workers and servers and retain independent addressability. Removing AWS/GCP Metrics and Admin controls Internally driven metrics and scaling controls have low, if any, usage rates. Prometheus has largely succeeded independent publication of metrics, and externally driven scaling is the norm. These modules have been incomplete between cloud providers, and for the functional side of AWS, bind us to springboot. Removing them for the sake of reduced dependencies and complexity. Remove unused setOnCancelHandler Remove this unused OperationQueue feature which provides no invocations on any use. Update BWoB docs for ensureOutputsPresent Improve unit test Disable Bzlmod explicitly in .bazelrc Log write errors with worker address Revert "Use integer ids for Sqlite bidirectional index" This reverts commit f651cdb. Common String.format for PipelineStage Cleanup matched logic in SWC listener Continue the loop while we have *not* matched successfully and avoid a confusing inversion in getMatched() Refactor SWC matcher and clarify Nullable Distinguish the valid/unique/propagating methods of entry listening. Interrupt matchStage to induce prepare shutdown The only signal to a waiting match that will halt its current listen loop for a valid unique operation is an interrupt. Specify example config with grpc target Distinguish target param with GRPC type storage from FILESYSTEM definition Remove SpringBoot usage Reinstate prior usage of LoggingMain for safe shutdown, with added release mechanism for interrupted processes. All invoked shutdowns are graceful, with vastly improved shutdown speed for empty workers waiting for pipeline stages. Enable graceful shutdown for server (bazelbuild#1490) refactor: code cleanup Tiny code cleanup Log paths created on putDirectory Will include operation root and inform directory cache effectiveness. Permit regex realInputDirectories Selecting realInputDirectories by regex permits flexible patterns that can yield drastic improvements in directory reuse for specialized deployments. runfiles in particular are hazardous expansions of nearly-execroot in the case of bazel. Care must be taken to match directories exclusively. The entire input tree is traversed for matches against expanded paths under the root, to allow for nested selection. Each match thus costs the number of input directories. Counterintuitively, OutputFiles are augmented to avoid the recursive check for OutputDirectories which only applies to actual reported results, resulting in a path match when creating the exec root. Regex style is java.util.Pattern, and must match the full input directory. Log execPath rather than the cache dir path This will include the path to the missed directory and the operation which required it. Shore up OutputDirectory for silence on duplicates Prevent adding duplicate realInputDirectories matches Trigger realInputDirectories to have empty files Ensure that the last leg of the execution presents a directory, rather than the parent, per OutputDirectory's stamping. Switch to positive check for linkInputDirectories docs(configuration): document --prometheus_port CLI argument docs(configuration): readability and typos style(configuration.md): table formatting feat: support --redis_uri command line option Support a `--redis_uri` command line option for start-up. docs(configuration): document the --redis_uri command line options also fixed some spelling typos. Example should use `container_image` instead of `java_image` chore: bump rules_jvm_external Bumping 4.2 -> 5.3 chore: bump rules_cc Bump fro 0.0.6 -> 0.0.9 Implement local resources for workers (bazelbuild#1282) Suppress unused warning Bump bazel version, otherwise some test fail with System::setSecurityManager Revert bazel upgrade New line at end of file feat: Hot CAS Entries - Update read counts in Redis feat: Hot CAS Entries - Final Integration build: override grpc dependencies with our dependencies Don't get transitive grpc dependencies, use the ones from our `maven_install(...)` chore(deps): bump protobuf runtime to 3.19.1 chore(deps) add transitive dependencies feat: add Proto reflection service to shard worker To aid connection troubleshooting Bug: Fix Blocked thread in WriteStreamObserver Caused by CASFile Write (bazelbuild#1486) * Add unit test * Signal Write on complete Pin the Java toolchain to `remotejdk_17` (bazelbuild#1509) Closes bazelbuild#1508 Cleanups: - remove the unused `ubuntu-bionic` base image - replace `ubuntu-jammy:jammy-java11-gcc` with `ubuntu-mantic:mantic-java17-gcc` - replace `amazoncorretto:19` with `ubuntu-mantic:mantic-java17-gcc` - swap inverted log file names in a file docs: add markdown language specifiers for code blocks Support OutputPaths in OutputDirectory Specifying any number of OutputPaths will ignore OutputFiles (consistent with uploads). Where an OutputPath specifies an output directory, the action must be able to create the directory itself. Permit Absolute Symlink Targets with configuration Partial specification of the absolute symlink response per REAPI. Remaining work will be in output identification. chore: update bazel to 6.4.0 (bazelbuild#1513) Trying to get more info on the Lombok stamping issue on Windows CI. See also bazelbuild/bazel#10363 and bazelbuild/bazel#18185 Rename instance types (bazelbuild#1514) Create SymlinkNode outputs during upload (bazelbuild#1515) Default disabled, available with createSymlinkOutputs option in Worker config. feat: Implement CAS lease extension (bazelbuild#1455) Problem Enabling the findMissingBlobsViaBackplane flag in BuildfarmServer eliminates the need for the BuildfarmWorker's fmb API call. This BuildfarmWorker:fmb call was also responsible for tracking CAS entry access. As result, our CAS cache eviction strategy shifted from LRU to FIFO. When the findMissingBlobsViaBackplane flag is enabled, the buildfarm relies on the backplane as the definitive source for CAS availability. Since we don't update CAS expiry on each access, the backplane will independently expire CAS entries based on the specified cas_expire duration, even if they are actively being read. Solution Updated bfServer:fmb call to perform non-blocking fmb calls to workers, allowing these workers to record access for the relevant CAS entries. Extended expiry duration for available CAS entries in the backplane on each fmb call. With these changes, we can utilize Bazel's experimental_remote_cache_lease_extension and experimental_remote_cache_ttl flags for incremental builds. Closes bazelbuild#1428 Bump org.json:json from 20230227 to 20231013 in /admin/main (bazelbuild#1516) Bumps [org.json:json](https://github.com/douglascrockford/JSON-java) from 20230227 to 20231013. - [Release notes](https://github.com/douglascrockford/JSON-java/releases) - [Changelog](https://github.com/stleary/JSON-java/blob/master/docs/RELEASES.md) - [Commits](https://github.com/douglascrockford/JSON-java/commits) --- updated-dependencies: - dependency-name: org.json:json dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Re-add missing graceful shutdown functionality (bazelbuild#1520) Technically correct to unwrap EE on lock failure Bump rules_oss_audit and patch for py3.11 Prevent healthStatusManager NPE on start failure Consistent check for publicName presence Read through external with query THROUGH=true Specifying a correlated invocation id with a uri containing a THROUGH=true query param will cause the CFC to read a blob through an external input stream, populating locally along the way. This permits client-based replication of blobs, and can enable N+1 replication and traffic balancing for reads. Add --port option to worker Option to run the worker with a cmdline specification for its gRPC server port. Restore worker --root cmdline specification Root cmdline specification has been broken since the config change of v2. Make bf-executor small blob names consistent Remove the size identification for small blobs when uploading with bf-executor. feat: Hot CAS Entries - Update read counts in Redis chore(deps): bump protobuf runtime to 3.19.1 chore(deps) add transitive dependencies feat: add Proto reflection service to shard worker To aid connection troubleshooting Bug: Fix Blocked thread in WriteStreamObserver Caused by CASFile Write (bazelbuild#1486) * Add unit test * Signal Write on complete Pin the Java toolchain to `remotejdk_17` (bazelbuild#1509) Closes bazelbuild#1508 Cleanups: - remove the unused `ubuntu-bionic` base image - replace `ubuntu-jammy:jammy-java11-gcc` with `ubuntu-mantic:mantic-java17-gcc` - replace `amazoncorretto:19` with `ubuntu-mantic:mantic-java17-gcc` - swap inverted log file names in a file docs: add markdown language specifiers for code blocks Support OutputPaths in OutputDirectory Specifying any number of OutputPaths will ignore OutputFiles (consistent with uploads). Where an OutputPath specifies an output directory, the action must be able to create the directory itself. chore: update bazel to 6.4.0 (bazelbuild#1513) Trying to get more info on the Lombok stamping issue on Windows CI. See also bazelbuild/bazel#10363 and bazelbuild/bazel#18185 Rename instance types (bazelbuild#1514) Create SymlinkNode outputs during upload (bazelbuild#1515) Default disabled, available with createSymlinkOutputs option in Worker config. feat: Implement CAS lease extension (bazelbuild#1455) Problem Enabling the findMissingBlobsViaBackplane flag in BuildfarmServer eliminates the need for the BuildfarmWorker's fmb API call. This BuildfarmWorker:fmb call was also responsible for tracking CAS entry access. As result, our CAS cache eviction strategy shifted from LRU to FIFO. When the findMissingBlobsViaBackplane flag is enabled, the buildfarm relies on the backplane as the definitive source for CAS availability. Since we don't update CAS expiry on each access, the backplane will independently expire CAS entries based on the specified cas_expire duration, even if they are actively being read. Solution Updated bfServer:fmb call to perform non-blocking fmb calls to workers, allowing these workers to record access for the relevant CAS entries. Extended expiry duration for available CAS entries in the backplane on each fmb call. With these changes, we can utilize Bazel's experimental_remote_cache_lease_extension and experimental_remote_cache_ttl flags for incremental builds. Closes bazelbuild#1428 Bump org.json:json from 20230227 to 20231013 in /admin/main (bazelbuild#1516) Bumps [org.json:json](https://github.com/douglascrockford/JSON-java) from 20230227 to 20231013. - [Release notes](https://github.com/douglascrockford/JSON-java/releases) - [Changelog](https://github.com/stleary/JSON-java/blob/master/docs/RELEASES.md) - [Commits](https://github.com/douglascrockford/JSON-java/commits) --- updated-dependencies: - dependency-name: org.json:json dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Re-add missing graceful shutdown functionality (bazelbuild#1520) Technically correct to unwrap EE on lock failure Bump rules_oss_audit and patch for py3.11 Prevent healthStatusManager NPE on start failure Consistent check for publicName presence Read through external with query THROUGH=true Specifying a correlated invocation id with a uri containing a THROUGH=true query param will cause the CFC to read a blob through an external input stream, populating locally along the way. This permits client-based replication of blobs, and can enable N+1 replication and traffic balancing for reads. Add --port option to worker Option to run the worker with a cmdline specification for its gRPC server port. Restore worker --root cmdline specification Root cmdline specification has been broken since the config change of v2. Make bf-executor small blob names consistent Remove the size identification for small blobs when uploading with bf-executor. Configured output size operation failure Permit installations to control the failure process for operations which produce outputs larger than the maxEntrySizeBytes. A default value of false retains the existing behavior which appears transient and blacklists the executed action key. When enabled, the action will fail under an invalid violation that indicates user error. Restore abbrev port as -p Update zstd-jni for latest version There's been a few releases of it by now and this pulls the latest. For buildfarm, notable changes included performance enhancments during decompression. See: https://github.com/facebook/zstd/releases/tag/v1.5.5 Attempt to resolve windows stamping Bug: Fix workerSet update logic for RemoteCasWriter Detail storage requirements Update for further docs related to storage+type functionality Remove outdated Operation Queue worker definitions Fix worker execution env title Add storage example descriptions Check for context cancelled before responding to error (bazelbuild#1526) When a write fails because the write was already cancelled before due to something like deadline exceeded, we get an unknown error. The exception comes from here and when it gets to errorResponse(), it only checks if status code is cancelled. In this case the status code is unknown, so we need to check if context is cancelled to prevent responseObserver from being invoked The code change adds checking if context is cancelled and a unit test testing when the exception has context cancelled. chore(deps): bump com.google.errorprone:error-prone Release notes: https://github.com/google/error-prone/releases/tag/v2.22.0 Write logs and cleaup Run formatter Fix main merge remove cleanup Minor updates Worker name execution properties matching updates updates updates updates updates Update ShardWorkerContext.java Update ShardWorkerContext.java Release resources when not keeping an operation (bazelbuild#1535) Update queues.md Refer to new camelized DMS fields. Expand predefined dynamic execution property name matches. Implement custom label header support for Grpc metrics interceptor (bazelbuild#1530) Add an option to provide a list of custom label headers to add to metrics. Specify direct guava dependency usage (bazelbuild#1538) Testing with bazel HEAD using jdk21 compilation has revealed new direct dependencies on guava. Update lombok dependency for jdk21 (bazelbuild#1540) Annotations under lombok were fixed for jdk21 in 1.18.28, update to current. Reorganize DequeueMatchEvaluator (bazelbuild#1537) Remove acceptEverything DequeueMatchSetting Place worker name in workerProvisions Only enable allowUnmatched effects on key mismatch Only acquire resources after asserting compatibility Update documentation to match changes Upgrade com_google_protobuf for jvm compatibility (bazelbuild#1539) Correct deprecated AccessController usage warning Requires a newer bazel than 6.4.0 for macos to choose unix toolchain with C++ std=c++14 specification for protobuf->absl dependency. Create buildfarm-worker-base-build-and-deploy.yml (bazelbuild#1534) Create a github workflow to build base buildfarm worker image. Add base image generation scripts (bazelbuild#1532) Fix buildfarm-worker-base-build-and-deploy.yml (bazelbuild#1541) Add public buildfarm image generation actions (bazelbuild#1542) Update base image building action (bazelbuild#1544) Add release image generation action (bazelbuild#1545) Limit workflow to canonical repository (bazelbuild#1547) Check for "cores" exec property as min-cores match (bazelbuild#1548) The execution platform property "cores" is detailed in documentation as specifying "min-cores" and "max-cores". Match this definition and prevent "cores" from being evaluated as a strict match with the worker provision properties (with likely rejection). Consider output_* as relative to WD (bazelbuild#1550) Per the REAPI spec: `The paths are relative to the working directory of the action execution.` Prefix the WorkingDirectory to paths used as OutputDirectory parameters, and verify that these are present in the layout of the directory for use. Implement Persistent Workers as an execution path (bazelbuild#1260) Followup to bazelbuild#1195 Add a new execution pathway in worker/Executor.java to use persistent workers via PersistentExecutor, like DockerExecutor. Mostly unchanged from the form we used to experiment back at Twitter, but now with tests. Co-authored-by: Shane Delmore [email protected] Locate Output Paths relative to WorkingDirectory (bazelbuild#1553) * Locate Output Paths relative to WorkingDirectory Required as a corollary to OutputDirectory changes to consider outputs as relative to working directory. * Windows builds emit relativize paths with native separators Remove incorrect external resolve of WD on upload (bazelbuild#1554) Previous patch included a change in actionRoot parameter, expecting it to prefer the working directory rooted path to discover outputs. Might want to reapply this later, but for now leave the resolution in uploadOutputs. empty

amishra-u · 2023-11-23T03:59:39Z

Please incorporate usage of this new class into this PR - separating them leaves this as an orphaned commit with no obvious introduction of behavior.

@werkt Merged all commits into one. Please take a look.

werkt · 2024-01-07T01:26:00Z

src/main/java/build/buildfarm/backplane/Backplane.java

+ Map<String, Integer> updateCasReadCount(Stream<Map.Entry<Digest, Integer>> casReadCountStream)
+ throws IOException;
+
+ /**
+ * Removes the CAS read count entries from the storage.
+ *
+ * @param digestsToBeRemoved CAS entries for which each read count needs to be removed.
+ * @return total count of cas read count entries removed.
+ */
+ int removeCasReadCountEntries(Stream<Digest> digestsToBeRemoved) throws IOException;


Why are you using a Stream as an interface specification? Typically these are Iterables

Changed them to Iterable, as it is more conventional .

Used Stream to leverage its functional programming capabilities and lazy evaluation, as I was performing transformations on each element. These transformations are relatively simple and don't benefit from the features offered by streams.

werkt · 2024-01-07T01:29:26Z

src/main/java/build/buildfarm/cas/BUILD

@@ -7,6 +7,7 @@ java_library(
 "@maven//:org_xerial_sqlite_jdbc",
 ],
 deps = [
+ "//src/main/java/build/buildfarm/backplane",


It is odd to present the backplane interface to the CFC. It only makes use of a small part of it, and other instances where the CFC influences distributed content (i.e. the CAS index) have been accomplished with callbacks, and this bleeds the requirements for a backplane at all into the CAS.

Thanks for pointing out. Agreed metrics package is more suitable for this. Moved.

werkt · 2024-01-07T01:30:25Z

src/main/java/build/buildfarm/cas/cfc/CASAccessMetricsRecorder.java

+ */
+@Log
+public final class CASAccessMetricsRecorder {
+ private final ScheduledExecutorService scheduler = Executors.newSingleThreadScheduledExecutor();


This scheduled executor service should be injected.

werkt · 2024-01-07T01:31:02Z

src/main/java/build/buildfarm/cas/cfc/CASAccessMetricsRecorder.java

+
+ private final Deque<Map<Digest, AtomicInteger>> readIntervalCountQueue;
+
+ private volatile Map<Digest, AtomicInteger> currentIntervalReadCount;


By what measure is this 'volatile'?

currentIntervalReadCountis updated - at the end of each interval, it is set to reference a new object.currentIntervalReadCount` is accessed by all cas read/write threads. Without volatile keyword cas read/write threads may have its stale reference.

werkt · 2024-01-07T01:33:26Z

src/main/java/build/buildfarm/cas/cfc/CASFileCache.java

+ RequestMetadata requestMetadata = TracingMetadataUtils.fromCurrentContext();
+ log.log(
+ Level.INFO,
+ format(
+ "Successfully wrote: %s; metadata: actionId - %s, actionMnemonic - %s, target - %s",
+ key,
+ requestMetadata.getActionId(),
+ requestMetadata.getActionMnemonic(),
+ requestMetadata.getTargetId()));


Why is this a) assumption of grpc context and b) unrelated-to-access metrics log entry in this change?

There is no easy way to reverse map an digest to ActionMenomnic and target pair. I needed this to find targets with indeterminism. Definitely unrelated to cas access metrics, removed will create another PR for this change.

werkt · 2024-01-07T01:34:26Z

src/main/java/build/buildfarm/cas/cfc/CASAccessMetricsRecorder.java

@@ -0,0 +1,242 @@
+package build.buildfarm.cas.cfc;


This does not belong in the cas (let alone cfc) package - a more appropriate location is a peer to the metrics presentation endpoint. Moving it out will alleviate the backplane interface bleed noted above.

Moved under metrics package.

werkt · 2024-01-07T01:37:40Z

src/main/java/build/buildfarm/instance/shard/RedisShardBackplane.java

+ entry ->
+ new AbstractMap.SimpleEntry<>(
+ entry.getKey().getHash(), entry.getValue()))));


There are some Maps transformations that would be suitable in guava for this. The Map is looking like a better candidate for interface parameter typing as well.

Changed it to traditional forEach. I wasn't able to find any method to transform keys in guava something like Maps.transformKeys.

werkt

looking better, still needs some changes.

werkt · 2024-01-29T20:43:23Z

src/main/java/build/buildfarm/metrics/cas/CASAccessMetricsRecorder.java

+ // during
+ // that interval but remained unread.


nit spacing

werkt · 2024-01-29T20:44:34Z

src/main/java/build/buildfarm/metrics/cas/CASAccessMetricsRecorder.java

+ if (digestsToExpire.isEmpty()) {
+ return;
+ }


flip the logic on this, and avoid the early return - encase below in if

werkt · 2024-01-29T20:51:58Z

src/main/java/build/buildfarm/metrics/cas/CASAccessMetricsRecorder.java

+ }
+ }
+
+ @SneakyThrows


Do not use this annotation. Change the signature to accept a Supplier.

werkt · 2024-01-29T20:58:13Z

src/main/java/build/buildfarm/metrics/cas/CASAccessMetricsRecorder.java

+ scheduler.shutdown();
+ if (!scheduler.awaitTermination(10, TimeUnit.SECONDS)) {
+ log.severe("Could not shut down cas access metrics recorder service");
+ }
+ scheduler.shutdownNow();


This class should not presume ownership of the scheduler it is passed - stop the recorder via this method, and stop the scheduler independently, owned (and maintained) by the caller

Moved logic to stop the scheduler in Worker class

Avoid stripping the existingHash, used to calculate the slot with suffix modifiers for queue balancing. Client presentation may also move to presenting each balanced queue name, removing the coordinated calculation on the client. The name could only have been used by a client prior for name presentation or determination of queue names in redis from slot arrangement.

* set expire and drop invocationId * fix format * patch configuration doc * fix typo * re-run ci use luxe's patch * set expire when every active operation insert * fix return code * fix ci if statement --------- Co-authored-by: wangpengfei.pfwang <[email protected]> Co-authored-by: George Gensure <[email protected]>

* feat: add OSSF Scorecards workflow Adding OSSF Scorecards workflow as github action. It runs periodially. Output goes into Code Scanning alerts of GitHub. * docs(README): add some badges - OSSF Scorecard - License (from GitHub) - latest Release (from GitHub)

Remove rules_oss_audit and accompanying documentation

src/main/java/build/buildfarm/common/redis/RedisSortedSet.java

amishra-u requested a review from werkt as a code owner October 2, 2023 20:32

This was referenced Oct 19, 2023

feat: Hot CAS Entries - Update read counts in Redis amishra-u/bazel-buildfarm#2

Merged

feat: Hot CAS Entries - Final Integration amishra-u/bazel-buildfarm#3

Merged

werkt requested changes Oct 31, 2023

View reviewed changes

amishra-u force-pushed the hot_keys branch from fa0270c to a110fe8 Compare November 23, 2023 02:56

amishra-u added 3 commits November 22, 2023 19:03

merge

c14bc16

Merge remote-tracking branch 'origin/main' into hot_keys

607db2e

fix merge error

6471206

amishra-u requested a review from werkt November 23, 2023 03:59

amishra-u and others added 4 commits January 3, 2024 11:04

Merge branch 'bazelbuild:main' into hot_keys

b319df5

Merge branch 'main' into hot_keys

3e6a5a0

resolve merge conflict

ead39cf

test annotation

4c8c6da

werkt requested changes Jan 7, 2024

View reviewed changes

amishra-u and others added 4 commits January 21, 2024 19:42

Merge branch 'bazelbuild:main' into hot_keys

36c0b3d

incorporate feedback

faa2ad9

remove unrelated change

9108250

fix BUILD

8aca413

werkt requested changes Jan 29, 2024

View reviewed changes

amishra-u and others added 8 commits February 1, 2024 10:51

incorporate feedback 2

974e37c

bf-cat Output salt/platform, deindent command (bazelbuild#1615)

11efbd9

chore: remove rules_oss_audit (bazelbuild#1617)

b3961f7

Remove rules_oss_audit and accompanying documentation

Merge branch 'main' into hot_keys

baaac9d

run formatter

8713302

fix unit test

13108a5

amishra-u requested a review from werkt February 1, 2024 19:51

amishra-u and others added 8 commits March 5, 2024 00:43

Merge branch 'bazelbuild:main' into hot_keys

4165754

Merge branch 'main' into hot_keys

da0215b

Merge branch 'main' into hot_keys

c8989c1

Update jedis pipeline lib

d77dc85

run formatter

c48bbda

fix formatting

553b955

fix formatting

a6e4199

Had to fix formatting in untouched files to pass the CI

b79207a

github-advanced-security bot found potential problems Apr 1, 2024

View reviewed changes

src/main/java/build/buildfarm/common/redis/RedisSortedSet.java Fixed Show fixed Hide fixed

amishra-u and others added 5 commits March 31, 2024 21:13

revert unrelated change

c75ef54

Remove unrelated change

853485a

fix linter issue

d7ea36e

Merge branch 'bazelbuild:main' into hot_keys

b53127c

Merge branch 'main' into hot_keys

9a6bbe5

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: Hot CAS Entries - Implement CAS access metrics recorder #1465

feat: Hot CAS Entries - Implement CAS access metrics recorder #1465

amishra-u commented Oct 2, 2023

werkt left a comment

werkt Oct 31, 2023

amishra-u Nov 23, 2023

amishra-u commented Oct 31, 2023

amishra-u commented Nov 23, 2023 •

edited

werkt Jan 7, 2024

amishra-u Jan 23, 2024

werkt Jan 7, 2024

amishra-u Jan 23, 2024

werkt Jan 7, 2024

amishra-u Jan 23, 2024

werkt Jan 7, 2024

amishra-u Jan 23, 2024

werkt Jan 7, 2024

amishra-u Jan 23, 2024

werkt Jan 7, 2024

amishra-u Jan 23, 2024

werkt Jan 7, 2024

amishra-u Jan 23, 2024

werkt left a comment

werkt Jan 29, 2024

werkt Jan 29, 2024

amishra-u Feb 1, 2024

werkt Jan 29, 2024

amishra-u Feb 1, 2024

werkt Jan 29, 2024

amishra-u Feb 1, 2024


		private final Deque<Map<Digest, AtomicInteger>> readIntervalCountQueue;

		private volatile Map<Digest, AtomicInteger> currentIntervalReadCount;

feat: Hot CAS Entries - Implement CAS access metrics recorder #1465

Are you sure you want to change the base?

feat: Hot CAS Entries - Implement CAS access metrics recorder #1465

Conversation

amishra-u commented Oct 2, 2023

werkt left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

amishra-u commented Oct 31, 2023

amishra-u commented Nov 23, 2023 • edited

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

werkt left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

amishra-u commented Nov 23, 2023 •

edited