0.5.0

Version: 0.5.0
Git ref: refs/tags/0.5.0
Build Date: 2024-04-23T23:09
PIP Package: chroma-0.5.0.tar.gz
Github Container Registry Image: ghcr.io/chroma-core/chroma:0.5.0
DockerHub Image: chromadb/chroma:0.5.0

What's Changed

• [ENH] Helm chart by @beggers in #1776
• [CLN] Fix CI and a couple other cleanups by @beggers in #1788
• [ENH] get collection info for compactor by @weiligu in #1778
• [ENH]: add rate limiting by @nicolasgere in #1728
• [PERF]: Minor docker compose quality of life improvements by @tazarov in #1753
• [ENH]: make rust docker image build faster with cache by @nicolasgere in #1730
• [ENH] readme for local postgres setup by @weiligu in #1795
• [ENH] FE talks to logservice by @weiligu in #1793
• [ENH]: add quota add limit by @nicolasgere in #1789
• [ENH]: add grpc python client interceptor by @nicolasgere in #1802
• [ENH] Refactor k8s manifests for configurability by @beggers in #1808
• [ENH]: go grpc interceptor server by @nicolasgere in #1803
• [ENH] add log id to pullLogs response by @weiligu in #1809
• [ENH]: rename go module and move to shared pkg by @nicolasgere in #1810
• [ENH] Add rust client to log service by @Ishiihara in #1811
• [DOC] Update pull_request_template.md by @HammadB in #1824
• [BLD] Remove hosted chroma workflow dispatches by @beggers in #1832
• [ENH]: OpenCLIP EF device param by @tazarov in #1806
• [BUG]: Added missing $not_contains operator for WhereDocument by @tazarov in #1781
• [BUG]: Deleting FTS entries upon deletion of individual records by @tazarov in #1689
• [ENH]: Updates to validation errors by @tazarov in #1703
• [DOC] add a bit more detail to the js client DEVELOP.md by @AlabasterAxe in #1829
• [ENH]: add grpc client interceptor by @nicolasgere in #1818
• [ENH] remove sysdb cache by @weiligu in #1835
• [ENH] helm chart tweaks by @beggers in #1836
• [ENH] Helm CD to hosted by @beggers in #1840
• [ENH] Blockfile provider by @HammadB in #1819
• [CLN] Run coordinator in /bin/sh by @beggers in #1816
• [ENH] log service staging by @weiligu in #1843
• [ENH] Add system scheduler to allow tasks to run with a schedule by @Ishiihara in #1839
• [ENH] Arrow-backed block by @HammadB in #1820
• [ENH] Block builder by @HammadB in #1821
• [ENH] Block iterator by @HammadB in #1822
• [DOC] Update and rename README to README.md by @HammadB in #1848
• [ENH] Compactor scheduler with system by @Ishiihara in #1844
• [TST] Scheduler test fix by @HammadB in #1851
• [TST] fix flacky coordinator tests by @weiligu in #1852
• [ENH] last compaction time by @weiligu in #1856
• [BLD] Add docker arg to build in release mode by @HammadB in #1859
• [ENH] Block delta by @HammadB in #1823
• [ENH] Sparse index by @HammadB in #1825
• [BUG]: fix auth by @nicolasgere in #1864
• [CHORE] add .chrome_env file to the gitignore by @AlabasterAxe in #1834
• [ENH] Add Arrow-backed blockfile by @HammadB in #1846
• [ENH] Add arrow blockfile provider by @HammadB in #1847
• [CLN] Apply Prettier Config to JS Client Repo by @AlabasterAxe in #1831
• [ENH] Add Segment Interfaces by @HammadB in #1853
• [ENH] Property testing for metadata indices by @beggers in #1794
• [ENH] Add uint blockfile key/val by @HammadB in #1854
• [ENH] fush API for compactor by @weiligu in #1869
• Revert "[ENH] fush API for compactor" by @beggers in #1874
• [ENH] Compactor flush by @weiligu in #1879
• [CLN] Clean up k8s, rename services and values by @beggers in #1881
• [ENH] Let us specify sysdbMigration target by @beggers in #1886
• [ENH] Run the sysdb migration in sh so we can do env var substitition by @beggers in #1887
• [BUG] install jq in migration, not sysdb by @beggers in #1894
• [ENH] Add push based operators, centralized dispatch, hardcode query plan as state machine by @HammadB in #1888
• [ENH] Clean DB before applying (for now) by @beggers in #1896
• [BUG] Wipe sysdb and reapply schema each time by @beggers in #1898
• [BUG] Add logservice config to query service by @beggers in #1900
• [TST] Add test that the default config loads and parses by @HammadB in #1901
• [ENH] Add end_timestamp to PullLog API by @Ishiihara in #1897
• [ENH] Add query-service server by @HammadB in #1899
• [BLD] Auto rebuild protos if they change in rust by @HammadB in #1902
• [ENH] Operator/Executor error handling by @HammadB in #1903
• [ENH] Implement the PullLog operator by @Ishiihara in #1906
• [ENH] Seed distributed sysdb by @beggers in #1909
• [ENH] Add brute force operator by @HammadB in #1907
• [BUG] Rename memberlist to match new memberlist name by @HammadB in #1910
• [BUG] Make memberlist name configurable by @HammadB in #1911
• [CHORE] Go Memberlist debug by @HammadB in #1913
• [CLN] Add trace for memberlist update by @HammadB in #1912
• [BUG] remove query service build cache - breaks staging by @beggers in #1917
• [ENH] Add optional kwargs when initialising SentenceTransformerEmbeddingFunction class by @sumaiyah in #1891
• [PERF] Make tilt and docker faster by @beggers in #1920
• [BUG] Point query service to the right logservice port by @beggers in #1921
• [BUG] Use nano seconds as end_timestamp by @Ishiihara in #1918
• [BUG] Log service incorrectly doesn't hydrate collection id by @HammadB in #1922
• [BUG] Log service N+1 query by @HammadB in #1923
• [BUG] Rust server should wire up system by @HammadB in #1924
• [CLN] Clean up log error message by @HammadB in #1925
• [BUG] BF operator should min(data, k) to prevent panic by @HammadB in #1926
• [ENH] make hnsw query orchestrator use BF operator by @HammadB in #1927
• [BUG] Fix as_nanos bad merge by @HammadB in #1928
• [CLN] Remove pulsar from python codebase by @HammadB in #1932
• [ENH] DataChunk abstraction with PullLog, Group and BF by @Ishiihara in #1929
• [CLN] Rename SubmitEmbeddingRecord to OperationRecord. Remove Topic concept from Segment/Collection. by @HammadB in #1933
• [CLN] Restructure EmbeddingRecord -> LogRecord. Use 'log_offset' as term instead of 'id' by @HammadB in #1934
• [ENH]: Ollama embedding function by @tazarov in #1813
• [ENH] Remove seq_id from protos, record and result types. Refactor rust to use LogRecord / OperationRecord by @HammadB in #1935
• [CLN] Stop clearing the sysdb on each deploy by @beggers in #1941
• [CLN] Create public if not exists by @beggers in #1943
• [ENH] Add compaction service memberlist propagation by @Ishiihara in #1946
• [ENH] Compaction manager by @Ishiihara in #1944
• [ENH] Compaction service setup by @Ishiihara in #1945
• [CLN] Remove unused worker_entrypoint by @Ishiihara in #1954
• [CLN] Change Task to CompactionJob for higher level compaction work d… by @Ishiihara in #1955
• [BUG] Fix memberlist manager to only list memberlist with the provide… by @Ishiihara in #1956
• [ENH] Add memberlist for compaction service by @Ishiihara in #1949
• [ENH] Create RoboflowEmbeddingFunction by @capjamesg in #1434
• [CLN] Clean up unused imports by @Ishiihara in #1959
• [ENH] Support langchain embedding functions with chroma by @Mihir1003 in #1880
• [ENH]: refactoring log service by @nicolasgere in #1958
• [PERF]: Improved server-side serialization with orjson + async by @tazarov in #1938
• [ENH]: Add property test log service by @nicolasgere in #1969
• [BUG] QuotaEnforcer fails to check out the corner cases. by @lizhiyuell in #1966
• [ENH]: Use new log service by @nicolasgere in #1971
• [CLN] Remove unused dependency and move rayon to dev dependency by @Ishiihara in #1981
• [CLN] Remove pulsar as a dependency to sysdb by @Ishiihara in #1982
• [BUG]: Trace decorator fix - local segment manager by @tazarov in #1978
• [CHORE]: expose jaeger frontend by @nicolasgere in #1974
• [BUG] Add proper locking before modifying the ip to key map by @Ishiihara in #1984
• [ENH]: Improved error reporting by @AlabasterAxe in #1817
• [ENH]: use env variable for log database migration url by @nicolasgere in #1983
• [CLN] Remove pulsar admin in golang by @Ishiihara in #1990
• [ENH] Batch process pod events for memberlist manager by @Ishiihara in #1988
• [ENH] Add graceful shutdown to query and compaction service by @Ishiihara in #1992
• [CLN] Remove unused dependency in frontend service by @Ishiihara in #1989
• [ENH] Use lister to update the memberlist by @Ishiihara in #1993
• [CLN]: remove unused code by @nicolasgere in #1994
• [BUG] Add check for empty memberlist for compactor scheduler by @Ishiihara in #1998
• [ENH] Fetch last compaction time from sysdb by @Ishiihara in #1997
• [ENH] Only update memberlist when their is a change by @Ishiihara in #2002
• [BUG] Fix memberlist manager flaky test by @Ishiihara in #2008
• [ENH] Add flush sysdb to compactor by @Ishiihara in #2003
• [ENH] Rust write segments and flush S3 operator skeleton by @Ishiihara in #2009
• [ENH] Make TestSysDb thread safe by @Ishiihara in #2010
• [ENH]: Add offset/limit collection sysdb by @nicolasgere in #1999
• [BUG] Make the gracefulperiod to be 0 for pod deletion by @Ishiihara in #2011
• [ENH] Simplify auth and correctly overwrite singleton tenant+db by @beggers in #1970
• [BUG] Fix JS client regression by @ibratoev in #2026
• [TST] Try to fix a sporadic test failure by @ibratoev in #2030
• [ENH]: use name/uuid to get collection by @nicolasgere in #2040
• [BLD] add lint workflow by @codetheweb in #2045
• [RELEASE] Release 0.5.0 by @beggers in #2047

New Contributors

• @AlabasterAxe made their first contribution in #1829
• @sumaiyah made their first contribution in #1891
• @capjamesg made their first contribution in #1434
• @Mihir1003 made their first contribution in #1880
• @lizhiyuell made their first contribution in #1966
• @codetheweb made their first contribution in #2045

Full Changelog: 0.4.24...0.5.0