Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support native PostgreSQL logging format #474

Closed
wants to merge 28 commits into from
Closed

Support native PostgreSQL logging format #474

wants to merge 28 commits into from
+4,466 −2,517

Conversation

JinweiOS
Copy link

@JinweiOS JinweiOS commented May 8, 2024

  • Add new logger crate
  • Supports piping log::info and above level logs to the log_destination configured in postgresql.conf
  • Currently supported log fields: timestamp pid message

cutecutecat and others added 28 commits May 21, 2024 17:12
@cutecutecat @JinweiOS
feat: add optimizing_threads to function (tensorchord#375)
4e6744f 
* feat: add optiming_threads to index

Signed-off-by: cutecutecat <[email protected]>

* put flexible at IndexProtect

Signed-off-by: cutecutecat <[email protected]>

* fix by comments

Signed-off-by: cutecutecat <[email protected]>

---------

Signed-off-by: cutecutecat <[email protected]>
Signed-off-by: jinweios <[email protected]>
@usamoi @silver-ymz @JinweiOS
chore: add another implementation of multiversion (tensorchord#446)
2d84951 
* chore: add another implementation of multiversion

Signed-off-by: usamoi <[email protected]>

* chore: update rust-toolchain

Signed-off-by: usamoi <[email protected]>

* chore: use detect::multiversion

Signed-off-by: usamoi <[email protected]>

* test: use detect::multiversion

Signed-off-by: usamoi <[email protected]>

* ci: add sde test

Signed-off-by: usamoi <[email protected]>

* test: add dot_internal_v4_avx512vnni_test

Signed-off-by: usamoi <[email protected]>

* test: bvector tests

Signed-off-by: usamoi <[email protected]>

* chore: add comments for detect

Signed-off-by: usamoi <[email protected]>

* ci: do not run rust test 3 times

Signed-off-by: usamoi <[email protected]>

* fix: svector sl2_v4

Signed-off-by: usamoi <[email protected]>

* test: run svector tests 10000 times

Signed-off-by: usamoi <[email protected]>

* fix: svecf32_sl2_v4

Signed-off-by: Mingzhuo Yin <[email protected]>

* test: run vecf16 and veci8 test for 10000 times

Signed-off-by: usamoi <[email protected]>

* test: run bvecf32 test for 10000 times

Signed-off-by: usamoi <[email protected]>

* test: run tests for 300 times to reduce ci time

Signed-off-by: usamoi <[email protected]>

* chore: update rust toolchain

Signed-off-by: usamoi <[email protected]>

---------

Signed-off-by: usamoi <[email protected]>
Signed-off-by: Mingzhuo Yin <[email protected]>
Co-authored-by: Mingzhuo Yin <[email protected]>
Signed-off-by: jinweios <[email protected]>
@JinweiOS
feat: get log config demo
e07deb8 
Signed-off-by: jinweios <[email protected]>
@JinweiOS
test: write some info to pg_log
bcfa88f 
Signed-off-by: jinweios <[email protected]>
@my-vegetable-has-exploded @JinweiOS
fix: validate_index for veci8 & rm deprecated feature. (tensorchord#451)
a903daf 
Signed-off-by: my-vegetable-has-exploded <[email protected]>
Signed-off-by: jinweios <[email protected]>
@whateveraname @usamoi @JinweiOS
feat: stand alone test (tensorchord#448)
852009a 
* add stand alone test

Signed-off-by: whateveraname <[email protected]>

* update .gitignore

Signed-off-by: whateveraname <[email protected]>

* change data path

Signed-off-by: whateveraname <[email protected]>

* update data path

Signed-off-by: whateveraname <[email protected]>

* cargo fmt

Signed-off-by: whateveraname <[email protected]>

* clean code

Signed-off-by: whateveraname <[email protected]>

* taplo fmt

Signed-off-by: whateveraname <[email protected]>

* gate code with cargo feature

Signed-off-by: whateveraname <[email protected]>

* clean Cargo.toml and add CLI for stand-alone-test

Signed-off-by: whateveraname <[email protected]>

* remove feature from package stand-alone-test

Signed-off-by: whateveraname <[email protected]>

* cleanup

Signed-off-by: usamoi <[email protected]>

---------

Signed-off-by: whateveraname <[email protected]>
Signed-off-by: usamoi <[email protected]>
Co-authored-by: usamoi <[email protected]>
Signed-off-by: jinweios <[email protected]>
@cutecutecat @usamoi @JinweiOS
fix: optiming threads deadlock (tensorchord#453)
fdec20a 
* fix: optiming threads deadlock

Signed-off-by: cutecutecat <[email protected]>

* fix by comments

Signed-off-by: cutecutecat <[email protected]>

* Update crates/rayon/src/lib.rs

test clippy

* Update crates/rayon/src/lib.rs

test clippy

* fix monitor status

Signed-off-by: cutecutecat <[email protected]>

---------

Signed-off-by: cutecutecat <[email protected]>
Co-authored-by: usamoi <[email protected]>
Signed-off-by: jinweios <[email protected]>
@usamoi @JinweiOS
feat: sync CREATE INDEX (tensorchord#462)
92e080a 
* feat: sync CREATE INDEX

Signed-off-by: usamoi <[email protected]>

* test: fix IVF tests

Signed-off-by: usamoi <[email protected]>

* feat: add Alter trait

Signed-off-by: usamoi <[email protected]>

* chore: rename IndexOptions2 to IndexAlterableOptions

Signed-off-by: usamoi <[email protected]>

---------

Signed-off-by: usamoi <[email protected]>
Signed-off-by: jinweios <[email protected]>
@JinweiOS
test: finish demo
a0ac459 
Signed-off-by: jinweios <[email protected]>
@my-vegetable-has-exploded @JinweiOS
fix openai option. (tensorchord#469)
d8cce92 
Signed-off-by: my-vegetable-has-exploded <[email protected]>
Signed-off-by: jinweios <[email protected]>
@JinweiOS
feat: support write log message in json format
f7a4fc2 
Signed-off-by: jinweios <[email protected]>
@JinweiOS
feat: preliminary support for json and stderr logs
ba6db5c 
Signed-off-by: jinweios <[email protected]>
@JinweiOS
refactor: Undo test code
f292680 
Signed-off-by: jinweios <[email protected]>
@JinweiOS
refactor: untrack jsonlog.rs & log.rs
3848413 
Signed-off-by: jinweios <[email protected]>
@my-vegetable-has-exploded @JinweiOS
feat: support aggregate function for vector. (tensorchord#463)
48ac1be 
* implement vector avg.

Signed-off-by: my-vegetable-has-exploded <[email protected]>

* Implement sum、 vector_dims()、 vector_norm()

Signed-off-by: my-vegetable-has-exploded <[email protected]>

* update AccumulateState

Signed-off-by: my-vegetable-has-exploded <[email protected]>

* fix norm.

Signed-off-by: my-vegetable-has-exploded <[email protected]>

* add l2_norm for VectorBorrowed.

Signed-off-by: my-vegetable-has-exploded <[email protected]>

---------

Signed-off-by: my-vegetable-has-exploded <[email protected]>
Signed-off-by: jinweios <[email protected]>
@usamoi @JinweiOS
fix: elkan means impl for some vector types (tensorchord#472)
f31bdc6 
Signed-off-by: usamoi <[email protected]>
Signed-off-by: jinweios <[email protected]>
@JinweiOS
feat: support csvlog pipe to log
edc7544 
Signed-off-by: jinweios <[email protected]>
@usamoi @JinweiOS
fix: skip partitioned tables in pg_vector_index_stat (tensorchord#478)
c4b63f4 
Signed-off-by: usamoi <[email protected]>
Signed-off-by: jinweios <[email protected]>
@usamoi @JinweiOS
fix: use f*_algebraic intrinsics, instead of f*_fast intrinsics (tens…
e4e4666 
…orchord#481)

Signed-off-by: usamoi <[email protected]>
Signed-off-by: jinweios <[email protected]>
@my-vegetable-has-exploded @JinweiOS
feat: support element-wise multiplication. (tensorchord#480)
bf0476f 
* feat: support element-wise multiplication.

Signed-off-by: my-vegetable-has-exploded <[email protected]>

* fix tap.

Signed-off-by: my-vegetable-has-exploded <[email protected]>

* Implement mul for vecf16 & veci8.

Signed-off-by: my-vegetable-has-exploded <[email protected]>

* fix zero.

Signed-off-by: my-vegetable-has-exploded <[email protected]>

---------

Signed-off-by: my-vegetable-has-exploded <[email protected]>
Signed-off-by: jinweios <[email protected]>
@JinweiOS
feat: vectorlogger support log filter level
f8db842 
Signed-off-by: jinweios <[email protected]>
@JinweiOS
refactor: move vectorlogger to lib.rs
dae747e 
Signed-off-by: jinweios <[email protected]>
@JinweiOS
feat: replace env_logger with internal logger
a0d1d1a 
Signed-off-by: jinweios <[email protected]>
@JinweiOS
refactor: undo invalid changes
7d4ecd6 
Signed-off-by: jinweios <[email protected]>
@JinweiOS
refactor: cargo fmt format
a8684c2 
Signed-off-by: jinweios <[email protected]>
@JinweiOS
refactor: cargo.toml format
fdbaa9e 
Signed-off-by: jinweios <[email protected]>
@JinweiOS
refacot: remove unneeded return
8ac26f7 
Signed-off-by: jinweios <[email protected]>
@JinweiOS
fix: modify c_char_to_string param type
7d24a92 
Signed-off-by: jinweios <[email protected]>
@JinweiOS JinweiOS closed this May 21, 2024
@JinweiOS
Copy link
Author

New PR #483

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
5 participants
@JinweiOS @cutecutecat @usamoi @my-vegetable-has-exploded @whateveraname