Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat!: Store timestamps as timestamp_tz #17843

Merged
merged 8 commits into from May 7, 2024
Merged

feat!: Store timestamps as timestamp_tz #17843

merged 8 commits into from May 7, 2024

Conversation

bbernays
Copy link
Collaborator

@bbernays bbernays commented May 1, 2024

Summary

Currently we are storing all timestamps as timestamp_ntz this is "wall clock" time meaning that it has no timezone associated with it. the arrow.TimestampType is:

TimestampType is encoded as a 64-bit signed integer since the UNIX epoch (2017-01-01T00:00:00Z). The zero-value is a second and time zone neutral. Time zone neutral can be considered UTC without having "UTC" as a time zone

Which makes it a better fit for users to be able to utilize the data in their queries.

@bbernays bbernays requested a review from a team as a code owner May 1, 2024 19:30
@bbernays bbernays requested review from savme and hermanschaaf and removed request for a team May 1, 2024 19:30
@bbernays bbernays requested a review from disq May 1, 2024 19:30
@bbernays bbernays changed the title feat: Store timestamps as timestamp_tz feat!: Store timestamps as timestamp_tz May 1, 2024
@hermanschaaf
Copy link
Member

@bbernays Tests are failing on this PR, just FYI

@bbernays
Copy link
Collaborator Author

bbernays commented May 2, 2024

The tests are failing because of issues with timezone comparison... In my local machine if I add &timezone=UTC to the connection string it works... still trying to figure out if there is a workable solution or not

@bbernays bbernays added the automerge Automatically merge once required checks pass label May 7, 2024
@kodiakhq kodiakhq bot merged commit 6eb8711 into main May 7, 2024
14 checks passed
@kodiakhq kodiakhq bot deleted the snowflake-tz branch May 7, 2024 18:56
kodiakhq bot pushed a commit that referenced this pull request May 14, 2024
🤖 I have created a release *beep* *boop*
---


## [4.0.0](plugins-destination-snowflake-v3.6.2...plugins-destination-snowflake-v4.0.0) (2024-05-13)


### ⚠ BREAKING CHANGES

* Store timestamps as `timestamp_tz` ([#17843](#17843))

### Features

* Store timestamps as `timestamp_tz` ([#17843](#17843)) ([6eb8711](6eb8711))


### Bug Fixes

* **deps:** Update module github.com/cloudquery/plugin-sdk/v4 to v4.41.0 ([#17917](#17917)) ([81f2506](81f2506))
* **deps:** Update module github.com/cloudquery/plugin-sdk/v4 to v4.41.1 ([#17941](#17941)) ([b112a67](b112a67))
* **deps:** Update module github.com/cloudquery/plugin-sdk/v4 to v4.42.0 ([#17951](#17951)) ([f5befb1](f5befb1))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/plugin/destination/snowflake automerge Automatically merge once required checks pass
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants