You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I want to enable z_order optimization with the delta-rs writer but i only want to do it on select time periods, as our dataset is so large its not good to do this over the entire dataset as this takes a lot longer to optimize. Please correct me if i have miss understood anything around z_order tasks. Currently we use databricks to z_order similar to the example example below,
OPTIMIZE events
WHERE date >= current_timestamp() - INTERVAL 1 day
ZORDER BY (eventType)
Is some able to provide advice on how best to achieve this within the rust engine.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hey Team,
I want to enable z_order optimization with the delta-rs writer but i only want to do it on select time periods, as our dataset is so large its not good to do this over the entire dataset as this takes a lot longer to optimize. Please correct me if i have miss understood anything around z_order tasks. Currently we use databricks to z_order similar to the example example below,
OPTIMIZE events
WHERE date >= current_timestamp() - INTERVAL 1 day
ZORDER BY (eventType)
Is some able to provide advice on how best to achieve this within the rust engine.
Many Thanks
Beta Was this translation helpful? Give feedback.
All reactions