[FEA] Make cudf.pandas
not perform redundant CPU<->GPU transfers if there is no in-place write operations
#15670
Labels
Milestone
cudf.pandas
not perform redundant CPU<->GPU transfers if there is no in-place write operations
#15670
Is your feature request related to a problem? Please describe.
In
cudf.pandas
we currently move dataframes from CPU to GPU or vice-versa for every step entirely. We can avoid performing transfers all the time by storing the dataframe in both memories and spending time in CPU<->GPU transfers if there are no in-place operations on the frames.Notice the
df.count(axis=0)
in cell6
taking quite a bit of time to move from CPU to GPU, we can avoid this.Describe the solution you'd like
Maintain two identical copies of dataframe - one in GPU, another in CPU.
The text was updated successfully, but these errors were encountered: