-
Hello. I was using v1.4.0 for developing iOS app, and recently found there was major update and applied to my app. I use iPhone 12 pro and base.en model with Core ML. For Core ML without Metal setting, overall time was reduced due to decode time reduction, but encode time is increased. Does anyone know possible reason for this behavior? |
Beta Was this translation helpful? Give feedback.
Answered by
ggerganov
Jan 4, 2024
Replies: 1 comment 1 reply
-
If you change this: whisper.cpp/coreml/whisper-encoder.mm Lines 25 to 29 in ab0a859 To this: // select which device to run the Core ML model on
MLModelConfiguration *config = [[MLModelConfiguration alloc] init];
//config.computeUnits = MLComputeUnitsCPUAndGPU;
//config.computeUnits = MLComputeUnitsCPUAndNeuralEngine;
config.computeUnits = MLComputeUnitsAll; Does it help? |
Beta Was this translation helpful? Give feedback.
1 reply
Answer selected by
LVCSRer
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
If you change this:
whisper.cpp/coreml/whisper-encoder.mm
Lines 25 to 29 in ab0a859
To this:
Does it help?