You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi everyone! I edited the Android demo to be capable of streaming audio to whisper in 5 second chunks. A lot of kinks to work out and sometimes I have to dump the audio buffer if whisper falls behind. I hope someone can look through my current implementation and point out things I can do better.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi everyone! I edited the Android demo to be capable of streaming audio to whisper in 5 second chunks. A lot of kinks to work out and sometimes I have to dump the audio buffer if whisper falls behind. I hope someone can look through my current implementation and point out things I can do better.
Using a converted distil-small.en to ggml model I am achieving about a 2x faster than realtime transcription on an S24 Ultra Below is my repo: https://github.com/liam-mceneaney/androidwhisper.cpp/tree/master
My PR: #1924
If anyone has tested a build with CLBlast let me know if it improves performance!
Beta Was this translation helpful? Give feedback.
All reactions