Faster Android inference (#4)

* Fix * Update readme
Macoron · Apr 8, 2023 · c11254d · c11254d
1 parent 030826f
commit c11254d
Show file tree

Hide file tree

Showing 2 changed files with 7 additions and 1 deletion.
diff --git a/Packages/com.whisper.unity/Runtime/WhisperParams.cs b/Packages/com.whisper.unity/Runtime/WhisperParams.cs
@@ -243,6 +243,12 @@ private void FreeLanguageString()
  PrintRealtime = false,
  PrintTimestamps = false
  };
+
+ // for some reason on android one thread works
+ // 10x faster than multithreading
+#if UNITY_ANDROID && !UNITY_EDITOR
+ param.ThreadsCount = 1;
+#endif
  return param;
  }
  } 

diff --git a/README.md b/README.md
@@ -9,7 +9,7 @@ This is Unity3d bindings for the [whisper.cpp](https://github.com/ggerganov/whis
 - Windows (x86_64)
 - MacOS (Intel and ARM)
 - iOS (Device and Simulator)
-- Android (ARM64, unstable, [see this issue](https://github.com/Macoron/whisper.unity/issues/2))
+- Android (ARM64)
 
 ## Getting started
 Clone this repository and open it as regular Unity project. It comes with examples and tiny multilanguage model weights.