Skip to content

Releases: belladoreai/llama3-tokenizer-js

v1.1.3

07 May 21:53
Compare
Choose a tag to compare

Add optimisticCount convenience function

v1.1.2

04 May 18:09
Compare
Choose a tag to compare

Reorganize files (should not include functional changes)

v1.1.1

03 May 13:46
Compare
Choose a tag to compare

Fix TypeScript types

v1.1.0

26 Apr 11:35
Compare
Choose a tag to compare

Add parsing for special tokens so that they can be now inserted into normal text (without requiring any special function calls as before)