forked from zurawiki/tiktoken-rs
-
Notifications
You must be signed in to change notification settings - Fork 0
Ready-made tokenizer library for working with GPT and tiktoken
License
SunDoge/tiktoken-rs
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
About
Ready-made tokenizer library for working with GPT and tiktoken
Resources
License
Code of conduct
Security policy
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published
Languages
- Rust 93.4%
- Shell 4.6%
- Just 2.0%