-
Notifications
You must be signed in to change notification settings - Fork 780
Pull requests: openai/tiktoken
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Support enterprise network support for self-hosted encodings (UPDATED v0.6.0)
#238
opened Jan 12, 2024 by
blaney83
Loading…
Allow older versions of dependencies fancy-regex and bstr.
#108
opened Apr 16, 2023 by
petterreinholdtsen
Loading…
update license metadata to use SPDX identifier as per recommendation
#125
opened May 12, 2023 by
imrehg
Loading…
Add support for fine-tuned models in encoding_for_model
#135
opened May 23, 2023 by
thespino
Loading…
fix pycache folder being added instead of encoding info files
#152
opened Jun 23, 2023 by
dheerajiiitv
Loading…
✨ feat: Split code rust, for run as python lib and rust lib
#167
opened Jul 18, 2023 by
Miuler
Loading…
0) Add the jtokkit test suite examples to validate the cl100k_base, p50k_base & r50k_base encodings
#237
opened Jan 6, 2024 by
paplorinc
Loading…
Optimize byte pair merge for really big tokens (40x faster for a 2500 token word)
#239
opened Jan 15, 2024 by
paplorinc
Loading…
Add possessive quantifiers to avoid catastrophic backtracking
#258
opened Feb 11, 2024 by
paplorinc
Loading…
Add Terminal-Based Visualization Tool for Tokenized Data Points in Tiktoken Tokenizer
#314
opened Jun 18, 2024 by
LVivona
Loading…
ProTip!
Find all pull requests that aren't related to any open issues with -linked:issue.