Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

✨ feat: Split code rust, for run as python lib and rust lib #167

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

✨ feat: Split code rust, for run as python lib and rust lib #167

wants to merge 2 commits into from

Commits on Sep 15, 2023

  1. ✨ feat: Split code rust, for run as python lib and rust lib

    @Miuler
    Miuler committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    b7af705 View commit details
    Browse the repository at this point in the history

  2. ✨ feat(rust): Convert project to a multi-crate workspace 

    This commit restructures the project from a single-crate workspace into a multi-crate workspace, dividing it into 'rs-tiktoken' and 'py-tiktoken'. This is done to improve the clarity of the organization of the codebase and make the Rust and Python modules separate for easier code maintenance. The setup.py is also updated to reflect these changes in the directory structure.

Refs: openai#24
    @Miuler
    Miuler committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    6b7624a View commit details
    Browse the repository at this point in the history