Lists (1)
Sort Name ascending (A-Z)
Stars
Machine Translation Web Interface for OpenNMT-py
Tools for merging pretrained large language models.
Neural Network-based Statistical Machine Translation Toolkit.
Python module to facilitate accessing the memoQ Web Service API.
This is a group of packages for Python to interact with memoQ server Web Service API.
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
The official Python library for the OpenAI API
JavaScript implementation of Japanese morphological analyzer
A lightning fast Finite State machine and REgular expression manipulation library.
japanese sentence segmentation library for python
Simple, Pythonic building blocks to evaluate LLM applications.
django-tables2 - An app for creating HTML tables
A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.
Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.
Kuromoji is a self-contained and very easy to use Japanese morphological analyzer designed for search
A Python 2 package for the automatic alignment of EU legislation. It uses nltk and hunalign.
Edit a bilingual alignment of an EU legal act within the browser; integrated with eunlp
LASER multilingual sentence embeddings as a pip package
Unsupervised text tokenizer for Neural Network-based text generation.
Language-Agnostic SEntence Representations
alvations / sacremoses
Forked from hplt-project/sacremosesPython port of Moses tokenizer, truecaser and normalizer