nikyim
Follow
Stars
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
📋 A list of open LLMs available for commercial use.
A Gradio web UI for Large Language Models.
BLOOM-zh is a modification from BLOOM. BLOOM-zh is trained extendedly on larger amounts of Traditional Chinese text data while it still maintains its pretrained English ability
Examples and guides for using the OpenAI API
UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.
Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
Code and documentation to train Stanford's Alpaca models, and generate the data.
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Instruct-tune LLaMA on consumer hardware
A game theoretic approach to explain the output of any machine learning model.
[NIVT Workshop @ ICCV 2023] SeMask: Semantically Masked Transformers for Semantic Segmentation
PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
Beyond Accuracy: Behavioral Testing of NLP models with CheckList
Fast, general, and tested differentiable structured prediction in PyTorch
A Visual Analysis Tool to Explore Learned Representations in Transformers Models
Code and data of the ACL 2020 paper "Word-level Textual Adversarial Attacking as Combinatorial Optimization"
A library for Multilingual Unsupervised or Supervised word Embeddings
Low-code framework for building custom LLMs, neural networks, and other AI models
A PyTorch-based knowledge distillation toolkit for natural language processing
A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
Indonesian Language Models and its Usage
Fast utility to transform and load a CSV file in a PostgreSQL table
Simple transformer implementation from scratch in pytorch.
LINE: Large-scale information network embedding
My Reading Lists of Deep Learning and Natural Language Processing
Implementation of Bayesian Hyperparameter Optimization of Machine Learning Algorithms