Token-wise and real-time display Inference module for Llama2 and other LLMs.

Learn OOV inference ability from word embedding vector

Inferring password composition policies from breached user credential databases.

Code for the active inference simulations in: The Acquisition of Culturally Patterned Attention Styles under Active Inference

Python program to perform object detection inference with Tensorflow 2.0.

Test Time Augmentation for Deep Learning Inference

Alpha Belief Propagation

onnxruntimeを試す

Raspberry Pi project using Intel's Neural Compute Stick with pre-trained MobileNet model for edge based streaming inference and SMS notification when class (dog) is in identified in frame

It shows how to create custom component for image classification in IoT Device.

Masked Language Modeling demo using XLM-RoBERTa + Gradio/FastAPI

Example code for prefix-tuning GPT/GPT-NeoX models and for inference with trained prefixes

A simple inference engine, server, and chatbot for GPT-NeoX models

This library offers an implementation of PyTorch’s preprocessing and inference steps using the OpenVINO API, effectively serving as an adapter for PyTorch.

This is a collection of algorithms and models written in Python for probabilistic programming. The main focus of the package is on Bayesian reasoning by using Bayesian networks, Markov networks, and their mixing.

This web app uses a trained ML model to classify Pokemon.

Implemented the prediction inference process of the NANODET model in ONNX format and TFLite format

compile stable diffusion to run faster

A project with code enabling inference on images from within a docker container over TCP

an LLM toolkit