Pytorch implementation of paper "Contrastive Learning with Synthetic Positives"

We introduce a novel approach for parameter generation, named neural network parameter diffusion (p-diff), which employs a standard latent diffusion model to synthesize a new set of parameters

Official implementation of "Fairness-Aware Meta-Learning via Nash Bargaining." We explore hypergradient conflicts in one-stage meta-learning and their impact on fairness. Our two-stage approach use…

[NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models

[ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models

Benchmark framework of synaptic device technologies for a simple neural network

A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...

Fairness in LLMs resources

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑‍🔬

Awesome list for LLM pruning.

PATIENT-Ψ: Using Large Language Models to Simulate Patients for Training Mental Health Professionals

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

A simple and effective LLM pruning approach.

Codebase for the paper Rethinking Medical Anomaly Detection in Brain MRI: An Image Quality Assessment Perspective

Approximating neural network loss landscapes in low-dimensional parameter subspaces for PyTorch

NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day

The open-sourced Python toolbox for backdoor attacks and defenses.

An Awesome Collection for LLM Survey

The easiest way to use Agentic RAG in any enterprise

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Generative Agents: Interactive Simulacra of Human Behavior

[MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

The repo for paper "Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data"

AI Hospital: Interactive Evaluation and Collaboration of LLMs as Intern Doctors for Clinical Diagnosis

Comprehensive and timely academic information on federated learning (papers, frameworks, datasets, tutorials, workshops)

Code for visualizing the loss landscape of neural nets