Skip to content

Shekhale/dim_red_zoo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Zoo of algorithms for dimensionality reduction

While most of well-studied and robust algorithms for Dimensionality Reduction (DR) like PCA are implemented in Python, there are many new methods that are not. This repository aggregate several algorithms which have been adapted and may be applied for DR in the Nearest Neighbour Search (NNS) problem. Also main ideas or/and architecture hacks can be gained.

Collection

VAE

Extremely popular generative model with huge number of modifications - original paper.

Possible implementation

ACAI

One of the variations of VAE. Paper and initial code

t-SNE

Well-studied method from Paper, very useful for data visualisation.

Here I trying to adapt this algorithm for huge datasets (near 1M and more) via neural network learning.

UMAP

Another graph-based method from Paper

Triplet

Simple and old method that can show state-of-the-art results in plenty of tasks.
Paper, and possible implementation

What about running?

To running some test it you need to specify paths to the corresponding data location in data.py file and run python train.py --database sift --method acai for learning ACAI methon on SIFT dataset.

Most of hyper-parameters are fixed, but you can easily change them.

See repo for applying any methods for NNS task.

Questions and suggestions

Please feel free to share any ideas and contact me.

About

Zoo of algorithms for dimensionality reduction

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages