Skip to content
/ S3D Public

Release of the pretrained S3D Network in PyTorch (ECCV 2018)

License

Notifications You must be signed in to change notification settings

kylemin/S3D

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

S3D in PyTorch

S3D Network is reported in the ECCV 2018 paper Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification. It has been shown by Xie that replacing standard 3D convolutions with spatial and temporal separable 3D convolutions 1) reduces the total number of parameters, 2) is more computationally efficient, and even 3) improves the performance in terms of accuracy.

Overview

In this repository, we release the pretrained S3D network in PyTorch. We pretrained S3D on Kinetics-400 dataset and it achieves 72.08% top1 accuracy (top5: 90.35%) on the validation set of the dataset.

Network Top 1 (%) Top 5 (%)
I3D 71.1 89.3
S3D (reported by author) 72.2 90.6
S3D (our implementation) 72.1 90.4

Weight file & Sample code

First, clone this repository and download this weight file. Then, just run the code using

$ python main.py

This will output the top 5 Kinetics classes predicted by the model with corresponding probability.

Top 5 classes ... with probability
riding a bike ... 0.9937429
biking through snow ... 0.0041600233
riding mountain bike ... 0.0010456557
riding unicycle ... 0.00088055385
motorcycling ... 0.00014455811

Notes

We implement and release this repository together with our TASED-Net project (ICCV 2019). If you find it useful, you might want to consider citing our work.

@inproceedings{min2019tased,
  title={TASED-Net: Temporally-Aggregating Spatial Encoder-Decoder Network for Video Saliency Detection},
  author={Min, Kyle and Corso, Jason J},
  booktitle={Proceedings of the IEEE International Conference on Computer Vision},
  pages={2394--2403},
  year={2019}
}

About

Release of the pretrained S3D Network in PyTorch (ECCV 2018)

Topics

Resources

License

Stars

Watchers

Forks

Languages