Skip to content
/ yavs Public

Yet Another Video Site - full stack video sharing webapp with automatic video category classification and insight generation. Live at:

License

Notifications You must be signed in to change notification settings

ajayraj/yavs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

97 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

yavs

Yet Another Video Site

Requirements to Deploy

Frontend: HTML, CSS (Bootstrap)
Backend: Django (Python), PostgreSQL, NGINX, Gunicorn, Django-RQ (Docker, Redis)
NLP: Python - SpeechRecognition, Spacy,Word Vector models, WordCloud
ETC: FFmpeg
Notes:

Tested both BERT and Word Vector models for predicting category of an uploaded video. I found that Spacy's Word Vector en_core_md model with stopwords removed and lemmatization worked best for my use case. BERT was trained with and without stopwords and lemmatization and performed worse in each case, particularly having a hilarious consistent error with confusing videos marked children's entertainment with significantly more adult comedy. Ideally, it would have been preferable to run BERT without stopwords and lemmatization as the model is able to bi-directionally make better use of all the context provided. Given the imperfect nature of speech transcription and that unclear audio/speech and incorrect transcriptions must expected at times, my hypothesis is that any mistakes could have been magnified in the BERT model due to excess emphasis being placed on incorrect contexts. The Word Vector model was faster, much more memory efficient, and more consistently accurate for this classification task.

About

Yet Another Video Site - full stack video sharing webapp with automatic video category classification and insight generation. Live at:

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published