Skip to content

Commit

Permalink
position generating module is incompatible with patch dropout, new st…
Browse files Browse the repository at this point in the history
…rategy
  • Loading branch information
lucidrains authored Feb 6, 2023
1 parent bb73ba7 commit 83fc875
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -136,7 +136,7 @@ music = musiclm(['the crystalline sounds of the piano in a ballroom']) # torch.T
- [x] modify audiolm to accept conditioning embeddings, optionally take care of different dimensions through a separate projection
- [x] audiolm and mulan goes into musiclm and generate, filter with mulan

- [ ] improvise a bit and give the audio transformer a position generating module before each attention layer
- [ ] give dynamic positional bias to self attention in AST
- [ ] add a version of mulan to <a href="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/mlfoundations/open_clip">open clip</a>
- [ ] set all the proper spectrogram hyperparameters

Expand Down

0 comments on commit 83fc875

Please sign in to comment.