Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP - CrossCLR full code #3

Open
wants to merge 5 commits into
base: main
Choose a base branch
from
Open

WIP - CrossCLR full code #3

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
02d2a74
unpolished code of crossCLR
mzolfaghari Feb 6, 2022
7b55b5a
remove unused files
mzolfaghari Feb 6, 2022
6499689
add run command
mzolfaghari Feb 6, 2022
d1cb837
add acknowledgement
mzolfaghari Feb 6, 2022
060674e
add crossclr without queue
mzolfaghari Feb 7, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
remove unused files
  • Loading branch information
@mzolfaghari
mzolfaghari committed Feb 6, 2022
commit 7b55b5a9274e9526cce7dd22725d0a48c468225e
14 changes: 7 additions & 7 deletions config/lsmdc.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,14 +4,14 @@ config_type: "ret"
training:
debug_size: 11000 #Debugging will be deactivated if set it to a number bigger that 10000!
loss_func: 'contrastive'
batch_size: 64 #64
batch_size: 96 #64
num_epochs: 20
compute_clip_retrieval: true

cross_clr_config:
temperature: 0.02
temperature: 0.03
temperature_weights: 0.0055
score_thrshold: 0.9
score_thrshold: 1
negative_weight: 0.65 #0.8
queue_size: 10000

Expand Down Expand Up @@ -61,7 +61,7 @@ video_local:
use_context: true
use_subspace: false #deactivated
pooler_config:
name: atn #atn #avg #max #atn
name: max #atn #avg #max #atn
hidden_dim: 512
num_heads: 4
num_layers: 1
Expand Down Expand Up @@ -101,7 +101,7 @@ dataset:
test_split: test1k
min_frames: 1
use_clips: true
max_frames: 10
max_frames: 4
feat_agg_dim: 2048 #1024 #512 # Split features and add them along a new dimension
mmt_feat_dim: 1024 #1024
action_feat_dim: 2048 #1024
Expand All @@ -124,7 +124,7 @@ dataset:
drop_last: false
optimizer:
name: radam
lr: 0.0006
lr: 0.0005
weight_decay: 0 #3.0e-05 #0
weight_decay_for_bias: true
lr_decay_mult: false
Expand All @@ -134,7 +134,7 @@ optimizer:
scheduler:
patience: 6
cooldown: 4
warmup: 2
warmup: 4

# ---------- Logging / Saving ----------
logging:
Expand Down
Loading