Git pushes fail when the remote index needs refreshing

[effigies]

What went wrong?

ds001107 has a dataset nested in a subdirectory, indicating a curation failure, probably in an automated process during the scitran->datalad conversion.

Fetching, git mving and pushing resulted in:

❯ git push
Enumerating objects: 1733, done.
Counting objects: 100% (1733/1733), done.
Delta compression using up to 16 threads
Compressing objects: 100% (1311/1311), done.
error: RPC failed; HTTP 502 curl 22 The requested URL returned error: 502
send-pack: unexpected disconnect while reading sideband packet
Writing objects: 100% (1732/1732), 66.52 MiB | 2.17 MiB/s, done.
Total 1732 (delta 398), reused 586 (delta 391), pack-reused 0
fatal: the remote end hung up unexpectedly
Everything up-to-date

After running git status on the remote and waiting for completion, I got:

❯ git push
Enumerating objects: 1147, done.
Counting objects: 100% (1147/1147), done.
Delta compression using up to 16 threads
Compressing objects: 100% (1116/1116), done.
Writing objects: 100% (1146/1146), 145.50 KiB | 2.55 MiB/s, done.
Total 1146 (delta 7), reused 0 (delta 0), pack-reused 0
remote: Resolving deltas: 100% (7/7), done.
remote: warning: exhaustive rename detection was skipped due to too many files.
remote: warning: you may want to set your diff.renameLimit variable to at least 1030 and retry the command.
remote: fatal: path '.bidsignore' does not exist in 'f1bbce744ae591aa985923048d020c9a47a263d3'
remote: Validation failed, some files are not valid BIDS filenames:
remote:   /sub-01/ses-localizer/func/sub-01_ses-localizer_task-movielocalizer_run-1_defacemask.nii.gz
remote:   /sub-01/ses-localizer/func/sub-01_ses-localizer_task-objectcategories_run-1_defacemask.nii.gz
[...]
remote:   /sub-36/sub-36_task-movie_beh.json
To https://openneuro.org/git/3/ds001107
   9566582..f1bbce7  master -> master

Expected behavior

git push should generally work. Periodic auto-refreshing of indices might be necessary?

It's possible that moving to bare repositories would eliminate this problem.

How to reproduce

No response

Desktop

• OS:
• Browser:
• Version:

Phone

• Device:
• OS:
• Browser:
• Version:

Additional information

No response