-
Notifications
You must be signed in to change notification settings - Fork 605
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feature extraction for image retrieval and fine tuning #25
Comments
Hi, thank for your questions:
|
Hi, thank for the hint. If I want to use an Italian BERT with the correct Italian tokenizer, in order to pre-train the model with the Pre-training datasets (with the sentences translate in italian language), could i use the pretrain script? python -m torch.distributed.run --nproc_per_node=8 pretrain.py --config ./configs/Pretrain.yaml --output_dir output/Pretrain After that, i could fine tune the pretrained model on the COCO dataset always with the sentences translate in italian language. Could it make sense? |
Yes you could do that. |
Hi, congratulation for the results.
My questions are about a correct use of the exit features for the retrieval task and of the finetuning phase.
Many thanks, Enrico
The text was updated successfully, but these errors were encountered: