transformers example

[ahmedo42]

Fixes #960

Description:
Transformers example using huggingface and Ignite , works on TPU & GPU , tried to stick as much as possible to the code in
CIFAR10 example .
Check list:

• New tests are added (if a new feature is added)
• New doc strings: description and/or example code are in RST format
• Documentation is updated (if required)

[vfdev-5]

Thanks for the PR @ahmedo42 ! Looks good !
I left few comment to improve docs and the code.
Let me try to run it locally and see how it works...

[vfdev-5]

@ahmedo42 I updated a bit more the example (maybe same things should be done on cifar10 as well).
I wonder if you checked the example from your side ? Batch size being 128 is rather large, which GPU do you have :)
Let me know what do you think about these changes. Thanks

[ahmedo42]

@ahmedo42 I updated a bit more the example (maybe same things should be done on cifar10 as well).

this definitely is cleaner , I agree that same changes should be done to the CIFAR10 example

I wonder if you checked the example from your side ? Batch size being 128 is rather large, which GPU do you have :)

yes, I checked on GPU , TPU on Kaggle and Colab ( as I Don't have GPU 😄 ) , the default batch size (128) was meant for TPU .

[vfdev-5]

Could you please rerun the check from your side to ensure that the example is working. I checked on GPU(s). Maybe, what remains is TPUs...
Once, we are done, we can merge it.

[vfdev-5]

LGTM! Thanks @ahmedo42 !

[ahmedo42]

It works on TPU