About the for loop GRU

[whmrtm]

I am trying to replicate this work. The code runs but I found that using a for-loop for GRUCell is really slow compared with directly using nn.GRU. Is there a way to accelerate it? I ran a profiler and it seems to me after break down the RNN to for-loops, the GPU usage is decreased. Any options or suggestions are appreciated