LSTM layer norm lstm with layer normalization implemented in pytorch User can simply replace torch.nn.LSTM with lstm.LSTM This code is modified from Implementation of Leyer norm LSTM