As I wrote in the following article. http://tam5917.hatenablog.com/entry/2016/09/09/205514
A network architecture that simplifies the structure of the LSTM has recently been proposed, so it was implemented in TF quickly. Anyone can understand the contents by reading the linked paper.