What are hidden units in individual LSTM cells?

Question

I am new to Neural Networks and found the concept of "hidden units" in individual LSTM cells. I understood the concept of having "gates"(input/output/forget etc.), but what are hidden units? I also understand that this is different from the number of unrolled LSTM cells in each layer(which is equal to the number of timesteps).

Answer 1

Even though its a old question i would like to answer this question. When i started learning LSTM even i couldn't understand Hidden Unit,Return Sequence ,Return State in LSTM . Check the above diagram that i drew which would help you understand it. It is the representation of 3 Hidden Unit LSTM Layer

• inp = Input(shape=(2,))
• x = Embedding(50000, 5)(inp)
• x = LSTM(3,return_sequences=True)(x)

For detailed information check my detailed blog on Medium https://medium.com/@raqueebilahi/