Fig. 2

Elman neural network Architectures are context units that can be treated as the memory units. There are connections from the middle (hidden) layer to these context units fixed with a weight of one