Too Long; Didn't Read
So yesterday I found this paper “<a href="https://papers.nips.cc/paper/6613-dilated-recurrent-neural-networks" target="_blank">Dilated Recurrent Neural Networks</a>” from <a href="https://papers.nips.cc/book/advances-in-neural-information-processing-systems-30-2017?utm_campaign=Revue%20newsletter&utm_medium=Newsletter&utm_source=Deep%20Learning%20Weekly" target="_blank">NIPS 2017</a> and implemented <a href="https://towardsdatascience.com/only-numpy-nips-2017-implementing-dilated-recurrent-neural-networks-with-interactive-code-e83abe8c9b27" target="_blank">here </a>. But then something hit me, Res Net and High Way net are built in a way that allows direction connection between the input data X and the transformed data X`.