Also as mentioned by Alistu in one of the comments that It really depends on how much the sequence length is reduced. An the bigger the network, the more time is saved when using a shorter sequence, since the signal is processed as a discrete vectors in any of these components and the shorter the signal, the more reduction in the time it is processed.
Regards