如何使用TimeDistributed层来预测动态长度序列? PYTHON 3 [英] How to use TimeDistributed layer for predicting sequences of dynamic length? PYTHON 3
问题描述
因此,我正在尝试构建基于LSTM的自动编码器,我希望将其用于时间序列数据.这些被拆分成不同长度的序列.因此,模型的输入具有[None,None,n_features]形状,其中第一个None代表样本数量,第二个None代表序列的time_steps.该序列由LSTM处理,其参数return_sequences = False,然后通过RepeatVector函数重新创建编码维,并再次运行LSTM.最后,我想使用TimeDistributed层,但是如何告诉python time_steps维是动态的呢?查看我的代码:
So I am trying to build an LSTM based autoencoder, which I want to use for the time series data. These are spitted up to sequences of different lengths. Input to the model has thus shape [None, None, n_features], where the first None stands for number of samples and the second for time_steps of the sequence. The sequences are processed by LSTM with argument return_sequences = False, coded dimension is then recreated by function RepeatVector and ran through LSTM again. In the end I would like to use the TimeDistributed layer, but how to tell python that the time_steps dimension is dynamic? See my code:
from keras import backend as K
.... other dependencies .....
input_ae = Input(shape=(None, 2)) # shape: time_steps, n_features
LSTM1 = LSTM(units=128, return_sequences=False)(input_ae)
code = RepeatVector(n=K.shape(input_ae)[1])(LSTM1) # bottleneck layer
LSTM2 = LSTM(units=128, return_sequences=True)(code)
output = TimeDistributed(Dense(units=2))(LSTM2) # ??????? HOW TO ????
# no problem here so far:
model = Model(input_ae, outputs=output)
model.compile(optimizer='adam', loss='mse')
推荐答案
此功能似乎可以解决问题
this function seems to do the trick
def repeat(x_inp):
x, inp = x_inp
x = tf.expand_dims(x, 1)
x = tf.repeat(x, [tf.shape(inp)[1]], axis=1)
return x
示例
input_ae = Input(shape=(None, 2))
LSTM1 = LSTM(units=128, return_sequences=False)(input_ae)
code = Lambda(repeat)([LSTM1, input_ae])
LSTM2 = LSTM(units=128, return_sequences=True)(code)
output = TimeDistributed(Dense(units=2))(LSTM2)
model = Model(input_ae, output)
model.compile(optimizer='adam', loss='mse')
X = np.random.uniform(0,1, (100,30,2))
model.fit(X, X, epochs=5)
我在TF 2.2上使用了tf.keras
I'm using tf.keras with TF 2.2
这篇关于如何使用TimeDistributed层来预测动态长度序列? PYTHON 3的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!