Keras错误:“如果您的数据采用符号张量的形式，则应指定`steps`参数(而不是`batch_size`参数.....) [英] Keras error: "If your data is in the form of symbolic tensors, you should specify the `steps` argument (instead of the `batch_size` argument.....)

问题描述

我想通过从VGG16网络的倒数第二层提取特征来使用自定义损失函数.因此，在model.compile()函数中，我传递了一个函数vgg_loss()，该函数返回所需的损失.如下所示:

I want to use a custom loss function, by extracting features from the penultimate layer of VGG16 network. So, in the model.compile() function, I pass a function vgg_loss() which returns the required loss. It is shown below:

model_loss = VGG16(include_top=False, input_shape=input_size)
model.compile(optimizer = Adam(lr = lrate, decay = 1e-6), loss = vgg_loss(model_loss))

vgg_loss()函数的定义如下:

The vgg_loss() function is defined as follows:

import keras.backend as K
from keras.backend import reshape
from keras.applications.vgg16 import preprocess_input

def vgg_loss(model):

    def loss(gt, pred):
        print(" Inside loss function ")    

        pred = reshape(pred, (1,) + (128,128,3))
        gt = reshape(gt, (1,) + (128,128,3))

        gt_in = preprocess_input(gt)
        pred_in = preprocess_input(pred)

        pred_out = model.predict(pred_in)
        gt_out = model.predict(gt_in)

        return K.mean(K.mean((pred_out - gt_out)**2, axis = (1,2)), axis = 1)

    return loss

运行model.compile时，出现以下与符号张量的使用有关的错误:

When run model.compile, I get the following error related to the usage of symbolic tensors:

Traceback (most recent call last):

File "C:\Users\Dell\.spyder-py3\UNet_keras\train_SO.py", line 32, in <module>
model = unet(input_size = (height,width,nc))

File "C:\Users\Dell\.spyder-py3\UNet_keras\model_SO.py", line 68, in unet
loss = vgg_loss(model_loss), metrics = ['mse'])

File "C:\Users\Dell\Anaconda3\envs\viji_aip\lib\site-packages\keras\engine\training.py", line 229, in 
compile
self.total_loss = self._prepare_total_loss(masks)

File "C:\Users\Dell\Anaconda3\envs\viji_aip\lib\site-packages\keras\engine\training.py", line 692, in 
_prepare_total_loss
y_true, y_pred, sample_weight=sample_weight)

File "C:\Users\Dell\Anaconda3\envs\viji_aip\lib\site-packages\keras\losses.py", line 71, in __call__
losses = self.call(y_true, y_pred)

File "C:\Users\Dell\Anaconda3\envs\viji_aip\lib\site-packages\keras\losses.py", line 132, in call
return self.fn(y_true, y_pred, **self._fn_kwargs)

File "C:\Users\Dell\.spyder-py3\UNet_keras\data_SO.py", line 28, in loss
pred_out = model.predict(pred)

File "C:\Users\Dell\Anaconda3\envs\viji_aip\lib\site-packages\keras\engine\training.py", line 1464, 
in predict
callbacks=callbacks)

File "C:\Users\Dell\Anaconda3\envs\viji_aip\lib\site-packages\keras\engine\training_arrays.py", line 
250, in predict_loop
steps_name='steps')

File "C:\Users\Dell\Anaconda3\envs\viji_aip\lib\site-packages\keras\engine\training_utils.py", line 
571, in check_num_samples
'you should specify the `' + steps_name + '` argument '

ValueError: If your data is in the form of symbolic tensors, you should specify the `steps` argument 
(instead of the `batch_size` argument, because symbolic tensors are expected to produce batches of 
input data).

我在这里做错了什么?

What am I doing wrong here?

推荐答案

1. 您必须使用tensorflow-2而不是keras.

您不能在损失函数中添加任何内容，并且期望它能正常工作，它必须是可区分的.您可能不需要在损失内添加vgg16的preprocessing_input，模型的输出不应该是完美的图像(范围为0-255)，它们应该已经是标准化的张量(由于某些激活，例如sigmoid). (请确保您所使用的VGG16也已在相同的归一化方案(0-1)范围内进行了训练，因为网络的输出可能会通过激活函数，例如sigmoid，因此您的输出很可能在范围(0-1))

You can't add anything in the loss function and expect it to work, it must be differentiable. You may not need to add preprocessing_input of vgg16 inside the loss, your output from the model shouldn't be perfect images (with range 0-255), they should be already normalized tensors (due to some activations like sigmoid). (Make sure, the VGG16 you're using was also trained with same normalization scheme (0-1) range, as the output from the network will probably pass through an activation function like sigmoid, your output will most likely be in the range(0-1))

这是一个具有损失函数的简单模型:

Here's a simple model with the loss function of yours:

import tensorflow.keras.backend as K
from tensorflow.keras.applications import *
from tensorflow.keras.layers import *
from tensorflow.keras.models import *

def vgg_loss(model):

    def loss(y_true, y_pred):
        return K.mean(K.square(model(y_pred) - model(y_true)), axis=-1)
    return loss

input_size = (224,224,3)
model_loss = VGG16(include_top=False, input_shape=input_size)

# simple model

ip = Input(input_size)
base_model = Dense(3)(ip)

model = Model(ip, base_model)

model.summary()

model.compile(optimizer = 'adam', loss = vgg_loss(model_loss))

Model: "model"
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
input_3 (InputLayer)         [(None, 224, 224, 3)]     0         
_________________________________________________________________
dense (Dense)                (None, 224, 224, 3)       12        
=================================================================
Total params: 12
Trainable params: 12
Non-trainable params: 0

这篇关于Keras错误:“如果您的数据采用符号张量的形式，则应指定`steps`参数(而不是`batch_size`参数.....)的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！