有没有办法在 tf.data.Dataset w/tf.py_func 中传递字典? [英] Is there a way to pass dictionary in tf.data.Dataset w/ tf.py_func?

问题描述

我在数据处理中使用 tf.data.Dataset，我想用 tf.py_func 应用一些 python 代码.

I'm using tf.data.Dataset in data processing and I want to do apply some python code with tf.py_func.

顺便说一句，我发现在 tf.py_func 中，我无法返回字典.有什么办法或解决方法吗?

BTW, I found that in tf.py_func, I cannot return a dictionary. Is there any way to do it or workaround?

我有如下代码

def map_func(images, labels):
    """mapping python function"""
    # do something
    # cannot be expressed as a tensor graph
    return {
        'images': images,
        'labels': labels,
        'new_key': new_value}
def tf_py_func(images, labels):
    return tf.py_func(map_func, [images, labels], [tf.uint8, tf.string], name='blah')

return dataset.map(tf_py_func)

==============================================================================

===========================================================================

已经有一段时间了，我忘记我问过这个问题了.我以另一种方式解决了它，它是如此简单，以至于我觉得我几乎是个傻瓜.问题是:

It's been a while and I forgot I asked this question. I solved it other way around and it was so easy that I felt I was almost a stupid. The problem was:

1. tf.py_func 不能返回字典.
2. dataset.map 可以返回字典.

答案是:映射两次.

def map_func(images, labels):
    """mapping python function"""
    # do something
    # cannot be expressed as a tensor graph
    return processed_images, processed_labels

def tf_py_func(images, labels):
    return tf.py_func(map_func, [images, labels], [tf.uint8, tf.string], name='blah')

def _to_dict(images, labels):
    return { 'images': images, 'labels': labels }

return dataset.map(tf_py_func).map(_to_dict)

推荐答案

您可以将字典转换为字符串，然后返回，然后拆分为字典.

You could turn the dictionary into a string which you return and then split into a dictionary.

这可能看起来像这样:

return (images + " " + labels + " " + new value)

然后在您的其他函数中:

and then in your other function:

l = map_func(image, label).split(" ")
d['images'] = l[0]
d[
...

这篇关于有没有办法在 tf.data.Dataset w/tf.py_func 中传递字典?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！