TPU本地文件系统不存在? [英] TPU local Filesystem doesn't exist?

问题描述

我编写了一个NN模型，该模型分析图像并最后提取8个浮点数.该模型在我的计算机上运行良好(但运行缓慢)，因此我在TPU云上尝试了BAM！我有一个错误:

I wrote a NN model that analyze an image and extract 8 floating numbers at the end. The model is working fine (but slowly) on my computer so I try it on the TPU cloud and there BAM! I have an error:

I1008 12:58:47.077905 140221679261440 tf_logging.py:115]从training_loop记录的错误:文件系统方案'[local]'未实现(文件:'/home/gcloud_iba/Data/CGTR/model/GA_subset/model. ckpt-0_temp_e840841d93124a67b54074b1c0fd7ae4') [[{{node save/SaveV2}} = SaveV2 [dtypes = [DT_FLOAT，DT_FLOAT，DT_FLOAT，DT_FLOAT，DT_FLOAT，...，DT_FLOAT，DT_FLOAT，DT_FLOAT，DT_FLOAT，DT_INT64/job)，_ device ="ca :0/任务:0/设备:CPU:0](保存/共享文件名，保存/SaveV2/张量名称，保存/SaveV2/shape_and_slices，batch_normalization/beta/Read/ReadVariableOp，batch_normalization/beta/Momentum/Read_1/ReadVariableOp，batch_normalization /gamma/Read/ReadVariableOp，batch_normalization/gamma/Momentum/Read_1/ReadVariableOp，batch_normalization/moving_mean/Read/ReadVariableOp，batch_normalization/moving_variance/Read/ReadVariableOp，batch_normalization_1/beta/Read/ReadVariableOp/Beta_mentation_1 ，batch_normalization_1/gamma/Read/ReadVariableOp，batch_normalization_1/gamma/Momentum/Read_1/ReadVariableOp，batch_normalization_1/moving_mean/Read/ReadVariableOp，batch_normalization_1/moving_variance/Read/ReadVariableOp，conv2d/kernel/Read/Read/ReadVMoment /ReadVariab leOp，conv2d_1/内核/Read/ReadVariableOp，conv2d_1/内核/动量/Read_1/ReadVariableOp，conv2d_2/内核/Read/ReadVariableOp，conv2d_2/内核/动量/Read_1/ReadVariableOp，conv2d_3/kernel/Readnel Momentum/Read_1/ReadVariableOp，conv2d_4/kernel/Read/ReadVariableOp，conv2d_4/kernel/Momentum/Read_1/ReadVariableOp，conv2d_5/kernel/Read/ReadVariableOp，conv2d_5/kernel/Momentum/Read/1/ReadVariableOp conv2d_6/kernel/Momentum/Read_1/ReadVariableOp，conv2d_7/kernel/Read/ReadVariableOp，conv2d_7/kernel/Momentum/Read_1/ReadVariableOp，conv2d_8/kernel/Read/ReadVariableOp，conv2d_8/kernel/Mov_1d Read/ReadVariableOp，conv2d_9/kernel/Momentum/Read_1/ReadVariableOp，densed/bias/Read/ReadVariableOp，densed/bias/Momentum/Read_1/ReadVariableOp，densed/kernel/Read/Read/ReadVariableOp，densed/kernel/Momentum/Read_1/ReadVariable density_1/bias/Read/ReadVariableOp，密实_1/bias/Momentum/Read_1/ReadVariable运算，密集_1/内核/读取/ReadVariableOp，密集_1/内核/动量/读取_1/ReadVariableOp，密集_2/偏置/读取/ReadVariableOp，密集_2/偏置/动量/读取_1/ReadVariableOp，密集_2/内核/读取/ReadVariableOp，密集_2/内核/动量/读取_1/ReadVariableOp，密集_3/偏差/读取/ReadVariableOp，密集_3/偏差/动量/读取_1/ReadVariableOp，密集_3/内核/读取/ReadVariableOp，密集_3/内核/动量/读取_1/ReadVariableOp，global_step/读取/读取)

I1008 12:58:47.077905 140221679261440 tf_logging.py:115] Error recorded from training_loop: File system scheme '[local]' not implemented (file: '/home/gcloud_iba/Data/CGTR/model/GA_subset/model.ckpt-0_temp_e840841d93124a67b54074b1c0fd7ae4') [[{{node save/SaveV2}} = SaveV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, ..., DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_INT64], _device="/job:worker/replica:0/task:0/device:CPU:0"](save/ShardedFilename, save/SaveV2/tensor_names, save/SaveV2/shape_and_slices, batch_normalization/beta/Read/ReadVariableOp, batch_normalization/beta/Momentum/Read_1/ReadVariableOp, batch_normalization/gamma/Read/ReadVariableOp, batch_normalization/gamma/Momentum/Read_1/ReadVariableOp, batch_normalization/moving_mean/Read/ReadVariableOp, batch_normalization/moving_variance/Read/ReadVariableOp, batch_normalization_1/beta/Read/ReadVariableOp, batch_normalization_1/beta/Momentum/Read_1/ReadVariableOp, batch_normalization_1/gamma/Read/ReadVariableOp, batch_normalization_1/gamma/Momentum/Read_1/ReadVariableOp, batch_normalization_1/moving_mean/Read/ReadVariableOp, batch_normalization_1/moving_variance/Read/ReadVariableOp, conv2d/kernel/Read/ReadVariableOp, conv2d/kernel/Momentum/Read_1/ReadVariableOp, conv2d_1/kernel/Read/ReadVariableOp, conv2d_1/kernel/Momentum/Read_1/ReadVariableOp, conv2d_2/kernel/Read/ReadVariableOp, conv2d_2/kernel/Momentum/Read_1/ReadVariableOp, conv2d_3/kernel/Read/ReadVariableOp, conv2d_3/kernel/Momentum/Read_1/ReadVariableOp, conv2d_4/kernel/Read/ReadVariableOp, conv2d_4/kernel/Momentum/Read_1/ReadVariableOp, conv2d_5/kernel/Read/ReadVariableOp, conv2d_5/kernel/Momentum/Read_1/ReadVariableOp, conv2d_6/kernel/Read/ReadVariableOp, conv2d_6/kernel/Momentum/Read_1/ReadVariableOp, conv2d_7/kernel/Read/ReadVariableOp, conv2d_7/kernel/Momentum/Read_1/ReadVariableOp, conv2d_8/kernel/Read/ReadVariableOp, conv2d_8/kernel/Momentum/Read_1/ReadVariableOp, conv2d_9/kernel/Read/ReadVariableOp, conv2d_9/kernel/Momentum/Read_1/ReadVariableOp, dense/bias/Read/ReadVariableOp, dense/bias/Momentum/Read_1/ReadVariableOp, dense/kernel/Read/ReadVariableOp, dense/kernel/Momentum/Read_1/ReadVariableOp, dense_1/bias/Read/ReadVariableOp, dense_1/bias/Momentum/Read_1/ReadVariableOp, dense_1/kernel/Read/ReadVariableOp, dense_1/kernel/Momentum/Read_1/ReadVariableOp, dense_2/bias/Read/ReadVariableOp, dense_2/bias/Momentum/Read_1/ReadVariableOp, dense_2/kernel/Read/ReadVariableOp, dense_2/kernel/Momentum/Read_1/ReadVariableOp, dense_3/bias/Read/ReadVariableOp, dense_3/bias/Momentum/Read_1/ReadVariableOp, dense_3/kernel/Read/ReadVariableOp, dense_3/kernel/Momentum/Read_1/ReadVariableOp, global_step/Read/ReadVariableOp)]]

我检查了TPU是否可以访问硬盘驱动器并且它可以工作(我还有另一段代码可以读取另一模型的相同数据集). 我还没有缓存数据(但是)，但是我做了一些预取.除此之外，我看不到什么不起作用?

I checked that the TPU has access to the hard drive and it works (I have another piece of code that reads the same dataset with another model). I do not cache my data (yet) but I do some prefetching. Aside this, I don't see what isn't working?

感谢您提供的任何帮助！

Thank you for any help you could provide!

Pi-r

推荐答案

本地文件系统在Cloud TPU上不可用.模型目录(检查点等)和输入数据应存储在Google Cloud Storage中(并以"gs://"作为前缀).

The local filesystem is not available on Cloud TPU's. Model directories (checkpoints etc) and input data should be stored in Google Cloud Storage (and prefixed with "gs://").

更多详细信息在这里

https://cloud.google.com/tpu/docs/storage-buckets

这篇关于TPU本地文件系统不存在?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！