如何更改目录结构/日期格式 [英] How to change Directory Structure/Date Format

问题描述

目前，我的文件进入Data Lake的文件每天都按增量文件细分.例如:RAW/< SourceSystem>/年/月/日.我最初选择以YYYY/M/d格式存储它们，但想将它们更改为YYYY/MM/dd.我不能 找出一种简单的方法来执行这样的操作，而无需重新处理所有大量数据的文件.有一个我不知道的简便方法吗?谢谢！

I currently have my files going into my Data Lake broken down by daily incremental files.  Example: RAW/<SourceSystem>/Year/Month/Day.  I originally chose to store them in YYYY/M/d format, but want to change them to YYYY/MM/dd.  I cannot figure out an easy way to do something like this without reprocessing all of the files, which is a lot of data.  Is there an easy way to do this that I'm not aware of? Thanks!

推荐答案

似乎没有可行的方法.我认为没有一种方法可以处理多个文件并将它们输出回相同的文件，这是一个很大的缺失功能.我应该能够提取10个文件，转换数据并输出它们 返回相同的10个文件或至少10个代表10个源文件的新文件.

It doesn't seem there's a possible way to do this.  I think not having a way to process multiple files and to output them back to the same files is a big missing feature.  I should be able to take 10 files, transform the data, and output them back to the same 10 files or at least 10 new files that represent the 10 source files.

这篇关于如何更改目录结构/日期格式的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！