导入多个嵌套的csv文件并将其串联到一个DataFrame中 [英] Import multiple nested csv files and concatenate into one DataFrame

问题描述

我正在尝试读取多个结构相同(列名)且位于几个文件夹中的CSV文件.我的主要目的是将这些文件连接到一个熊猫数据框中. 请在附件的文件夹位置分布下面找到附件，因此每个文件夹包含5个CSV文件. 是否有任何预定义的功能或功能可以帮助您解决问题?

I'm trying to read multiple CSV files that have the same structure(column names)and located in several folders, My main purpose is to concatenate these files into one panda data frame. please find attached below files location distribution of folders, thus each folder contains 5 CSV files. Is there any predefined function or smth that can help ??

推荐答案

使用 pd.concat():

import os
import pandas as pd
outdir = [YOUR_INITIAL_PATH]
df_final = pd.DataFrame(columns=['column1', 'column2', 'columnN']) # creates an empty df with the desired structure
for root, dirs, filenames in os.walk(outdir):
    for f in filenames:
        if f.endswith('.csv'):
            df_temp = pd.read_csv(root + '\\' + f)
            df_final = pd.concat([df_final, df_temp])

这篇关于导入多个嵌套的csv文件并将其串联到一个DataFrame中的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！