使用R下载压缩数据文件，解压并导入.csv [英] Using R to download zipped data file, extract, and import .csv

问题描述

我想使用 R 从网页下载并提取.csv文件。

I am trying to download and extract a .csv file from a webpage using R.

此问题与使用R下载压缩数据文件，解压缩和导入数据。

我无法使解决方案正常工作，但可能是由于我使用的网址。

I cannot get the solution to work, but it may be due to the web address i am using.

我正在尝试从 http://data.worldbank.org/country/united-kingdom（在下载数据下拉列表）

I am trying to download the .csv files from http://data.worldbank.org/country/united-kingdom (under the download data drop down)

使用@ Dirk的解决方案从上面的链接，我试过

Using @Dirk's solution from the link above, i tried

temp <- tempfile()
download.file("http://api.worldbank.org/v2/en/country/gbr?downloadformat=csv",temp)
con <- unz(temp, "gbr_Country_en_csv_v2.csv")
dat <- read.table(con, header=T, skip=2)
unlink(temp)

我通过查看页面源代码获得扩展链接，

I got the extended link by looking at the page source code, which I expect is causing the problems, although it works if i paste it into the address bar.

文件使用正确的Gb下载

The file downloads with the correct Gb

download.file("http://api.worldbank.org/v2/en/country/gbr?downloadformat=csv",temp)
# trying URL 'http://api.worldbank.org/v2/en/country/gbr?downloadformat=csv'
# Content type 'application/zip' length 332358 bytes (324 Kb)
# opened URL
# downloaded 324 Kb

# also tried unzip but get this warning
con <- unzip(temp, "gbr_Country_en_csv_v2.csv")
# Warning message:
# In unzip(temp, "gbr_Country_en_csv_v2.csv") :
# requested file not found in the zip file

但是这些都是我手动下载文件名。

But these are the file names when i manually download them.

我会感谢一些帮助，我错了，谢谢

I'd appreciate some help with where i am going wrong , thanks

我使用Windows 8，R版本3.1.0

I am using Windows 8, R version 3.1.0

推荐答案

为了让您的数据下载和解压缩，您需要设置 mode =wb

In order to get your data to download and uncompress, you need to set mode="wb"

download.file("...",temp, mode="wb")
unzip(temp, "gbr_Country_en_csv_v2.csv")
dd <- read.table("gbr_Country_en_csv_v2.csv", sep=",",skip=2, header=T)

它看起来像默认是w，其中假设一个文本文件。如果它是一个简单的csv文件，这将是好的。但由于它是压缩的，它是一个二进制文件，因此wb。没有wb部分，您根本无法打开zip。

It looks like the default is "w" which assumes a text files. If it was a plain csv file this would be fine. But since it's compressed, it's a binary file, hence the "wb". Without the "wb" part, you can't open the zip at all.

这篇关于使用R下载压缩数据文件，解压并导入.csv的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！