有没有办法确定或指定BigQuery存储数据的地理区域？ [英] Is there a way to determine or specify what geo region BigQuery stores data in?

问题描述

有没有办法确定哪些地区（ like these ）BigQuery将我的数据存储在？更重要的是，有没有一种方法可以指定将数据发送到BigQuery时的存储位置？如果它很重要，我同时使用POST方法批量加载数据和流。

如果这两个答案都是否，其中不存在 BQ存储数据？它只是在美国，其他地方......还是传播到全球各地？

解决方案

注意：这篇文章中的所有内容都应该被视为指南，而不是保证。如果有疑问，请参阅BigQuery服务条款，该服务条款将更详细地说明有关数据位置的保证。

默认情况下，BigQuery将您的数据存储在 us-central1 和 us-central2 中。如果您希望BigQuery数据接近您的计算（即GCE），则应将计算移至其中一个区域。

BigQuery位置信息位于数据集中。目前有三种可能的价值：美国，欧盟和未指定。如果是美国，则数据位于美国（ us-central1 和 us-central2 ），EU，数据位于欧盟（ europe-west1 ，虽然其他副本可能存储在欧盟其他地方）。如果没有指定，它现在相当于将其存储在美国。

您可以通过执行 datasets.get（）操作，您可以通过 bq 命令行客户端执行以下操作：

  bq --format = prettyjson show publicdata：samples | grep location 
  

请注意，默认情况下，位置为空，表示位置未指定。 / p>

创建数据集时必须设置位置;它也只是（现在）列入白名单的客户，可以设置他们的数据集位置。

Is there a way to determine what region (like these) BigQuery is storing my data in? More to the point, is there a way to specify where my data gets stored when sent into BigQuery? If it matters, I'm using both the POST method for bulk loading data and streaming as well.

If the answer to both of these is "no", where does BQ store data? Is it just in the USA, elsewhere...or is it spread all over the globe?

解决方案

Note: Everything in this post should be considered a guideline and not a guarantee. When in doubt, refer to the BigQuery terms-of-service, which will spell out in more detail about what is guaranteed with respect to data location.

By default, BigQuery stores your data in us-central1 and us-central2. If you want your BigQuery data to be close to your computation (i.e. GCE), you should move your computation to one of those regions.

BigQuery location information is on the dataset. There are three possible values, currently: US, EU, and unspecified. If it is US, the data is located in the US (us-central1 and us-central2), EU, the data is located in the EU (europe-west1, although additional replicas may be stored elsewhere in the EU). If it is unspecified, it is currently equivalent to storing it in the US.

You can see this by doing a datasets.get() operation, which you can do with the bq command line client via:

bq --format=prettyjson show publicdata:samples | grep location

Note that by default, the location is empty, which means that the location is unspecified.

Location must be set when the dataset is created; it is also only (for now) a whitelisted set of customers who can set their dataset location.

这篇关于有没有办法确定或指定BigQuery存储数据的地理区域？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！