BigQuery API 限制超出错误 [英] BigQuery API limit exceeded error

问题描述

我们在 tabledata.list 过程中遇到错误消息:

We've got error during tabledata.list with message:

API limit exceeded: Unable to return a row that exceeds the API limits. To retrieve the row, export the table.

它未在 https://cloud.google.com/bigquery/troubleshooting 中列出-errors#errortable .

这个错误每次都会发生.

This error occurs every time.

我们可以正常将这个表导出到GCS中.结果看起来很正常(没有特别大的行).

We can export this table into GCS normally. Result looks normal (there are no extremely large rows).

我们设法在实际错误发生之前检索了几个结果页面.

We manage to retrieve several result pages before the actual error occurs.

com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden
{
  "code" : 403,
  "errors" : [ {
    "domain" : "global",
    "message" : "API limit exceeded: Unable to return a row that exceeds the API limits. To retrieve the row, export the table.",
    "reason" : "apiLimitExceeded"
  } ],
  "message" : "API limit exceeded: Unable to return a row that exceeds the API limits. To retrieve the row, export the table."
}
    at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:145) ~[com.google.api-client.google-api-client-1.21.0.jar:1.21.0]
    at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113) ~[com.google.api-client.google-api-client-1.21.0.jar:1.21.0]
    at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40) ~[com.google.api-client.google-api-client-1.21.0.jar:1.21.0]
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321) ~[com.google.api-client.google-api-client-1.21.0.jar:1.21.0]

什么意思?我们如何解决此错误?

What does it mean? How can we resolve this error?

推荐答案

很抱歉给您带来不便.

这是 tabledata.list 方法的一个已知问题.问题是我们有一些基础设施限制，目前无法从 tabledata.list 返回非常大的行.

This is a known issue of tabledata.list method. The problem is that we have some infrastructure limitations that it is currently not possible to return very large row from tabledata.list.

large 是一个相对词.不幸的是，有些行在用 json 表示时尺寸很小，但当用我们的内部格式表示时会消耗大量内存.

large is a relative word. Unfortunately some row has small size when represented in json, but can consume lots of memory when represented in our internal format.

当前的解决方法如错误消息中所述:导出表.

The current workaround is as mentioned in the error message: to export the table.

从长远来看，我们正在积极致力于改进我们的系统以克服这一限制.敬请关注:)

For the long-term, we are actively working on improving our system to overcome this limitation. Stay tuned :)

这篇关于BigQuery API 限制超出错误的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！