BigQuery可以用作主查询引擎吗？ [英] Can BigQuery be used as a primary query engine?

问题描述

我想知道是否可以深入了解将BigQuery作为我们正在开发的分析工具的主要查询引擎的可行性。我们的公共API需要真实地执行使用PHP SDK（在潜在的100M +行上）的最少数百个并发SELECT查询，但是从目前的文档看来，BigQuery似乎更适合不经常查询，而不是按需提供高容量，高负载查询。

Google网站上列出的一些商家似乎做了类似的事情，但我也看到了20个并发请求的速率限制数字，这似乎排除这个产品的用例？

解决方案

我很高兴你问到了。普通的BigQuery用户可能会受到并发请求率限制，但有一个选项可以满足您描述的确切用例：预留容量。

通过预留容量，您可以获得您的自己的独立群集，不受同样的限制，但您定义的限制。

检查 https://developers.google.com/bigquery/pricing#reserved_cap 获取更多信息。

I was wondering if I could get an insight into how feasible it is to use BigQuery as a primary query engine for an analytics tool that we are developing. Our public API will need to realistically perform at minimum hundreds of concurrent SELECT queries using the PHP SDK (on potentially 100M+ rows), but from the current documentation it seems like BigQuery is more geared towards infrequent querying than providing high volume, high load on demand queries.

Some of the businesses listed on the Google website appear to be doing similar things but I have also seen rate limit figures of 20 concurrent requests, which appears to rule out this Use Case for the product?

解决方案

I'm glad you asked. Normal BigQuery users are subject to concurrent request rate limits, but there's an option that would suit the exact use case you describe: Reserved capacity.

With reserved capacity, you get your own "separate cluster", not subject to the same limitations, but the ones you define.

Check https://developers.google.com/bigquery/pricing#reserved_cap for more information.

这篇关于BigQuery可以用作主查询引擎吗？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！