Google Cloud Dataflow用户定义的MySQL源代码 [英] Google Cloud Dataflow User-Defined MySQL Source

问题描述

我正在编写Google Dataflow Pipeline，并且作为 Sources 之一，我需要通过查询获得MySQL结果集。接下来几个问题：

I am writing a Google Dataflow Pipeline and as one of the Sources I require a MySQL resultset via a query. A couple of questions then:

1. 从我的管道中提取数据的正确方法是什么，这可以简单地完成在线使用JDBC？


2. 如果我确实需要实现用户定义的数据格式将MySQL包装为源，有没有人知道如果一个实现已经存在，我不需要重新发明轮子？ （不要误会我的意思，我会喜欢写它，但我认为这将是一个非常常见的情况，使用MySQL作为源）

1. What would be proper way to extract data from MySQL as a step in my pipeline, can this simply be done in-line using JDBC?
2. In the case that I indeed do need to implement "User-Defined Data Format" wrapping MySQL as a source, does anyone know if an implementation already exists and I do not need to reinvent the wheel? (don't get me wrong I would enjoy writing it, but I would imagine this would be quite a common scenario to use MySQL as a source)

全心全意！

推荐答案

JDBC连接器刚刚添加到 Apache Beam（孵化）。参见 JdbcIO 。

A JDBC connector has been just added to Apache Beam (incubating). See JdbcIO.

这篇关于Google Cloud Dataflow用户定义的MySQL源代码的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！