流集错误-错误的文件描述符 [英] Streamsets Error - Bad File Descriptor

问题描述

我试图使用Streamsets查询Oracle数据库并将数据发布到Kafka中.我在Mac上下载了Streamsets的tarball，并将其解压缩到我的主目录中.我第一次尝试运行$HOME/streamsets-datacollector-2.1.0.2/bin/streamsets dc时就开始运行，然后按照此处添加jdbc驱动程序，然后说明

I was attempting to use Streamsets to query an Oracle database and publish the data into Kafka. I downloaded Streamsets' tarball on my Mac and unzipped it into my home directory. Running $HOME/streamsets-datacollector-2.1.0.2/bin/streamsets dc started up on my first try, then I followed the instructions here to add the jdbc driver, then the instructions here to configure my streamsets job. However, I got an error: JDBC_00 - Cannot connect to specified database: com.streamsets.pipeline.api.StageException: JDBC_06 - Failed to initialize connection pool: java.sql.SQLRecoverableException: IO Error: Bad file descriptor.

推荐答案

这最终与进程可以打开的文件数限制有关.当我在笔记本电脑上运行ulimit -n时，它显示4864，然后我通过ulimit -n 10000将其设置为10,000，重新启动了流集服务器，它开始工作了！如果需要继续运行，我将找到一种更程序化的方式来设置此过程的ulimit，以解决此问题.

This wound up having something to do with the limit on the number of files a process can have open. When I ran ulimit -n on the laptop, it showed 4864, then I set it to 10,000 via ulimit -n 10000, restarted the streamsets server, and it worked! If I need to keep running this, I will find a more procedural way of setting the ulimit for this process to work around this issue.

这篇关于流集错误-错误的文件描述符的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！