遇到IOException异常运行导入作业：由javac的返回错误：java.io.IOException异常 [英] Encountered IOException running import job: java.io.IOException: Error returned by javac

查看：5092
本文介绍了遇到IOException异常运行导入作业：由javac的返回错误：java.io.IOException异常的处理方法，对大家解决问题具有一定的参考价值，需要的朋友们下面随着小编来一起学习吧！

问题描述

我试图运行使用Java简单sqoop进口方案。

I am trying to run a simple sqoop import program using JAVA.

我的计划：

    String driver="com.vertica.Driver";
    Configuration config = new Configuration(); 
    config.addResource(new Path("/../../../mapred-site.xml"));
    config.addResource(new Path("/../../../core-site.xml"));
    config.addResource(new Path("/../../../hdfs-site.xml"));

    SqoopOptions options = new SqoopOptions();
    options.setConnectString(connection_string);
    options.setDriverClassName(driver);

    options.setUsername(username);
    options.setPassword("xxxxxxxxxxxxx");
    options.setTargetDir(directory path);
    options.setFetchSize(0);
    options.setSqlQuery("SELECT 123456 as runid, " +
            "business_date " +
            "FROM database.table " +
            "WHERE business_date=\'20140922\' " +
            "AND instrument_id=1037894110378941 " +
            "AND $CONDITIONS");

    int ret = new ImportTool().run(options);
    System.out.println("Return Val: "+ret);

我有以下误差

15/02/03 02:26:23 WARN sqoop.ConnFactory: $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration.
15/02/03 02:26:23 WARN sqoop.ConnFactory: Parameter --driver is set to an explicit driver however appropriate connection manager is not being set (via  --connection-manager). Sqoop is going to fall back to org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which connection manager should be     used next time.
15/02/03 02:26:23 INFO tool.CodeGenTool: Beginning code generation
15/02/03 02:26:24 INFO manager.SqlManager: Executing SQL statement: SELECT 123456 as runid, business_date FROM silverscreen_qa.SS_INSTRUMENT WHERE  business_date='20140922' AND instrument_id=1037894110378941 AND  (1 = 0)
15/02/03 02:26:24 INFO manager.SqlManager: Executing SQL statement: SELECT 123456 as runid, business_date FROM silverscreen_qa.SS_INSTRUMENT WHERE  business_date='20140922' AND instrument_id=1037894110378941 AND  (1 = 0)
15/02/03 02:26:24 INFO orm.CompilationManager: $HADOOP_MAPRED_HOME is not set
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:11: error: package com.cloudera.sqoop.lib does not exist
import com.cloudera.sqoop.lib.JdbcWritableBridge;
                             ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:12: error: package com.cloudera.sqoop.lib does not exist
import com.cloudera.sqoop.lib.DelimiterSet;
                             ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:13: error: package com.cloudera.sqoop.lib does not exist
import com.cloudera.sqoop.lib.FieldFormatter;
                             ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:14: error: package com.cloudera.sqoop.lib does not exist
import com.cloudera.sqoop.lib.RecordParser;
                             ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:15: error: package com.cloudera.sqoop.lib does not exist
import com.cloudera.sqoop.lib.BooleanParser;
                             ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:16: error: package com.cloudera.sqoop.lib does not exist
import com.cloudera.sqoop.lib.BlobRef;
                             ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:17: error: package com.cloudera.sqoop.lib does not exist
import com.cloudera.sqoop.lib.ClobRef;
                             ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:18: error: package com.cloudera.sqoop.lib does not exist
import com.cloudera.sqoop.lib.LargeObjectLoader;
                             ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:19: error: package com.cloudera.sqoop.lib does not exist
import com.cloudera.sqoop.lib.SqoopRecord;
                             ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:37: error: cannot find symbol
public class QueryResult extends SqoopRecord  implements DBWritable, Writable {
                                 ^
  symbol: class SqoopRecord
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:81: error: cannot find symbol
  public void loadLargeObjects(LargeObjectLoader __loader)
                               ^
  symbol:   class LargeObjectLoader
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:119: error: cannot find symbol
  private final DelimiterSet __outputDelimiters = new DelimiterSet((char) 44, (char) 10, (char) 0, (char) 0, false);
                ^   
  symbol:   class DelimiterSet  
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:123: error: cannot find symbol
  public String toString(DelimiterSet delimiters) {
                         ^
  symbol:   class DelimiterSet
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:129: error: cannot find symbol
  public String toString(DelimiterSet delimiters, boolean useRecordDelim) {
                         ^
  symbol:   class DelimiterSet
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:140: error: cannot find symbol
  private final DelimiterSet __inputDelimiters = new DelimiterSet((char) 44, (char) 10, (char) 0, (char) 0, false);
                ^
  symbol:   class DelimiterSet
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:141: error: cannot find symbol
  private RecordParser __parser;
          ^
  symbol:   class RecordParser
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:142: error: package RecordParser does not exist
  public void parse(Text __record) throws RecordParser.ParseError {
                                                      ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:150: error: package RecordParser does not exist
  public void parse(CharSequence __record) throws RecordParser.ParseError {
                                                              ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:158: error: package RecordParser does not exist
  public void parse(byte [] __record) throws RecordParser.ParseError {
                                                         ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:166: error: package RecordParser does not exist
  public void parse(char [] __record) throws RecordParser.ParseError {
                                                         ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:174: error: package RecordParser does not exist
  public void parse(ByteBuffer __record) throws RecordParser.ParseError {
                                                            ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:182: error: package RecordParser does not exist
  public void parse(CharBuffer __record) throws RecordParser.ParseError {
                                                            ^
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:64: error: bad operand types for binary operator '=='
    if (this == o) {
             ^
  first type:  QueryResult
  second type: Object
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:67: error: inconvertible types
    if (!(o instanceof QueryResult)) {
          ^
  required: QueryResult
  found:    Object
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:70: error: inconvertible types
    QueryResult that = (QueryResult) o;
                                     ^
  required: QueryResult
  found:    Object
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:78: error: cannot find symbol
    this.runid = JdbcWritableBridge.readLong(1, __dbResults);
                 ^
  symbol:   variable JdbcWritableBridge
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:79: error: cannot find symbol
    this.business_date = JdbcWritableBridge.readDate(2, __dbResults);
                         ^
  symbol:   variable JdbcWritableBridge
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:89: error: cannot find symbol
    JdbcWritableBridge.writeLong(runid, 1 + __off, -5, __dbStmt);
    ^
  symbol:   variable JdbcWritableBridge
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:90: error: cannot find symbol
    JdbcWritableBridge.writeDate(business_date, 2 + __off, 91, __dbStmt);
    ^
  symbol:   variable JdbcWritableBridge
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:119: error: cannot find symbol
  private final DelimiterSet __outputDelimiters = new DelimiterSet((char) 44, (char) 10, (char) 0, (char) 0, false);
                                                      ^
  symbol:   class DelimiterSet
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:132: error: cannot find symbol
    __sb.append(FieldFormatter.escapeAndEnclose(runid==null?"null":"" + runid, delimiters));
                ^
  symbol:   variable FieldFormatter
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:134: error: cannot find symbol
    __sb.append(FieldFormatter.escapeAndEnclose(business_date==null?"null":"" + business_date, delimiters));
                ^
  symbol:   variable FieldFormatter
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:140: error: cannot find symbol
  private final DelimiterSet __inputDelimiters = new DelimiterSet((char) 44, (char) 10, (char) 0, (char) 0, false);
                                                     ^
  symbol:   class DelimiterSet
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:144: error: cannot find symbol
      this.__parser = new RecordParser(__inputDelimiters);
                          ^
  symbol:   class RecordParser
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:152: error: cannot find symbol
      this.__parser = new RecordParser(__inputDelimiters);
                          ^
  symbol:   class RecordParser
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:160: error: cannot find symbol
      this.__parser = new RecordParser(__inputDelimiters);
                          ^
  symbol:   class RecordParser
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:168: error: cannot find symbol
      this.__parser = new RecordParser(__inputDelimiters);
                          ^
  symbol:   class RecordParser
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:176: error: cannot find symbol
      this.__parser = new RecordParser(__inputDelimiters);
                          ^
  symbol:   class RecordParser
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:184: error: cannot find symbol
      this.__parser = new RecordParser(__inputDelimiters);
                          ^
  symbol:   class RecordParser
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:206: error: cannot find symbol
    QueryResult o = (QueryResult) super.clone();
                                  ^
  symbol:   variable super
  location: class QueryResult
/tmp/sqoop-sha0_dev/compile/bda7671a1a4e5e172248f2497654d2c1/QueryResult.java:208: error: incompatible types
    return o;
           ^
  required: Object
  found:    QueryResult
41 errors
15/02/03 02:26:24 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Error returned by javac
        at org.apache.sqoop.orm.CompilationManager.compile(CompilationManager.java:207)
        at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:97)
        at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:396)
        at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:502)
        at com.cts.rbc.archive.TestConnectionForHive.main(TestConnectionForHive.java:196)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.eclipse.jdt.internal.jarinjarloader.JarRsrcLoader.main(JarRsrcLoader.java:58)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

Return Val: 1

可能的解决方案我试过了。

Possible Solutions I tried.

在我hadoop-env.sh JAVA_HOME的值为

In my hadoop-env.sh the value of JAVA_HOME is

    JAVA_HOME=/usr/lib/jvm/java-1.7.0-oracle-1.7.0.65.x86_64

我知道这听起​​来很重复，但是相信我，我已经尝试在类似的问题提供的解决方案所描述的所有解决方案

I know this sounds repeated but believe me I have tried all solutions described in the solutions provided in similar questions

我试着用下面的code更改JAVA_HOME在〜/ .bashrc

I tried changing JAVA_HOME in ~/.bashrc with the below code

    JAVA_HOME=/etc/alternatives/java

这是最新的Java安装在我的节点
它仍然抛出了同样的错误。

This is where latest java is installed in my node It still throws the same error.

同样的查询工作在bash。

The same query works in bash.

请注意：我没有权限更改JAVA_HOME在hadoop-env.sh作为一个共享系统

Note: I don't have permission to alter JAVA_HOME in hadoop-env.sh as its a shared system.

可能的方式覆盖JAVA_HOME使用Java程序？

Possible way to overwrite JAVA_HOME in Java Program?

推荐答案

[解决]

有没有必要改变JAVA_HOME（或）hadoop_ma pred_home（或）sqoop_home

There was no need to change java_home (or) hadoop_mapred_home (or) sqoop_home

作为错误所暗示的，它不能够找到sqoop库。而我用sqoop 1.4.4库在我的计划。
请注意，我没有使用任何的构建工具（Maven的，SBT或其它）
我用的是普通的Eclipse并添加外部.jar到我的计划。

As the error suggests, it was not able to find sqoop library. Whereas I used sqoop 1.4.4 library in my program. Please note that I wasn't using any build tool (Maven, SBT or anything) I was using normal eclipse and adding external .jar to my program.

在导出该.jar我使用Eclipse标准方法（文件 - >导出 - >爪哇 - > Runnable的.jar文件）

While exporting the .jar I was using Eclipse standard method (File -> Export -> Java -> Runnable .jar File)

在启动配置，我选择我的合适的项目
在库处理，我是用选项包需要的库文件在生成JAR

In launch configuration I selected my appropriate project and in library handling, I was using the option "package required libraries into generated JAR"

当我选择提取需要的库文件在生成JAR，并执行.jar文件它已成功执行。

When I selected "extract required libraries into generated JAR" and executed .jar file it was executed successfully.

这篇关于遇到IOException异常运行导入作业：由javac的返回错误：java.io.IOException异常的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！

查看全文
相关文章
Linux/Unix最新文章
热门教程
热门工具
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆