线程“main”中的异常java.lang.NoSuchMethodError：scala.Predef $ .refArrayOps（ [英] Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.refArrayOps(

问题描述

我是scala的新手并且在INTELLJ中获取以下代码的错误可以帮助解决任何问题

I am new to scala and getting below error for code in INTELLJ can any one please help to resolve it

     import org.apache.spark.{SparkContext, SparkConf}
     object wordcount {
     def main(args: Array[String])
      {
      val conf = new SparkConf()
      .setMaster("local[*]")
      .setAppName("TestSpark")
      .set("spark.executor.memory","2g")

       val sc = new SparkContext(conf)
       val a  = sc.parallelize(Seq("This is the firstline", "This is the  
       second line", "This is the third line"))              
       val count = a.flatMap(x => x.split(" "))
       val counts = count.map(word => (word,1)).reduceByKey((x,y) => x+y)
        counts.foreach(println)

       }

       }

我收到以下错误：

      Exception in thread "main" java.lang.NoSuchMethodError:    
     scala.Predef$.refArrayOps([Ljava/lang/Object;)
      Lscala/collection/mutable/ArrayOps;
      at org.apache.spark.util.Utils$.getCallSite(Utils.scala:1342)
     at org.apache.spark.SparkContext.<init>(SparkContext.scala:81)
     at wordcount$.main(wordcount.scala:12)
     at wordcount.main(wordcount.scala)
     Using Spark's default log4j profile: org/apache/spark/log4j-    

以下是我建的SBT

      name := "scalaprograms"

      version := "1.0"

       scalaVersion := "2.12.1"

      libraryDependencies += "org.apache.spark" % "spark-core_2.11" %

推荐答案

你应该使用Scala 2.11来使用 spark-core_2.11 。即使用：

You should use Scala 2.11 in order to work withspark-core_2.11. I.e. use :

scalaVersion := "2.11.8"

AFAIk Spark无法使用Scala 2.12

AFAIk Spark does not work yet with Scala 2.12

这篇关于线程“main”中的异常java.lang.NoSuchMethodError：scala.Predef $ .refArrayOps（的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！