Spark 报错 : Error: bad symbolic reference. A signature in SparkContext.class refers to term conf

报错如下: 

Error:scalac: Error: bad symbolic reference. A signature in SparkContext.class refers to term conf
in package org.apache.hadoop which is not available.
It may be completely missing from the current classpath, or the version on
the classpath might be incompatible with the version used when compiling SparkContext.class.
scala.reflect.internal.Types$TypeError: bad symbolic reference. A signature in SparkContext.class refers to term conf
in package org.apache.hadoop which is not available.
It may be completely missing from the current classpath, or the version on
the classpath might be incompatible with the version used when compiling SparkContext.class.at scala.reflect.internal.pickling.UnPickler$Scan.toTypeError(UnPickler.scala:847)at scala.reflect.internal.pickling.UnPickler$Scan$LazyTypeRef.complete(UnPickler.scala:854)at scala.reflect.internal.pickling.UnPickler$Scan$LazyTypeRef.load(UnPickler.scala:863)at scala.reflect.internal.Symbols$Symbol.typeParams(Symbols.scala:1489)at scala.tools.nsc.transform.SpecializeTypes$$anonfun$scala$tools$nsc$transform$SpecializeTypes$$normalizeMember$1.apply(SpecializeTypes.scala:798)at scala.tools.nsc.transform.SpecializeTypes$$anonfun$scala$tools$nsc$transform$SpecializeTypes$$normalizeMember$1.apply(SpecializeTypes.scala:798)at scala.reflect.internal.SymbolTable.atPhase(SymbolTable.scala:207)at scala.reflect.internal.SymbolTable.beforePhase(SymbolTable.scala:215)at scala.tools.nsc.transform.SpecializeTypes.scala$tools$nsc$transform$SpecializeTypes$$normalizeMember(SpecializeTypes.scala:797)at scala.tools.nsc.transform.SpecializeTypes$$anonfun$22.apply(SpecializeTypes.scala:751)at scala.tools.nsc.transform.SpecializeTypes$$anonfun$22.apply(SpecializeTypes.scala:749)at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)at scala.collection.immutable.List.foreach(List.scala:318)at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:251)at scala.collection.AbstractTraversable.flatMap(Traversable.scala:105)at scala.tools.nsc.transform.SpecializeTypes.specializeClass(SpecializeTypes.scala:749)at scala.tools.nsc.transform.SpecializeTypes.transformInfo(SpecializeTypes.scala:1172)at scala.tools.nsc.transform.InfoTransform$Phase$$anon$1.transform(InfoTransform.scala:38)at scala.reflect.internal.Symbols$Symbol.rawInfo(Symbols.scala:1321)at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1241)at scala.reflect.internal.Symbols$Symbol.isDerivedValueClass(Symbols.scala:658)at scala.reflect.internal.transform.Erasure$ErasureMap.apply(Erasure.scala:131)at scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1283)at scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1030)at scala.reflect.internal.Trees$$anonfun$itransform$1.apply(Trees.scala:1229)at scala.reflect.internal.Trees$$anonfun$itransform$1.apply(Trees.scala:1228)at scala.reflect.api.Trees$Transformer.atOwner(Trees.scala:2936)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:34)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:28)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:19)at scala.reflect.internal.Trees$class.itransform(Trees.scala:1227)at scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13)at scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13)at scala.reflect.api.Trees$Transformer.transform(Trees.scala:2897)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.transform(TypingTransformers.scala:48)at scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1292)at scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1030)at scala.reflect.api.Trees$Transformer$$anonfun$transformStats$1.apply(Trees.scala:2927)at scala.reflect.api.Trees$Transformer$$anonfun$transformStats$1.apply(Trees.scala:2925)at scala.collection.immutable.List.loop$1(List.scala:170)at scala.collection.immutable.List.mapConserve(List.scala:186)at scala.reflect.api.Trees$Transformer.transformStats(Trees.scala:2925)at scala.reflect.internal.Trees$class.itransform(Trees.scala:1238)at scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13)at scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13)at scala.reflect.api.Trees$Transformer.transform(Trees.scala:2897)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.transform(TypingTransformers.scala:48)at scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1292)at scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1030)at scala.reflect.internal.Trees$$anonfun$itransform$2.apply(Trees.scala:1235)at scala.reflect.internal.Trees$$anonfun$itransform$2.apply(Trees.scala:1233)at scala.reflect.api.Trees$Transformer.atOwner(Trees.scala:2936)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:34)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:28)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:19)at scala.reflect.internal.Trees$class.itransform(Trees.scala:1232)at scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13)at scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13)at scala.reflect.api.Trees$Transformer.transform(Trees.scala:2897)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.transform(TypingTransformers.scala:48)at scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1288)at scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1030)at scala.reflect.api.Trees$Transformer$$anonfun$transformStats$1.apply(Trees.scala:2927)at scala.reflect.api.Trees$Transformer$$anonfun$transformStats$1.apply(Trees.scala:2925)at scala.collection.immutable.List.loop$1(List.scala:170)at scala.collection.immutable.List.mapConserve(List.scala:186)at scala.reflect.api.Trees$Transformer.transformStats(Trees.scala:2925)at scala.reflect.internal.Trees$class.itransform(Trees.scala:1276)at scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13)at scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13)at scala.reflect.api.Trees$Transformer.transform(Trees.scala:2897)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.scala$tools$nsc$transform$TypingTransformers$TypingTransformer$$super$transform(TypingTransformers.scala:44)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer$$anonfun$transform$1.apply(TypingTransformers.scala:44)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer$$anonfun$transform$1.apply(TypingTransformers.scala:44)at scala.reflect.api.Trees$Transformer.atOwner(Trees.scala:2936)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:34)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.transform(TypingTransformers.scala:44)at scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1292)at scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1030)at scala.reflect.api.Trees$Transformer.transformTemplate(Trees.scala:2904)at scala.reflect.internal.Trees$$anonfun$itransform$4.apply(Trees.scala:1280)at scala.reflect.internal.Trees$$anonfun$itransform$4.apply(Trees.scala:1279)at scala.reflect.api.Trees$Transformer.atOwner(Trees.scala:2936)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:34)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:28)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:19)at scala.reflect.internal.Trees$class.itransform(Trees.scala:1278)at scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13)at scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13)at scala.reflect.api.Trees$Transformer.transform(Trees.scala:2897)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.transform(TypingTransformers.scala:48)at scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1292)at scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1030)at scala.reflect.api.Trees$Transformer$$anonfun$transformStats$1.apply(Trees.scala:2927)at scala.reflect.api.Trees$Transformer$$anonfun$transformStats$1.apply(Trees.scala:2925)at scala.collection.immutable.List.loop$1(List.scala:170)at scala.collection.immutable.List.mapConserve(List.scala:186)at scala.reflect.api.Trees$Transformer.transformStats(Trees.scala:2925)at scala.reflect.internal.Trees$$anonfun$itransform$7.apply(Trees.scala:1298)at scala.reflect.internal.Trees$$anonfun$itransform$7.apply(Trees.scala:1298)at scala.reflect.api.Trees$Transformer.atOwner(Trees.scala:2936)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:34)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:28)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:19)at scala.reflect.internal.Trees$class.itransform(Trees.scala:1297)at scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13)at scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13)at scala.reflect.api.Trees$Transformer.transform(Trees.scala:2897)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.scala$tools$nsc$transform$TypingTransformers$TypingTransformer$$super$transform(TypingTransformers.scala:44)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer$$anonfun$transform$2.apply(TypingTransformers.scala:46)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer$$anonfun$transform$2.apply(TypingTransformers.scala:46)at scala.reflect.api.Trees$Transformer.atOwner(Trees.scala:2936)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:34)at scala.tools.nsc.transform.TypingTransformers$TypingTransformer.transform(TypingTransformers.scala:46)at scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1292)at scala.tools.nsc.transform.Erasure$ErasureTransformer.transform(Erasure.scala:1302)at scala.tools.nsc.transform.Erasure$ErasureTransformer.transform(Erasure.scala:888)at scala.tools.nsc.ast.Trees$Transformer.transformUnit(Trees.scala:227)at scala.tools.nsc.transform.Transform$Phase.apply(Transform.scala:30)at scala.tools.nsc.Global$GlobalPhase.applyPhase(Global.scala:464)at scala.tools.nsc.Global$GlobalPhase$$anonfun$run$1.apply(Global.scala:431)at scala.tools.nsc.Global$GlobalPhase$$anonfun$run$1.apply(Global.scala:431)at scala.collection.Iterator$class.foreach(Iterator.scala:727)at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)at scala.tools.nsc.Global$GlobalPhase.run(Global.scala:431)at scala.tools.nsc.Global$Run.compileUnitsInternal(Global.scala:1583)at scala.tools.nsc.Global$Run.compileUnits(Global.scala:1557)at scala.tools.nsc.Global$Run.compileSources(Global.scala:1553)at scala.tools.nsc.Global$Run.compile(Global.scala:1662)at xsbt.CachedCompiler0.run(CompilerInterface.scala:115)at xsbt.CachedCompiler0.run(CompilerInterface.scala:94)at xsbt.CompilerInterface.run(CompilerInterface.scala:22)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:498)at sbt.compiler.AnalyzingCompiler.call(AnalyzingCompiler.scala:101)at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:47)at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:41)at org.jetbrains.jps.incremental.scala.local.IdeaIncrementalCompiler.compile(IdeaIncrementalCompiler.scala:32)at org.jetbrains.jps.incremental.scala.local.LocalServer.compile(LocalServer.scala:26)at org.jetbrains.jps.incremental.scala.remote.Main$.make(Main.scala:68)at org.jetbrains.jps.incremental.scala.remote.Main$.nailMain(Main.scala:25)at org.jetbrains.jps.incremental.scala.remote.Main.nailMain(Main.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:498)at com.martiansoftware.nailgun.NGSession.run(NGSession.java:319)

问题原因:少引入了hadoop-client包

pom.xml中加入

   <dependency><groupId>org.apache.hadoop</groupId><artifactId>hadoop-client</artifactId><version>2.6.0</version></dependency>

 

 

本文来自互联网用户投稿,该文观点仅代表作者本人,不代表本站立场。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如若转载,请注明出处:http://www.mzph.cn/news/509898.shtml

如若内容造成侵权/违法违规/事实不符,请联系多彩编程网进行投诉反馈email:809451989@qq.com,一经查实,立即删除!

相关文章

怎么写出靠谱的简历

著 著作权归作者所有。商业转载请联系作者获得授权&#xff0c;非商业转载请注明出处。作者&#xff1a;王亞暉链接&#xff1a;http://www.zhihu.com/question/25002833/answer/35426774来源&#xff1a;知乎第一部分&#xff1a;基本信息。必须有的&#xff1a;名字、联系方式…

vue.js安装与配置

我们在前端学习中&#xff0c;学会了HTML、CSS、JS之后一般会选择学习一些框架&#xff0c;比如Jquery、AngularJs等。这个系列的博文是针对于学习Vue.js的同学展开的。 1.如何简单地使用Vue.js 如同以前我们学过的Jquery一样&#xff0c;我们在程序中使用Vue.js时也可以使用直…

简历模板

先讲讲怎样才是一份好的技术简历 首先&#xff0c;一份好的简历不光说明事实&#xff0c;更通过FAB模式来增强其说服力。 Feature&#xff1a;是什么Advantage&#xff1a;比别人好在哪些地方Benefit&#xff1a;如果雇佣你&#xff0c;招聘方会得到什么好处 其次&#xff0c;…

Sentry : Spark-sql 读取hive数据 权限问题

经测试Spark-sql 只支持Sentry表、库权限&#xff0c;不支持Sentry 对Hive列权限读的控制&#xff0c;设置列权限读&#xff0c;Spark-sql是无权限读取的 对hive表某一列有读权限设置 代码如下&#xff0c;jast_column用户有对hive表test的s2列读权限&#xff0c;这里使用spa…

运行第一个vue.js文件

<!DOCTYPE html> <html> <head> <meta charset"utf-8"> <title>第一个vue.js</title> <script src"https://cdn.bootcss.com/vue/2.2.2/vue.min.js"></script> </head> <body> <div id&qu…

请不要做个浮躁的人

1.把C当成一门新的语言学习&#xff08;和C没啥关系&#xff01;真的。&#xff09;&#xff1b; 2.看《Thinking In C&#xff0c;不要看《C变成死相》&#xff1b; 3.看《The C Programming Language》和《Inside The C Object Model》,不要因为他们很难而我们自己是初…

Hbase WALs(HLog) 文件存储,查看

WALs(HLog) 存储 HLog 存储位置是在&#xff0c;hbase配置目录下WALs目录&#xff0c;默认为 /hbase/WALs 与 /hbase/oldWALs /hbase/WALs : 存储未过期的日志/hbase/oldWALs : 存储已过期的日志 这里先查看WALs日志目录&#xff0c;目录格式为&#xff1a;hostname1 为 …

关于在头文件中定义变量

注意头文件中不可以放变量的定义&#xff01;&#xff01;&#xff01;一般情况下头文件中只放变量的声明&#xff0c;因为头文件要被其他文件包含&#xff08;即#include&#xff09;&#xff0c;如果把定义放到头文件的话&#xff0c;就不能避免多次定义变量&#xff0c;C不允…

Elasticsearch 6.x 下载安装

下载ES 下载ES安装包上传至服务器&#xff0c;地址为&#xff1a; https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-6.1.0.tar.gz 上传完成后解压 tar -zxvf elasticsearch-6.1.0.tar.gz 安装JDK 这里使用jdk8&#xff0c;官网下载安装即可&#xf…

抽象工厂模式-与-工厂方法模式区别

首先来看看这两者的定义区别&#xff1a; 工厂模式&#xff1a;定义一个用于创建对象的借口&#xff0c;让子类决定实例化哪一个类 抽象工厂模式&#xff1a;为创建一组相关或相互依赖的对象提供一个接口&#xff0c;而且无需指定他们的具体类 个人觉得这个区别在于产品&#x…

navicat设计表中添加自增长列

写web通讯录的时候在添加联系人时候需要主键故采用自增长列为主键&#xff0c;百度链接有详细教程 点击打开链接,注意的是在设计表中添加栏位后把类型改成bigint才会出现自增长选项&#xff0c;希望对你有用

ElasticSearch 索引、更新和删除数据

https://www.elastic.co/guide/en/elasticsearch/client/java-api/6.1/client.html Relational DB -> Databases -> Tables -> Rows -> Columns Elasticsearch -> Indices -> Types -> Documents -> Fields 创建索引 , 5个分片&#xff0c;1个副本 …

osg学习笔记(一)

场景图形采用一种自顶向下的&#xff0c;分层的树状数据结构来组织空间数据集&#xff0c;以提高渲染的效率 场景图形树结构的顶部是一个根节点&#xff0c;从根节点向下延伸&#xff0c;各个组节点中均包含了几何信息和用于控制其外观的渲染状态信息。根节点和各个组节点都可以…

Centos7.x 安装 CDH 6.x

前置条件 ntp服务安装防火墙关闭 执行以下优化代码 systemctl stop firewalld.service echo "* soft nofile 128000" >>/etc/security/limits.conf echo "* hard nofile 128000" >>/etc/security/limits.conf echo "* so…

osg学习博客

http://www.cnblogs.com/mazhenyu/p/3522387.html http://www.cnblogs.com/shapherd/archive/2010/08/10/osg.html&#xff08;基础知识&#xff09;

Windows IEDA 编译Hbase源码报错 - 无法执行shell脚本

windows 下编译 hbase源码&#xff0c;报错 [ERROR] Command execution failed. java.io.IOException: Cannot run program "bash" (in directory "D:\File\ideaWorkspace\hbase-1.4.10-src\hbase-1.4.10\hbase-shaded\hbase-shaded-check-invariants\target\…

怎样查找自增列主键的id

select max(id) from inform &#xff08;inform为表名,查询最大的id值&#xff09;

c++使用Lua

http://www.jb51.net/article/55096.htm

最新版 VMware 安装,虚拟机安装, Ubuntu可视化linux系统安装

一、下载 地址&#xff1a;https://www.vmware.com/cn.html 二、安装VM 选择相应配置&#xff0c;一直下一步即可 双击打开VMware&#xff0c;输入密钥&#xff1a;CG392-4PX5J-H816Z-HYZNG-PQRG2 Ubuntu 镜像下载地址&#xff1a; https://www.ubuntu.com/download/desktop/…

何为“渲染”

这个问题也曾经困惑过我很久.其实"渲染","绘制","画画"这三个词是一个意思.对应的英文是Render,Draw,Paint.但"渲染"的逼格要高于"绘制","绘制"的逼格要高于"画画".在计算机图形学相关的书中,你只会看到…