org.apache.spark.sql.AnalysisException: Try to map struct<>to Tuple1 异常
来源:互联网 发布:笔记本电脑咋下载软件 编辑:程序博客网 时间:2024/06/14 15:00
spark.read.parquet(mypath).as[MyEntity]会遇到下面异常
org.apache.spark.sql.AnalysisException: Try to map struct<uid:string> to Tuple1, but failed as the number of fields does not line up.;at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveDeserializer$.org$apache$spark$sql$catalyst$analysis$Analyzer$ResolveDeserializer$$fail(Analyzer.scala:2044)at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveDeserializer$.org$apache$spark$sql$catalyst$analysis$Analyzer$ResolveDeserializer$$validateTopLevelTupleFields(Analyzer.scala:2061)at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveDeserializer$$anonfun$apply$32$$anonfun$applyOrElse$12.applyOrElse(Analyzer.scala:2035)at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveDeserializer$$anonfun$apply$32$$anonfun$applyOrElse$12.applyOrElse(Analyzer.scala:2027)
在read之前需要:
import spark.implicits._
阅读全文
0 0
- org.apache.spark.sql.AnalysisException: Try to map struct<>to Tuple1 异常
- org.apache.spark.shuffle.FetchFailedException:Failed to connect to异常
- Sparksql 一个错误:org.apache.spark.sql.AnalysisException: character ' ' not supported here;
- org.apache.spark.sql.AnalysisException: Table or view not found: `traintext`.`train`; line 1 pos 14;
- golang struct to map
- spark 启动sql Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
- org.apache.spark.sql.catalyst.expressions.GenericRowWithSchema cannot be cast to scala.Tuple2
- org.apache.catalina.LifecycleException: Failed to start component 异常
- Maven xml异常:Failure to transfer org.apache.maven.***
- 关于异常org.apache.catalina.LifecycleException: Failed to start
- spark worker 启动失败 failed to launch org.apache.spark.deploy.worker.Worker
- org.apache.catalina.util.DefaultAnnotationProcessor cannot be cast to org.ap 造型异常 解决
- Introduction To Apache Spark(1)
- org.apache.spark.sql.api.java.JavaSQLContext
- Hive On Spark报错:Failed to execute spark task, org.apache.hadoop.hive.ql.metadata.HiveException
- org.apache.hadoop.ipc.Client: Retrying connect to server异常的解决
- hadoop异常:org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031
- hadoop MapReduce运行异常:Unknown protocol to name node: org.apache.hadoop.mapred.JobSubmissionProtocol
- Spring Cloud学习--容错机制(Hystrix之Turbine集群监控)
- 多线程:基本概念
- 随便写写
- ubuntu16.04 安装Sublime Text 3
- Solr搜索引擎(2)Solrj
- org.apache.spark.sql.AnalysisException: Try to map struct<>to Tuple1 异常
- <![CDATA[ ]]>和转义字符的使用
- malloc, calloc, realloc 使用及区别
- 快速排序算法C语言实现
- 【AC梦工厂】广工华工联合训练1 H
- jQuery整理
- 全民暗黑APK+IOS双端文字教程+商业手工端
- codevs 4919 线段树:区间更新,区间查询(余数)
- Android Studio创建不同分辨率的Drawable文件夹