Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Welcome To Ask or Share your Answers For Others

Categories

0 votes
938 views
in Technique[技术] by (71.8m points)

hadoop - exception ".internal.jaxp.datatype.XMLGregorianCalendarImpl" during hive query

i get this exception when i perform a large query of hive that does not include any date in it and cant figure out what that means , the query is simply join between 2 large tables

exception java.lang.IllegalArgumentException: "2019-02-29T19:37:16" is not a valid representation of an XML Gregorian Calendar value. at com.sun.org.apache.xerces.internal.jaxp.datatype.XMLGregorianCalendarImpl.<init>

full trace:

Status: FAILED java.lang.RuntimeException: java.sql.SQLException: Error while processing statement{Failed in 10.35.172.131} :
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex re-running, vertexName=Map 5
, vertexId=vertex_1610800572255_205110_1_00Vertex re-running, vertexName=Map 5, 
vertexId=vertex_1610800572255_205110_1_00Vertex re-running, vertexName=Map 5,
vertexId=vertex_1610800572255_205110_1_00Vertex re-running, vertexName=Map 5,
vertexId=vertex_1610800572255_205110_1_00Vertex re-running, vertexName=Map 5, 
vertexId=vertex_1610800572255_205110_1_00Vertex re-running,
...
vertexName=Map 5, vertexId=vertex_1610800572255_205110_1_00Vertex re-running, vertexName=Map 5, 
vertexId=vertex_1610800572255_205110_1_00Vertex failed, vertexName=Map 1, vertexId=vertex_1610800572255_205110_1_01, 
diagnostics=[Task failed, taskId=task_1610800572255_205110_1_01_000041,
diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task 
( failure ) : attempt_1610800572255_205110_1_01_000041_0:java.lang.RuntimeException: j
ava.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: 
Hive Runtime Error while processing row [Error getting row data with exception java.lang.IllegalArgumentException:
"2019-02-29T16:11:22" is not a valid representation of an XML Gregorian Calendar value. 
at com.sun.org.apache.xerces.internal.jaxp.datatype.XMLGregorianCalendarImpl.<init>(XMLGregorianCalendarImpl.java:440)
at com.sun.org.apache.xerces.internal.jaxp.datatype.DatatypeFactoryImpl.newXMLGregorianCalendar(DatatypeFactoryImpl.java:536)
at javax.xml.bind.DatatypeConverterImpl._parseDateTime(DatatypeConverterImpl.java:422)
at javax.xml.bind.DatatypeConverterImpl.parseDateTime(DatatypeConverterImpl.java:417)
at javax.xml.bind.DatatypeConverter.parseDateTime(DatatypeConverter.java:327)
at org.openx.data.jsonserde.objectinspector.primitive.ParsePrimitiveUtils.parseTimestamp(ParsePrimitiveUtils.java:60)
at org.openx.data.jsonserde.objectinspector.primitive.JavaStringTimestampObjectInspector.getPrimitiveWritableObject(JavaStringTimestampObjectInspector.java:73) 
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:276) 
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:373)
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:373)
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:203) 
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:189)
at org.apache.hadoop.hive.ql.exec.MapOperator.toErrorMessage(MapOperator.java:596)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:562)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:92)
at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:76) 
at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:419) 
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:267)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:250)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:108) 
....
question from:https://stackoverflow.com/questions/65913594/exception-internal-jaxp-datatype-xmlgregoriancalendarimpl-during-hive-query

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome To Ask or Share your Answers For Others

1 Answer

0 votes
by (71.8m points)
Waitting for answers

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Click Here to Ask a Question

2.1m questions

2.1m answers

60 comments

57.0k users

...