Flink

刘超 12天前 ⋅ 4483 阅读   编辑

  flink官网

分类 版本 错误 是否
解决
hdp apache
开发工具
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.calcite.jdbc.CalciteSchema.createRootSchema(ZZ)Lorg/apache/calcite/jdbc/CalciteSchema
版本
1.10.0 Description Resource Path Location Type The type org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer09 cannot be resolved. It is indirectly referenced from required .class files
1.10.1 Recovery is suppressed by FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=3, backoffTimeMS=1)
使用
这里通过以下问题来说明面对这类问题的解决方法:1、先确定类属于哪个包中;2、然后再确认是否有包的依赖,比如pom.xml或者build.sbt中有该包的依赖吗;3、确认是不是类冲突,加一下-verbose:class打印一下jar加载明细,确认加载的是不是声明的jar,比如这类问题;还有相互依赖问题等,比如010的FlinkKafkaConsumer010依赖09的FlinkKafkaConsumer09;也有可能下载jar有问题,比如这类问题
  eclipse有The import org.apache.flink.streaming.api.functions.source.RichParallelSourceFunction
  Description Resource Path Location Type The type org.apache.flink.api.common.functions.MapFunction cannot be resolved. It is indirectly referenced from required .class files
  escription Resource Path Location Type The type org.apache.flink.streaming.connectors.kafka.KafkaDeserializationSchema cannot be resolved. It is indirectly referenced from required .class files
  Description Resource Path Location Type The project was not built since its build path is incomplete. Cannot find the class file for org.apache.hadoop.hbase.TableName. Fix the build path then try building this project
  The method endHeadOperatorInput(int) is undefined for the type OperatorChain<capture#8-of ?,capture#9-of ?>
  Exception in thread "main" java.lang.NoSuchMethodError: org.apache.flink.api.java.Utils.resolveFactory(Ljava/lang/ThreadLocal;Ljava/lang/Object;)Ljava/util/Optional;
  Exception in thread "main" java.lang.IllegalAccessError: tried to access method org.apache.flink.core.execution.DefaultExecutorServiceLoader.()V from class org.apache.flink.streaming.api.environment.StreamExecutionEnvironment
  java.lang.ClassCastException: org.codehaus.janino.CompilerFactory cannot be cast to org.codehaus.commons.compiler.ICompilerFactory
语法
  Caused by: org.apache.calcite.sql.parser.impl.ParseException: Encountered "as \"" at line 10, column 148.
  Caused by: java.sql.SQLException: Parameter index out of range (1 > number of parameters, which is 0).
模块
  flink-runtime-web
  The module flink-runtime-web could not be found in the class path. Please add this jar in order to enable web based job submission
WordCount
  Caused by: org.apache.flink.runtime.resourcemanager.exceptions.UnfulfillableSlotRequestException: Could not fulfill slot request 6e67620df1632199ab51ed218f9c381 e. Requested resource profile (ResourceProfile{UNKNOWN}) is unfulfillable.
数据类型 No implicit arguments of type: TypeInformation[AdxBidWin]
  the result type of an implicit conversion must be more specific than Object
函数 AggregateFunction
Too many arguments for method aggregate(AggregateFunction[T,ACC,R])(TypeInformation[ACC],TypeInformation[R])  
the result type of an implicit conversion must be more specific than Object
jar 1.9 class org.apache.flink.kafka.shaded.org.kafka.common.serialization.ByteArrayDeserializer could not be found
超时
java.util.concurrent.TimeoutException: Heartbeat of TaskManager with id container_e87_1591346769672_60966_01_000006 timed out.
checkout
checkpoint太大导致flink重启
状态
processor-api
The new key serializer must be compatible.
日志
WARN No appenders could be found for logger (org.apache.flink.api.java.ClosureCleaner)
JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'Key: 'web.log.path' , default: null (fallback keys: [{key=jobmanager.web.log.path, isDeprecated=true}])'.
第三方组件
kafka Connection to node -1 (10.172.32.142/10.172.32.142:11041) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka
flinksql向kafka输出数据出现EXPR$7
ES [WARN ][o.e.d.s.a.InternalOrder$Parser] Deprecated aggregation order key [_term] used, replaced by [_key]
安装
docker flink docker pull 下来的 flink,按docker run --name flink_jobmanager -d -t flink jobmanager运行,页面打不


注意:本文归作者所有,未经作者允许,不得转载

全部评论: 0

    我有话说: