当前位置:网站首页>Flink partition policy
Flink partition policy
2022-06-25 11:39:00 【Direction_ Wind】
- GlobalPartitioner The data will be distributed to the first instance of the downstream operator for processing
- RebalancePartitioner Count It is reported that Be followed Ring hair Deliver to Next Swimming each A reality In the example Into the Office The reason is .
- RescalePartitioner This kind of partition will be based on the parallelism of upstream and downstream operators , Loop output to every instance of the downstream operator .
- BroadcastPartitioner The broadcast partition will output the upstream data to each instance of the downstream operator . optimum close For big data sets and small data sets Jion Scene .
- ForwardPartitioner Used to output records to downstream local operator instances . It requires upstream and downstream count Son and That's ok degree One sample . To put it simply , ForwardPartitioner Console printing for data .( It's also chain Conditions for operators )
- KeyGroupStreamPartitioner Hash Comparator . Will press the data Key Of Hash Value output to downstream operator instance .
- CustomPartitionerWrapper User defined partition . It needs to be implemented by users themselves Partitioner Interface , To define your own partition logic
RescalePartitioner It's a little hard to understand , Suppose the upstream parallelism is 2, The number is A and B. The downstream parallelism is 4, The number is 1,2,3,4. that A Then send the data loop to 1 and 2,B Then send the data loop to 3 and 4. Suppose the upstream parallelism is 4, The number is A,B,C,D. Downstream parallel Line degree , The number is 1,2. that A and B Send the data to 1,C and D Send the data to 2.
边栏推荐
- Comment TCP gère - t - il les exceptions lors de trois poignées de main et de quatre vagues?
- MySQL synchronous data configuration and shell script implementation
- Jincang KFS data cascade scenario deployment
- 翌圣生物冲刺科创板:25%收入来自新冠产品销售 拟募资11亿
- Countdownlatch source code analysis
- 9 cases where elements cannot be located
- Socket communication principle
- Leetcode 1249. Remove invalid brackets (awesome, finally made)
- [shangyun boutique] energy saving and efficiency improvement! Accelerating the transformation of "intelligent manufacturing" in the textile industry
- Spark Tuning common configuration parameters
猜你喜欢
SQL injection vulnerability (bypass)
牛客网:旋转数组
西山科技冲刺科创板:拟募资6.6亿 郭毅军夫妇有60%表决权
基于SSH的高校实验室物品管理信息系统的设计与实现 论文文档+项目源码及数据库文件
Démarrer avec Apache shenyu
Design and implementation of university laboratory goods management information system based on SSH
数据库系列:MySQL索引优化总结(综合版)
Double buffer transparent encryption and decryption driven course paper + project source code based on minifilter framework
Ladder side tuning: the "wall ladder" of the pre training model
基于超算平台气象预警并行计算架构研究
随机推荐
relu与sigmod的比较
为什么要分布式 id ?分布式 id 生成方案有哪些?
金仓数据库 KingbaseES 插件DBMS_OUTPUT
杭州/北京内推 | 阿里达摩院招聘视觉生成方向学术实习生(人才计划)
Double tampon transparent cryptage et décryptage basé sur le cadre minifilter
TCP如何处理三次握手和四次挥手期间的异常
Big endian and little endian
JVM 原理简介
Jincang database kingbasees plug-in identity_ pwdexp
一个数学难题,难倒两位数学家
牛客网:分糖果问题
Apache ShenYu 入门
查询法,中断法实现USART通信
9 cases where elements cannot be located
Course paper + code and executable EXE file of library information management system based on C language
翌圣生物冲刺科创板:25%收入来自新冠产品销售 拟募资11亿
Spark history server performance improvement (I) -- Application List
数据库系列:MySQL索引优化总结(综合版)
子类A继承父类B, A a = new A(); 则父类B构造函数、父类B静态代码块、父类B非静态代码块、子类A构造函数、子类A静态代码块、子类A非静态代码块 执行的先后顺序是?
Getting started with Apache Shenyu