当前位置:网站首页>Flink partition policy
Flink partition policy
2022-06-25 11:39:00 【Direction_ Wind】
- GlobalPartitioner The data will be distributed to the first instance of the downstream operator for processing
- RebalancePartitioner Count It is reported that Be followed Ring hair Deliver to Next Swimming each A reality In the example Into the Office The reason is .
- RescalePartitioner This kind of partition will be based on the parallelism of upstream and downstream operators , Loop output to every instance of the downstream operator .
- BroadcastPartitioner The broadcast partition will output the upstream data to each instance of the downstream operator . optimum close For big data sets and small data sets Jion Scene .
- ForwardPartitioner Used to output records to downstream local operator instances . It requires upstream and downstream count Son and That's ok degree One sample . To put it simply , ForwardPartitioner Console printing for data .( It's also chain Conditions for operators )
- KeyGroupStreamPartitioner Hash Comparator . Will press the data Key Of Hash Value output to downstream operator instance .
- CustomPartitionerWrapper User defined partition . It needs to be implemented by users themselves Partitioner Interface , To define your own partition logic
RescalePartitioner It's a little hard to understand , Suppose the upstream parallelism is 2, The number is A and B. The downstream parallelism is 4, The number is 1,2,3,4. that A Then send the data loop to 1 and 2,B Then send the data loop to 3 and 4. Suppose the upstream parallelism is 4, The number is A,B,C,D. Downstream parallel Line degree , The number is 1,2. that A and B Send the data to 1,C and D Send the data to 2.
边栏推荐
- relu与sigmod的比较
- SQL injection vulnerability (bypass)
- Double tampon transparent cryptage et décryptage basé sur le cadre minifilter
- redis的dict的扩容机制(rehash)
- Démarrer avec Apache shenyu
- 西山科技冲刺科创板:拟募资6.6亿 郭毅军夫妇有60%表决权
- Shichuang Energy sprint Technology Innovation Board: le chiffre d'affaires annuel prévu de 1,1 milliard de RMB est de 0,7 milliard de RMB, en baisse de 36%
- c盘使用100%清理方法
- Hangzhou / Beijing neitui Ali Dharma academy recruits academic interns in visual generation (talent plan)
- MySQL and Oracle processing CLOB and blob fields
猜你喜欢

仿真与烧录程序有哪几种方式?(包含常用工具与使用方式)

Writing wechat applet with uni app

Leetcode 1249. Remove invalid brackets (awesome, finally made)

金太阳教育美股上市:市值3.6亿美元 成小盘中概股

Design and implementation of university laboratory goods management information system based on SSH

金仓KFS数据级联场景部署

按钮多次点击造成结果

SQL注入漏洞(绕过篇)

Spark runs wordcount (case 2)

基于C语言的图书信息管理系统 课程论文+代码及可执行exe文件
随机推荐
基于C语言的图书信息管理系统 课程论文+代码及可执行exe文件
9 cases where elements cannot be located
基于Minifilter框架的双缓冲透明加解密驱动 课程论文+项目源码
Causes and solutions of over fitting
Spark runs wordcount (case 2)
GaussDB 集群维护案例集-sql执行慢
CFCA Anxin sign access
Detection and analysis of simulator in an app
元素定位不到的 9 种情况
Dragon Book tiger Book whale Book gnawing? Try the monkey book with Douban score of 9.5
How gaussdb counts the response time of user SQL
Niuke.com: Candy distribution
Whole process of web page request
C disk uses 100% cleaning method
2022 PMP project management examination agile knowledge points (2)
为什么要分布式 id ?分布式 id 生成方案有哪些?
Kingbasees plug-in ftutilx of Jincang database
JVM shutdown hook details
仿真与烧录程序有哪几种方式?(包含常用工具与使用方式)
过拟合原因及解决