当前位置:网站首页>Four classic training modes in comparative learning
Four classic training modes in comparative learning
2022-06-28 02:01:00 【Zhiyuan community】
Contrastive learning is a very effective method in unsupervised representation learning , The core idea is to train query and key Of Encoder, Let this Encoder To match query and key The generated coding distance is close to , The mismatched encoding distance is far . Want to make comparative learning effective , A core point is to expand the comparison sample ( Negative sample ) The number of , That is, each time the gradient is updated ,query What you see doesn't match key The number of . The more negative samples , The closer to the actual goal of comparative learning , namely query And all that don't match key All far away .
At present, there are 4 The most typical paradigm , Respectively End-to-End、Memory Bank、Momentum Encoder as well as In-Batch Negtive. The differences of these comparative learning structures are mainly reflected in the treatment of negative samples ,4 The first method is an evolving relationship . This article mainly introduces this 4 The classic work of a comparative learning structure .
边栏推荐
猜你喜欢
声网 VQA:将实时互动中未知的视频画质用户主观体验变可知
pytorch_ lightning. utilities. exceptions. MisconfigurationException: You requested GPUs: [1] But...
基于可学习尺寸自适应分子亚结构的药物相互作用预测
Database query optimization: master-slave read-write separation and common problems
Evaluation - grey correlation analysis
【牛客討論區】第四章:Redis
Xctf attack and defense world misc wage earner advanced zone
评价——秩和比综合评价
如何理解 Transformer 中的 Query、Key 与 Value
frp实现内网穿透
随机推荐
药物发现综述-02-分子性质预测
药物发现综述-01-药物发现概述
Overview of drug discovery-01 overview of drug discovery
Is it safe to open an online futures account?
[Yocto RM]3 - Yocto Project Releases and the Stable Release Process
Golang monkeys eat peaches and ask for the number of peaches on the first day
Solon 1.8.3 release, cloud native microservice development framework
Original | 2025 to achieve the "five ones" goal! The four products of Jiefang power are officially released
有监督、无监督与半监督学习
Adobe Premiere基础-常用的视频特效(边角定位,马赛克,模糊,锐化,手写工具,效果控件层级顺序)(十六)
pytorch_ lightning. utilities. exceptions. MisconfigurationException: You requested GPUs: [1] But...
Implementation of timed tasks in laravel framework
学习 pickle
OS模块与OS.path 模块的学习
要搞清楚什么是同步,异步,串行,并行,并发,进程,线程,协程
style中的scoped属性和lang属性
Some habits of making money in foreign lead
树莓派实现温控风扇智能降温
pytorch_lightning.utilities.exceptions.MisconfigurationException: You requested GPUs: [1] But...
Adobe Premiere foundation - sound adjustment (volume correction, noise reduction, telephone tone, pitch shifter, parameter equalizer) (XVIII)