当前位置:网站首页>Four classic training modes in comparative learning
Four classic training modes in comparative learning
2022-06-28 02:01:00 【Zhiyuan community】
Contrastive learning is a very effective method in unsupervised representation learning , The core idea is to train query and key Of Encoder, Let this Encoder To match query and key The generated coding distance is close to , The mismatched encoding distance is far . Want to make comparative learning effective , A core point is to expand the comparison sample ( Negative sample ) The number of , That is, each time the gradient is updated ,query What you see doesn't match key The number of . The more negative samples , The closer to the actual goal of comparative learning , namely query And all that don't match key All far away .
At present, there are 4 The most typical paradigm , Respectively End-to-End、Memory Bank、Momentum Encoder as well as In-Batch Negtive. The differences of these comparative learning structures are mainly reflected in the treatment of negative samples ,4 The first method is an evolving relationship . This article mainly introduces this 4 The classic work of a comparative learning structure .
边栏推荐
- 免费、好用、强大的开源笔记软件综合评测
- 评价——灰色关联分析
- Ten thousand words long article understanding business intelligence (BI) | recommended collection
- 面试官问:能否模拟实现JS的new操作符
- Arrays.asList()坑
- [DNS resolution] set the name DNSPod resolution for domain name access of COM
- Review of drug discovery-02-prediction of molecular properties
- Qu'est - ce que la numérisation? Qu'est - ce que la transformation numérique? Pourquoi les entreprises choisissent - elles la transformation numérique?
- style中的scoped属性和lang属性
- 9. Openfeign service interface call
猜你喜欢
药物发现综述-03-分子设计与优化
The practice of dual process guard and keeping alive in IM instant messaging development
万字长文看懂商业智能(BI)|推荐收藏
Adobe Premiere基础-常用的视频特效(裁剪,黑白,剪辑速度,镜像,镜头光晕)(十五)
药物发现综述-02-分子性质预测
Solve storage problems? WMS warehouse management system solution
Cloud assisted privacy collection intersection (server assisted psi) protocol introduction: Learning
机器学习笔记 - 时间序列作为特征
Adobe Premiere Basics - general operations for editing material files (offline files, replacing materials, material labels and grouping, material enabling, convenient adjustment of opacity, project pa
Adobe Premiere Basics - common video effects (cropping, black and white, clip speed, mirroring, lens halo) (XV)
随机推荐
Review of drug discovery-02-prediction of molecular properties
[Yocto RM]3 - Yocto Project Releases and the Stable Release Process
Comprehensive evaluation of free, easy-to-use and powerful open source note taking software
Import the data table in MySQL into Excel
【牛客討論區】第四章:Redis
万字长文看懂商业智能(BI)|推荐收藏
ionic4实现半星评分
TD Hero 线上发布会|7月2日邀你来
Centos8 operation record command version Yum redis MySQL Nacos JDK
[Yocto RM] 4 - Source Directory Structure
Qu'est - ce que la numérisation? Qu'est - ce que la transformation numérique? Pourquoi les entreprises choisissent - elles la transformation numérique?
有监督、无监督与半监督学习
[embedded foundation] memory (cache, ram, ROM, flash)
向excel中导入mysql中的数据表
如何高效读书学习
面试官问:JS的继承
style中的scoped属性和lang属性
Solve storage problems? WMS warehouse management system solution
网络爬虫是什么
Adobe Premiere基础-常用的视频特效(裁剪,黑白,剪辑速度,镜像,镜头光晕)(十五)