当前位置:网站首页>Four classic training modes in comparative learning
Four classic training modes in comparative learning
2022-06-28 02:01:00 【Zhiyuan community】
Contrastive learning is a very effective method in unsupervised representation learning , The core idea is to train query and key Of Encoder, Let this Encoder To match query and key The generated coding distance is close to , The mismatched encoding distance is far . Want to make comparative learning effective , A core point is to expand the comparison sample ( Negative sample ) The number of , That is, each time the gradient is updated ,query What you see doesn't match key The number of . The more negative samples , The closer to the actual goal of comparative learning , namely query And all that don't match key All far away .
At present, there are 4 The most typical paradigm , Respectively End-to-End、Memory Bank、Momentum Encoder as well as In-Batch Negtive. The differences of these comparative learning structures are mainly reflected in the treatment of negative samples ,4 The first method is an evolving relationship . This article mainly introduces this 4 The classic work of a comparative learning structure .
边栏推荐
- Data analysts too hot? Monthly income 3W? Tell you the true situation of this industry with data
- PV操作原语
- [open source] open source system sorting - Examination Questionnaire, etc
- 解决ionic4 使用hammerjs手势 press 事件,页面无法滚动问题
- Centos8 operation record command version Yum redis MySQL Nacos JDK
- 如何高效读书学习
- 面试官问:JS的继承
- Prometeus 2.35.0 新特性
- [sylixos] I2C device driver creation and use
- Ai+ clinical trial patient recruitment | massive bio completed round a financing of $9million
猜你喜欢
面试官问:能否模拟实现JS的new操作符
[Yongyi XY chair] trial experience
Google Earth engine (GEE) -- an error caused by the imagecollection (error) traversing the image collection
[Niuke discussion area] Chapter 4: redis
Database query optimization: master-slave read-write separation and common problems
基于可学习尺寸自适应分子亚结构的药物相互作用预测
Web3 technology initial experience and related learning materials
What is digitalization? What is digital transformation? Why do enterprises choose digital transformation?
数据库的新选择 Amazon Aurora
How fiddle uses agents
随机推荐
要搞清楚什么是同步,异步,串行,并行,并发,进程,线程,协程
什麼是數字化?什麼是數字化轉型?為什麼企業選擇數字化轉型?
面试官问:JS的继承
Modular development
机器学习笔记 - 时间序列作为特征
什么是数字化?什么是数字化转型?为什么企业选择数字化转型?
Machine learning notes - time series as features
[embedded foundation] memory (cache, ram, ROM, flash)
Capacitor
How to understand query, key and value in transformer
How to build an e-commerce platform at low cost
有监督、无监督与半监督学习
如何高效读书学习
利用redis bitmap实现人员在线情况监控
Arrays. Aslist() pit
Adobe Premiere Basics - general operations for editing material files (offline files, replacing materials, material labels and grouping, material enabling, convenient adjustment of opacity, project pa
Google Earth engine (GEE) -- an error caused by the imagecollection (error) traversing the image collection
数据人面试指南 | 准备好这几点做到有备无患!
LMSOC:一种对社会敏感的预训练方法
[embedded foundation] serial port communication