📑

AI Paper Research

AI 논문 조사 및 정리

Foundations
최적화·학습이론Optimization & Learning Theory
The Road Less Scheduled
Symbolic Discovery of Optimization Algor...Sophia: A Scalable Stochastic Second-ord...
Tensor Programs V: Tuning Large Neural N...
Sharpness-Aware Minimization for Efficie...
The Lottery Ticket Hypothesis: Finding S...Large Batch Optimization for Deep Learni...
Decoupled Weight Decay RegularizationLarge Batch Training of Convolutional Ne...
Training Deep Nets with Sublinear Memory...
홈/최적화·학습이론/2023

최적화·학습이론 — 2023

2편의 논문

NeurIPS 2023500+

Symbolic Discovery of Optimization Algorithms

최적화 알고리즘의 기호적 발견

Xiangning Chen, Chen Liang, Da Huang et al. (2023)

ICLR 2024300+

Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Sophia: 언어 모델 사전학습을 위한 확장 가능한 확률적 2차 최적화기

Hong Liu, Zhiyuan Li, David Hall et al. (2023)

← 최적화·학습이론 전체