Search
❯
Apr 24, 20261 min read
warmup phase → stable (constant) phase → cosine decay phase
learning rate schedule