Never think about x ↦ x - η∇L(x) (gradient descent),even as a simplification.Replace it with x ↦ (1-𝛾)x + 𝛾 argmin_{y∈X} ⟨y,∇L(x)⟩ (Frank-Wolfe; a Mann iteration)or x ↦ (1-λ)x + η…

Posters: davidad. davidad

2 likes recorded by the source corpus.

Topics: Math

View Post: https://x.com/davidad/status/1783717909153390714