Last-Iterate Convergence for Constrained MDPs: From Dual Descent to Primal-Dual

Dual descent gives last-iterate guarantees without coverage assumptions. An inner-loop-free primal-dual method improves those guarantees further.

By Michael Lu, Max Qiushi Lin, Mo Chen et al · 1-minute read