To avoid the failure of FTL we can try to “regularize” the weight vectors by adding a penalty function R(w) to the objective. This yields the FoReL algorithm.
https://…/notes.pdf
http://…/lecture3.pdf … Follow the Regularized Leader (FTRL,FoReL)