Proximal algorithms /

This monograph is about a class of optimization algorithms called proximal algorithms. Much like Newton's method is a standard tool for solving unconstrained smooth optimization problems of modest size, proximal algorithms can be viewed as an analogous tool for nonsmooth, constrained, large-sca...

Full description

Bibliographic Details
Main Authors: Parikh, Neal (Author), Boyd, Stephen P (Author)
Format: Book
Language:English
Published: [Hanover, Massachusetts] : Now Publishers, 2014
Series:Foundations and trends in optimization ; volume 1, issue 3, pages 127-239
Subjects:
LEADER 05132nam a2200649Mi 4500
001 66bc63ed-677d-4626-b6bf-457ee7213210
005 20240926000000.0
008 141204s2014 mau foab 000 0 eng d
020 |a 160198717X 
020 |a 9781601987174  |q (electronic) 
020 |z 9781601987167  |q (print) 
024 7 |a 10.1561/2400000003  |2 doi 
035 |a (OCoLC-M)905838036 
035 |a (Sirsi) a13475658 
035 |a (Sirsi) ocn905838036 
040 |a LLB  |b eng  |e rda  |e pn  |c LLB  |d OCLCO  |d OCLCF  |d CEF  |d OCLCQ  |d UtOrBLW 
050 4 |a QA402.5  |b .P276 2014 
082 0 4 |a 519.3  |2 23 
100 1 |a Parikh, Neal,  |e author 
245 1 0 |a Proximal algorithms /  |c Neal Parikh, Stephen Boyd 
264 1 |a [Hanover, Massachusetts] :  |b Now Publishers,  |c 2014 
300 |a 1 online resource (1 PDF (iii, 128-239 pages)) 
336 |a text  |b txt  |2 rdacontent 
337 |a electronic  |2 isbdmedia 
338 |a online resource  |b cr  |2 rdacarrier 
490 1 |a Foundations and trends in optimization,  |x 2167-3918 ;  |v volume 1, issue 3, pages 127-239 
500 |a Title from PDF (viewed on December 04, 2014) 
504 |a Includes bibliographical references (pages 224-239) 
505 0 |a 1. Introduction -- 1.1 Definition -- 1.2 Interpretations -- 1.3 Proximal algorithms -- 1.4 What this paper is about -- 1.5 Related work -- 1.6 Outline 
505 8 |a 2. Properties -- 2.1 Separable sum -- 2.2 Basic operations -- 2.3 Fixed points -- 2.4 Proximal average -- 2.5 Moreau decomposition 
505 8 |a 3. Interpretations -- 3.1 Moreau-Yosida regularization -- 3.2 Resolvent of subdifferential operator -- 3.3 Modified gradient step -- 3.4 Trust region problem -- 3.5 Notes and references 
505 8 |a 4. Proximal algorithms -- 4.1 Proximal minimization -- 4.2 Proximal gradient method -- 4.3 Accelerated proximal gradient method -- 4.4 Alternating direction method of multipliers -- 4.5 Notes and references 
505 8 |a 5. Parallel and distributed algorithms -- 5.1 Problem structure -- 5.2 Consensus -- 5.3 Exchange -- 5.4 Allocation -- 5.5 Notes and references 
505 8 |a 6. Evaluating proximal operators -- 6.1 Generic methods -- 6.2 Polyhedra -- 6.3 Cones -- 6.4 Pointwise maximum and supremum -- 6.5 Norms and norm balls -- 6.6 Sublevel set and epigraph -- 6.7 Matrix functions -- 6.8 Notes and references 
505 8 |a 7. Examples and applications -- 7.1 Lasso -- 7.2 Matrix decomposition -- 7.3 Multi-period portfolio optimization -- 7.4 Stochastic optimization -- 7.5 Robust and risk-averse optimization -- 7.6 Stochastic control 
505 8 |a 8. Conclusions -- References 
510 0 |a ACM Computing Guide 
510 0 |a ACM Computing Reviews 
510 0 |a AMS MathSciNet 
510 0 |a DBLP Computer Science Bibliography 
510 0 |a Google Book Search 
510 0 |a Google Scholar 
510 0 |a INSPEC 
510 0 |a Scopus 
510 0 |a Zentralblatt MATH Database 
520 3 |a This monograph is about a class of optimization algorithms called proximal algorithms. Much like Newton's method is a standard tool for solving unconstrained smooth optimization problems of modest size, proximal algorithms can be viewed as an analogous tool for nonsmooth, constrained, large-scale, or distributed versions of these problems. They are very generally applicable, but are especially well-suited to problems of substantial recent interest involving large or high-dimensional datasets. Proximal methods sit at a higher level of abstraction than classical algorithms like Newton's method: the base operation is evaluating the proximal operator of a function, which itself involves solving a small convex optimization problem. These subproblems, which generalize the problem of projecting a point onto a convex set, often admit closed-form solutions or can be solved very quickly with standard or simple specialized methods. Here, we discuss the many different interpretations of proximal operators and algorithms, describe their connections to many other topics in optimization and applied mathematics, survey some popular algorithms, and provide a large number of examples of proximal operators that commonly arise in practice 
524 |a Foundations and Trends in Optimization, Vol. 1, No. 3 (2014) 127-239, 2014, N. Parikh and S. Boyd 
650 0 |a Algorithms  |0 (SIRSI)991523 
650 0 |a Mathematical optimization  |0 (SIRSI)1037742 
650 7 |a Algorithms  |2 fast  |0 http://id.worldcat.org/fast/805020 
650 7 |a Mathematical optimization  |2 fast  |0 http://id.worldcat.org/fast/1012099 
700 1 |a Boyd, Stephen P  |e author.  |0 (SIRSI)750229 
710 2 |a Now Publishers,  |e publisher 
830 0 |a Foundations and trends in optimization ;  |v volume 1, issue 3, pages 127-239 
999 1 0 |i 66bc63ed-677d-4626-b6bf-457ee7213210  |l a13475658  |s US-CST  |m proximal_algorithms________________________________________________________2014_______nowpua________________________________________parikh__neal_______________________e 
999 1 1 |l a13475658  |s ISIL:US-CST  |t BKS  |b 1c22877c-a3d9-52d6-a55c-017badb2d8ad  |y 1c22877c-a3d9-52d6-a55c-017badb2d8ad  |p UNLOANABLE 
999 1 1 |l a13475658  |s ISIL:US-CST  |t BKS  |a SUL-ELECTRONIC  |p UNLOANABLE