Proximal quasi-Newton methods for regularized convex optimization with linear and accelerated sublinear convergence rates
Sign Up to like & getrecommendations! Published in 2018 at "Computational Optimization and Applications"
DOI: 10.1007/s10589-017-9964-z
Abstract: A general, inexact, efficient proximal quasi-Newton algorithm for composite optimization problems has been proposed by Scheinberg and Tang (Math Program 160:495–529, 2016) and a sublinear global convergence rate has been established. In this paper, we… read more here.
Keywords: newton algorithm; proximal quasi; quasi newton; optimization ... See more keywords
Convergence of Quasi-Newton Method for Fully Complex-Valued Neural Networks
Sign Up to like & getrecommendations! Published in 2017 at "Neural Processing Letters"
DOI: 10.1007/s11063-017-9621-7
Abstract: In this paper, based on Wirtinger calculus, we introduce a quasi-Newton method for training complex-valued neural networks with analytic activation functions. Using the duality between Wirtinger calculus and multivariate real calculus, we prove a convergence… read more here.
Keywords: valued neural; method; quasi newton; newton method ... See more keywords
Diagonal quasi-Newton methods via least change updating principle with weighted Frobenius norm
Sign Up to like & getrecommendations! Published in 2020 at "Numerical Algorithms"
DOI: 10.1007/s11075-020-00930-9
Abstract: This paper presents a class of low memory quasi-Newton methods with standard backtracking line search for large-scale unconstrained minimization. The methods are derived by means of least change updating technique analogous to that for the… read more here.
Keywords: change updating; quasi; quasi newton; newton methods ... See more keywords
A positional misalignment correction method for Fourier ptychographic microscopy based on the quasi-Newton method with a global optimization module
Sign Up to like & getrecommendations! Published in 2019 at "Optics Communications"
DOI: 10.1016/j.optcom.2019.07.046
Abstract: Abstract Fourier ptychographic microscopy (FPM) can achieve high resolution imaging with a wide field-of-view, in which, the position of the LED sources determines the quality of the reconstructed image. In this paper, a positional misalignment… read more here.
Keywords: microscopy; quasi newton; positional misalignment; misalignment correction ... See more keywords
Stochastic proximal quasi-Newton methods for non-convex composite optimization
Sign Up to like & getrecommendations! Published in 2019 at "Optimization Methods and Software"
DOI: 10.1080/10556788.2018.1471141
Abstract: ABSTRACT In this paper, we propose a generic algorithmic framework for stochastic proximal quasi-Newton (SPQN) methods to solve non-convex composite optimization problems. Stochastic second-order information is explored to construct proximal subproblem. Under mild conditions we… read more here.
Keywords: stochastic proximal; proximal quasi; quasi newton; optimization ... See more keywords
A quasi-Newton proximal bundle method using gradient sampling technique for minimizing nonsmooth convex functions
Sign Up to like & getrecommendations! Published in 2022 at "Optimization Methods and Software"
DOI: 10.1080/10556788.2021.2023522
Abstract: This study aims to merge the well-established ideas of bundle and Gradient Sampling (GS) methods to develop an algorithm for locating a minimizer of a nonsmooth convex function. In the proposed method, with the help… read more here.
Keywords: nonsmooth convex; bundle methods; quasi newton; method ... See more keywords
A quasi-Newton method in shape optimization for a transmission problem
Sign Up to like & getrecommendations! Published in 2022 at "Optimization Methods and Software"
DOI: 10.1080/10556788.2022.2078823
Abstract: We consider optimal design problems in stationary diffusion for mixtures of two isotropic phases. The goal is to find an optimal distribution of the phases such that the energy functional is maximized. By following the… read more here.
Keywords: method shape; quasi newton; shape optimization; method ... See more keywords
On the implementation of a quasi-Newton interior-point method for PDE-constrained optimization using finite element discretizations
Sign Up to like & getrecommendations! Published in 2022 at "Optimization Methods and Software"
DOI: 10.1080/10556788.2022.2117354
Abstract: ABSTRACT We present a quasi-Newton interior-point method appropriate for optimization problems with pointwise inequality constraints in Hilbert function spaces. Among others, our methodology applies to optimization problems constrained by partial differential equations (PDEs) that are… read more here.
Keywords: point method; quasi newton; newton interior; interior point ... See more keywords
Decentralized Quasi-Newton Methods
Sign Up to like & getrecommendations! Published in 2017 at "IEEE Transactions on Signal Processing"
DOI: 10.1109/tsp.2017.2666776
Abstract: We introduce the decentralized Broyden–Fletcher–Goldfarb–Shanno (D-BFGS) method as a variation of the BFGS quasi-Newton method for solving decentralized optimization problems. Decentralized quasi-Newton methods are of interest in problems that are not well conditioned, making first-order… read more here.
Keywords: order; bfgs; quasi newton; newton methods ... See more keywords
Variance-Reduced Stochastic Quasi-Newton Methods for Decentralized Learning
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Transactions on Signal Processing"
DOI: 10.1109/tsp.2023.3240652
Abstract: In this work, we investigate stochastic quasi-Newton methods for minimizing a finite sum of cost functions over a decentralized network. We first develop a general algorithmic framework, in which each node constructs a local, inexact… read more here.
Keywords: quasi newton; stochastic quasi; variance reduced; newton methods ... See more keywords
The simulation of flight trajectory based on quasi-Newton and mesh simplification
Sign Up to like & getrecommendations! Published in 2019 at "Modern Physics Letters B"
DOI: 10.1142/s0217984919503111
Abstract: To address the problem of low accuracy of aircraft flight trajectory, a new prediction method for flight trajectory is proposed based on the quasi-Newton and mesh simplification algorithm. This method firstly proposes the calculation method… read more here.
Keywords: flight trajectory; quasi newton; flight; mesh simplification ... See more keywords