scholarly journals Tikhonov regularization with ℓ0-term complementing a~convex penalty: ℓ1-convergence under sparsity constraints

2019 ◽  
Vol 27 (4) ◽  
pp. 575-590 ◽  
Author(s):  
Wei Wang ◽  
Shuai Lu ◽  
Bernd Hofmann ◽  
Jin Cheng

Abstract Measuring the error by an {\ell^{1}} -norm, we analyze under sparsity assumptions an {\ell^{0}} -regularization approach, where the penalty in the Tikhonov functional is complemented by a general stabilizing convex functional. In this context, ill-posed operator equations {Ax=y} with an injective and bounded linear operator A mapping between {\ell^{2}} and a Banach space Y are regularized. For sparse solutions, error estimates as well as linear and sublinear convergence rates are derived based on a variational inequality approach, where the regularization parameter can be chosen either a priori in an appropriate way or a posteriori by the sequential discrepancy principle. To further illustrate the balance between the {\ell^{0}} -term and the complementing convex penalty, the important special case of the {\ell^{2}} -norm square penalty is investigated showing explicit dependence between both terms. Finally, some numerical experiments verify and illustrate the sparsity promoting properties of corresponding regularized solutions.

Mathematics ◽  
2020 ◽  
Vol 8 (3) ◽  
pp. 331
Author(s):  
Bernd Hofmann ◽  
Christopher Hofmann

This paper deals with the Tikhonov regularization for nonlinear ill-posed operator equations in Hilbert scales with oversmoothing penalties. One focus is on the application of the discrepancy principle for choosing the regularization parameter and its consequences. Numerical case studies are performed in order to complement analytical results concerning the oversmoothing situation. For example, case studies are presented for exact solutions of Hölder type smoothness with a low Hölder exponent. Moreover, the regularization parameter choice using the discrepancy principle, for which rate results are proven in the oversmoothing case in in reference (Hofmann, B.; Mathé, P. Inverse Probl. 2018, 34, 015007) is compared to Hölder type a priori choices. On the other hand, well-known analytical results on the existence and convergence of regularized solutions are summarized and partially augmented. In particular, a sketch for a novel proof to derive Hölder convergence rates in the case of oversmoothing penalties is given, extending ideas from in reference (Hofmann, B.; Plato, R. ETNA. 2020, 93).


2020 ◽  
Vol 28 (5) ◽  
pp. 659-676
Author(s):  
Dinh Nho Hào ◽  
Nguyen Van Duc ◽  
Nguyen Van Thang ◽  
Nguyen Trung Thành

AbstractThe problem of determining the initial condition from noisy final observations in time-fractional parabolic equations is considered. This problem is well known to be ill-posed, and it is regularized by backward Sobolev-type equations. Error estimates of Hölder type are obtained with a priori and a posteriori regularization parameter choice rules. The proposed regularization method results in a stable noniterative numerical scheme. The theoretical error estimates are confirmed by numerical tests for one- and two-dimensional equations.


2017 ◽  
Vol 25 (5) ◽  
pp. 543-551 ◽  
Author(s):  
Santhosh George ◽  
M. Thamban Nair

AbstractRecently, Semenova [12] considered a derivative free iterative method for nonlinear ill-posed operator equations with a monotone operator. In this paper, a modified form of Semenova’s method is considered providing simple convergence analysis under more realistic nonlinearity assumptions. The paper also provides a stopping rule for the iteration based on an a priori choice of the regularization parameter and also under the adaptive procedure considered by Pereverzev and Schock [11].


2003 ◽  
Vol 2003 (39) ◽  
pp. 2487-2499 ◽  
Author(s):  
Santhosh George ◽  
M. Thamban Nair

Recently, Tautenhahn and Hämarik (1999) have considered a monotone rule as a parameter choice strategy for choosing the regularization parameter while considering approximate solution of an ill-posed operator equationTx=y, whereTis a bounded linear operator between Hilbert spaces. Motivated by this, we propose a new discrepancy principle for the simplified regularization, in the setting of Hilbert scales, whenTis a positive and selfadjoint operator. When the datayis known only approximately, our method provides optimal order under certain natural assumptions on the ill-posedness of the equation and smoothness of the solution. The result, in fact, improves an earlier work of the authors (1997).


2011 ◽  
Vol 11 (1) ◽  
pp. 75-82 ◽  
Author(s):  
Kosnazar Sharipov

AbstractWe consider the classical ill-posed problem of the recovery of continuous functions from noisy Fourier coefficients. For the classes of functions given in terms of generalized smoothness, we present a priori and a posteriori regularization parameter choice realizing an order-optimal error bound.


2018 ◽  
Vol 26 (5) ◽  
pp. 639-646 ◽  
Author(s):  
Jens Flemming

Abstract We consider Tikhonov-type variational regularization of ill-posed linear operator equations in Banach spaces with general convex penalty functionals. Upper bounds for certain error measures expressing the distance between exact and regularized solutions, especially for Bregman distances, can be obtained from variational source conditions. We prove that such bounds are optimal in case of twisted Bregman distances, a specific a priori parameter choice, and low regularity of the exact solution, that is, the rate function is also an asymptotic lower bound for the error measure. This result extends existing converse results from Hilbert space settings to Banach spaces without adhering to spectral theory.


2012 ◽  
Vol 2012 ◽  
pp. 1-22 ◽  
Author(s):  
Santhosh George ◽  
Monnanda Erappa Shobha

Finite-dimensional realization of a Two-Step Newton-Tikhonov method is considered for obtaining a stable approximate solution to nonlinear ill-posed Hammerstein-type operator equations KF(x)=f. Here F:D(F)⊆X→X is nonlinear monotone operator, K:X→Y is a bounded linear operator, X is a real Hilbert space, and Y is a Hilbert space. The error analysis for this method is done under two general source conditions, the first one involves the operator K and the second one involves the Fréchet derivative of F at an initial approximation x0 of the the solution x̂: balancing principle of Pereverzev and Schock (2005) is employed in choosing the regularization parameter and order optimal error bounds are established. Numerical illustration is given to confirm the reliability of our approach.


Author(s):  
O. V. Matysik ◽  
V. F. Savchuk

In the introduction, the object of investigation is indicated – incorrect problems described by first-kind operator equations. The subject of the study is an explicit iterative method for solving first-kind equations. The aim of the paper is to prove the convergence of the proposed method of simple iterations with an alternating step alternately and to obtain error estimates in the original norm of a Hilbert space for the cases of self-conjugated and non self-conjugated problems. The a priori choice of the regularization parameter is studied for a source-like representable solution under the assumption that the operator and the right-hand side of the equation are given approximately. In the main part of the work, the achievement of the stated goal is expressed in four reduced and proved theorems. In Section 1, the first-kind equation is written down and a new explicit method of simple iteration with alternating steps is proposed to solve it. In Section 2, we consider the case of the selfconjugated problem and prove Theorem 1 on the convergence of the method and Theorem 2, in which an error estimate is obtained. To obtain an error estimate, an additional condition is required – the requirement of the source representability of the exact solution. In Section 3, the non-self-conjugated problem is solved, the convergence of the proposed method is proved, which in this case is written differently, and its error estimate is obtained in the case of an a priori choice of the regularization parameter. In sections 2 and 3, the error estimates obtained are optimized, that is, a value is found – the step number of the iteration, in which the error estimate is minimal. Since incorrect problems constantly arise in numerous applications of mathematics, the problem of studying them and constructing methods for their solution is topical. The obtained results can be used in theoretical studies of solution of first-kind operator equations, as well as applied ill-posed problems encountered in dynamics and kinetics, mathematical economics, geophysics, spectroscopy, systems for complete automatic processing and interpretation of experiments, plasma diagnostics, seismic and medicine.


Author(s):  
Viraj Shah ◽  
Chinmay Hegde

AbstractWe consider the problem of reconstructing a signal from under-determined modulo observations (or measurements). This observation model is inspired by a relatively new imaging mechanism called modulo imaging, which can be used to extend the dynamic range of imaging systems; variations of this model have also been studied under the category of phase unwrapping. Signal reconstruction in the under-determined regime with modulo observations is a challenging ill-posed problem, and existing reconstruction methods cannot be used directly. In this paper, we propose a novel approach to solving the signal recovery problem under sparsity constraints for the special case to modulo folding limited to two periods. We show that given a sufficient number of measurements, our algorithm perfectly recovers the underlying signal. We also provide experiments validating our approach on toy signal and image data and demonstrate its promising performance.


Mathematics ◽  
2019 ◽  
Vol 7 (9) ◽  
pp. 865 ◽  
Author(s):  
Fan Yang ◽  
Ping Fan ◽  
Xiao-Xiao Li ◽  
Xin-Yi Ma

In present paper, we deal with a backward diffusion problem for a time-fractional diffusion problem with a nonlinear source in a strip domain. We all know this nonlinear problem is severely ill-posed, i.e., the solution does not depend continuously on the measurable data. Therefore, we use the Fourier truncation regularization method to solve this problem. Under an a priori hypothesis and an a priori regularization parameter selection rule, we obtain the convergence error estimates between the regular solution and the exact solution at 0 ≤ x < 1 .


Sign in / Sign up

Export Citation Format

Share Document