Linear Tikhonov Inversion¶
from geoscilabs.inversion.LinearInversionDirect import LinearInversionDirectApp
from ipywidgets import interact, FloatSlider, ToggleButtons, IntSlider, FloatText, IntText
import matplotlib.pyplot as plt
import matplotlib
matplotlib.rcParams['font.size'] = 14
app = LinearInversionDirectApp()
Background¶
This app is based upon the inversion tutorial: “INVERSION FOR APPLIED GEOPHYSICS” by Oldenburg and Li (2005).
Douglas W. Oldenburg and Yaoguo Li (2005) 5. Inversion for Applied Geophysics: A Tutorial. Near-Surface Geophysics: pp. 89-150. eISBN: 978-1-56080-171-9 print ISBN: 978-1-56080-130-6 Oldenburg & Li (2005)
Purpose¶
We illustrate how a generic linear inverse problem can be solved using a Tikhonov approach. The default parameters provided for the Forward and Inverse problems below generate a reasonable example for illustrating the inversion but the learning comes when these parameters are changed and outcomes are observed.
Outline¶
The app is divided into two sections:
Forward Problem¶
Mathematical Background for the Forward Problem
Step 1: Create a model, .
Step 2: Generate a sensitivity matrix .
Step 3: Simulate data () and add noise.
These steps are explored individually but additional text is given in 2 Linear Tikhonov Inversion. For convenience, the widgets used to carry out all three steps are consolidated at the end of the section. A brief mathematical description is also provided.
Inverse Problem¶
Mathematical Background for the Inverse Problem
Step 4: Invert the data, and explore the results
Here we provide widgets to adjust the parameters for the inverse problem. Some basic information is provided but details about the parameters are provided in the text 2 Linear Tikhonov Inversion.
Mathematical Background for the Forward Problem¶
Let denote the kernel function for th datum. With a given model , the th datum can be computed by solving following integral equation:
Equation 1.7 Generic representation of a linear functional for forward mapping where is the datum, the associated kernel function, and the model.
where
Equation 2.1 Oscillatory kernel functions , each of which correspond to each datum , that decay with depth. The rate of decay is controlled by , and controls the frequency.
is the kernel function. By integrating over cells of width and using the midpoint rule cell we obtain the sensitivities
Equation 2.19 Oscillatory kernel functions, defined in Equation 2.1, written after integrating over cells of a width and using the midpoint rule for the discretized calculations in LinearTikhonovInversion
where
- : th row vector for the sensitivty matrix ()
- : model location ()
- : decaying constant (<0)
- : oscillating constant (>0)
By stacking multiple rows of , we obtain sensitivity matrix, :
Equation 2.20 The sensitivity matrix is created by stacking multiple rows of kernel functions (LinearTikhonovInversion
Here, the size of the matrix is . Finally data, , can be written as a linear equation:
Equation 2.3 Expression for the linear forward problem in Equation 2.2, expanded for the N-length data vector .
where is an inversion model; this is a column vector ().
In real measurments, there will be various noise sources, and hence observation, , can be written as
Equation 2.5 The observed data is a combination of the clean data and the noise .
Step 1: Create a model, ¶
The model is a function defined on the interval [0,1] and discretized into equal intervals. It is the sum of a: (a) background , (b) box car and (c) Gaussian .
m_background
: background value
The box car is defined by
m1
: amplitudem1_center
: centerm1_width
: width
The Gaussian is defined by
m2
: amplitudem2_center
: centerm2_sigma
: width of Gaussian (as defined by a standard deviation ε)M
: number of model parameters
Q_model = app.interact_plot_model()
Step2: Generate a sensitivity kernel (or matrix), ¶
By using the following app, we explore each row vector of the sensitivity matrix, . Parameters of the apps are:
M
: # of model parametersN
: # of datap
: decaying constant (<0)q
: oscillating constant (>0)ymin
: maximum limit for y-axisymax
: minimum limit for y-axisshow_singular
: show singualr values
Q_kernel = app.interact_plot_G()
Step 3: Simulate data, , and add noise¶
The -th datum is the inner product of the -th kernel and the model . In discrete form it can be written as the dot product of the vector and the model vector .
Equation 2.2 The linear forward problem in Equation 1.7 evaluated for a discretized model on a 1D mesh.
If there are data, these data can be written as a column vector, :
Equation 2.3 Expression for the linear forward problem in Equation 2.2, expanded for the N-length data vector .
Adding Noise¶
Observational data are always contaminated with noise. Here we add Gaussian noise (zero mean and standard deviation ε). Here we choose
Equation 2.6 Definition of the standard deviation as a percentage of the datum and a floor value.
Q_data = app.interact_plot_data()
Composite Widget for Forward Modelling¶
app.reset_to_defaults()
app.interact_plot_all_three_together()
Mathematical Background for the Inverse Problem¶
In the inverse problem we attempt to find the model that gave rise to the observational data . The inverse problem is formulated as an optimization problem to minimize:
Equation 2.17 Objective function for the inverse problem which combines the data misfit (Equation 2.7) and chosen definition of the model norm (e.g. Equation 2.12, Equation 2.13, Equation 2.14) with a trade-off parameter β to balance the relative influence of these terms.
where
- : data misfit
- : model regularization
- β: trade-off (Tikhonov) parameter
Data misfit is defined as
Equation 2.7 Data misfit function measures the difference between each predicted datum and observation , normalized by the estimated standard deviation .
where is an estimate of the standard deviation of the th datum, and .
The model regularization term, , can be written as
Equation 2.14 Combination of the smallest (Equation 2.12) and flattest model norms (Equation 2.13), where the quantities and are nonnegative constants used to adjust the relative importance of each term.
The first term is referred to as the “smallness” term. Minimizing this generates a model that is close to a reference model . The second term penalizes roughness of the model. It is generically referred to as a “flattest” or “smoothness” term.
Step 4: Invert the data, and explore the results¶
In the inverse problem we define parameters needed to evaluate the data misfit and the model regularization terms. We then deal with parameters associated with the inversion.
Parameters¶
mode
:Run
orExplore
Run
: Each click of the app, will runn_beta
inversionsExplore
: Not running inversions, but explore result of the previously run inversions
Misfit¶
percent
: estiamte uncertainty as a percentage of the data (%)floor
: estimate uncertainty floorchifact
: chi factor for stopping criteria (whenchifact=1
)
Model norm¶
mref
: reference modelalpha_s
: weight for smallness termalpha_x
: weight for smoothness term
Beta¶
beta_min
: minimum βbeta_max
: maximum βn_beta
: the number of β
Plotting options¶
data
:obs & pred
ornormalized misfit
obs & pred
: show observed and predicted datanormalized misfit
: show normalized misfit
tikhonov
:phi_d & phi_m
orphi_d vs phi_m
phi_d & phi_m
: show and as a function of βphi_d vs phi_m
: show tikhonov curve
i_beta
: i-th β valuescale
:linear
orlog
linear
: linear scale for plotting the third panellog
: log scale for plotting the third panel
app.interact_plot_inversion()
- Oldenburg, D. W., & Li, Y. (2005). 5. Inversion for Applied Geophysics: A Tutorial. In Near-Surface Geophysics (pp. 89–150). Society of Exploration Geophysicists. 10.1190/1.9781560801719.ch5