This preview shows pages 1–3. Sign up to view the full content.
This preview has intentionally blurred sections. Sign up to view the full version.View Full Document
Unformatted text preview: 3. Least-squares methods Special classes of optimization problems are least-square problems. In this type of problems we are most interested in problems that involve modeling some dataset for example as is done with the resistivity sounding case. Typically we would have a dataset, consisting of measurements y and possibly also independent (or control) variables x (such as our electrode spacing: a dataset ( x i , y i ) i =1 N and we have a physical model that relates these variable, for example in the form of a set of partial differential equations f ( x i , y i , ) = 0 where the physical model has physical parameters . In the more favorable case, this model can be written as y = y ( x i , ) In addition we have measurement errors on the measurements of y i (we assume that the errors on x are much less or negligible), hence we need a framework to account for these. That framework is formulated within probability theory, hence is may be useful to refresh our memory with some basic concepts. 3.1 Probability concepts: a review To describe errors we do not know exactly/deterministically how large they are we use the concept of random variable. For example in the case or measurements with errors, we could have statistical information about these errors in terms of bias of the measurement or variation/variance of the measurement. Essentially all these statistics would be available directly if we would be able to repeat an experiment many times, each time we record a different measurements, hence the total set of measurements determine the probability distribution of outcomes of these measurements. However, in many case we cannot afford the luxury of repeated measurements, so we have either to rely on experience of using the measurement device or provide an expert guess. The experimental error, being the difference between the true but unknown measurement and the actual measurement is therefore modeled as a random variable. Such random variable is fully described by a probability function. For errors we often use a Gaussian probability function ) ) ( 2 1 exp( 2 1 ) ( 2 2 -- = x x f X + - = = dx x xf X E X ) ( ] [ + -- = = dx x f x X Var X ) ( ) ( ] [ 2 2 Where X is the random variable describing the amount of error made. If =0 then we say the measurement is unbiased, i.e. we are not making any systematic errors. In other cases, when we have bounds on the error we often use a traingular distribution function. If we measure different variables, we will have a measurement error for each variable. This is the case for resistivity sounding, where we measure at different spacing, so each measurement can have a different kind of error. Moreover, it may not be appropriate to look at these errors as being independent one from each other, that is if you measure something too high for one variable, then it may be such that you will also measure too high for another variable (you may have been making the same mistake). Hence, we high for another variable (you may have been making the same mistake)....
View Full Document
This note was uploaded on 01/24/2011 for the course ERE 284 taught by Professor . during the Spring '10 term at Stanford.
- Spring '10