5102-Lecture-06

5102-Lecture-06 - , let ( y ) = arg max lik( | y ) . Model...

Info iconThis preview shows pages 1–7. Sign up to view the full content.

View Full Document Right Arrow Icon
Lecture 6 Stat 5102-004 31 January 2011
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Bayes Estimators Find a Bayes estimator by minimizing the posterior expected loss. ˆ θ ( y ) = arg min a E[ L ( a , Θ) | y ] Under squared error loss, the posterior mean is the Bayes estimator, L ( a ) = ( a - θ ) 2 E[Θ | y ] = arg min a E[ L ( a , Θ) | y ] ˆ θ ( y ) = E[Θ | y ] and the posterior variance is the minimum posterior expected loss. Var[Θ | y ] = E ±( ˆ θ ( y ) - Θ ) 2 ² ² y ³ STAT 5102 (Theory of Statistics) Lecture 6 1 / 6
Background image of page 2
Large Sample Behavior (Binomial example) Θ | y Beta( α + y + n - y ) μ 0 = α α + β The Bayes estimator under squared error loss is ˆ θ = α + β α + β + n μ 0 | {z } a n + n α + β + n | {z } b n Y n . As n → ∞ , a n 0 and b n 1 1 n Y P --→ θ n ( 1 n Y - θ ) D --→ N ( 0 (1 - θ ) ) STAT 5102 (Theory of Statistics) Lecture 6 2 / 6
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Average Behavior (Binomial example) The Bayes estimator under squared error loss is ˆ θ = α + β α + β + n μ 0 | {z } a n + n α + β + n | {z } b n Y n . For each n , E ˆ θ = a n + b n θ and Var ˆ θ = b 2 n n θ (1 - θ ) MSE( θ ) = Bias 2 ˆ θ + Var ˆ θ = [ a n + ( b n - 1) θ ] 2 + b 2 n n θ (1 - θ ) STAT 5102 (Theory of Statistics) Lecture 6 3 / 6
Background image of page 4
Maximum Likelihood Estimators Maximum likelihood estimators are defined by maximizing the likelihood. For each y ∈ Y
Background image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Background image of page 6
Background image of page 7
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: , let ( y ) = arg max lik( | y ) . Model y = ( y 1 ,..., y n ) as a random sample from a uniform on [0 , ] . lik ( |y 29 lik( | y ) = -n I [max y , ) ( ) : Y y 7 max y STAT 5102 (Theory of Statistics) Lecture 6 4 / 6 Maximum Likelihood Estimators Recall that likelihoods are amenable to analysis in the log scale. Since the logarithm is an increasing function, arg max ( | y ) = arg max lik( | y ) . The same arguments maximize both the likelihood and log likelihood. The log likelihood is analytically convenientespecially for I random samples and I exponential families. STAT 5102 (Theory of Statistics) Lecture 6 5 / 6 Normal Example = E Y lik ( |y 29 y loglik y STAT 5102 (Theory of Statistics) Lecture 6 6 / 6...
View Full Document

This note was uploaded on 02/24/2011 for the course STAT 5102 taught by Professor Staff during the Spring '03 term at Minnesota.

Page1 / 7

5102-Lecture-06 - , let ( y ) = arg max lik( | y ) . Model...

This preview shows document pages 1 - 7. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online