/*! This file is auto-generated */ .wp-block-button__link{color:#fff;background-color:#32373c;border-radius:9999px;box-shadow:none;text-decoration:none;padding:calc(.667em + 2px) calc(1.333em + 2px);font-size:1.125em}.wp-block-file__button{background:#32373c;color:#fff;text-decoration:none} Q27E \({{\rm{X}}_{\rm{1}}}{\rm{,}}...... [FREE SOLUTION] | 魅影直播

魅影直播

\({{\rm{X}}_{\rm{1}}}{\rm{,}}.....{\rm{,}}{{\rm{X}}_{\rm{n}}}\)be a random sample from a gamma distribution with parameters \({\rm{\alpha }}\) and \({\rm{\beta }}\). a. Derive the equations whose solutions yield the maximum likelihood estimators of \({\rm{\alpha }}\) and \({\rm{\beta }}\). Do you think they can be solved explicitly? b. Show that the mle of \({\rm{\mu = \alpha \beta }}\) is \(\widehat {\rm{\mu }}{\rm{ = }}\overline {\rm{X}} \).

Short Answer

Expert verified

(a) Equations are,

\(\begin{array}{c}\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{\rm{ln}}} {{\rm{x}}_{\rm{i}}}{\rm{ - nln\hat \beta - n}}\frac{{\rm{1}}}{{{\rm{\Gamma (\hat \alpha )}}}}{\rm{ \times }}\frac{{\rm{d}}}{{{\rm{d\hat \alpha }}}}{\rm{\Gamma (\hat \alpha ) = 0}}\\{\rm{n\hat \alpha }}\frac{{\rm{1}}}{{{\rm{\hat \beta }}}}{\rm{ + }}\frac{{\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{{\rm{x}}_{\rm{i}}}} }}{{{{{\rm{\hat \beta }}}^{\rm{2}}}}}{\rm{ = 0}}\end{array}\)

(b) Shown, \(\overline {\rm{X}} {\rm{ = }}\widehat {\rm{\mu }}\).

Step by step solution

01

Define equations

A mathematical language that asserts that two algebraic expressions must be equal in nature is known as an equation.

02

Explanation

(a) The probability density function (pdf) of random variable \({\rm{X}}\) with gamma distribution is,

\({\rm{f(x;\alpha ,\beta ) = }}\frac{{\rm{1}}}{{{{\rm{\beta }}^{\rm{\alpha }}}{\rm{\Gamma (\alpha )}}}}{{\rm{x}}^{{\rm{\alpha - 1}}}}{{\rm{e}}^{{\rm{ - x/\beta }}}}{\rm{,x}} \ge {\rm{0}}\)

Where the parameters\({\rm{\alpha }}\)and\({\rm{\beta }}\)fulfil\({\rm{\alpha > 0}}\)and\({\rm{\beta > 0}}\), and is zero for\({\rm{x < 0}}\).

Allow joint pdf or pmb for random variables\({{\rm{X}}_{\rm{1}}}{\rm{,}}{{\rm{X}}_{\rm{2}}}{\rm{, \ldots ,}}{{\rm{X}}_{\rm{n}}}\).

\({\rm{f}}\left( {{{\rm{x}}_{\rm{1}}}{\rm{,}}{{\rm{x}}_{\rm{2}}}{\rm{, \ldots ,}}{{\rm{x}}_{\rm{n}}}{\rm{;}}{{\rm{\theta }}_{\rm{1}}}{\rm{,}}{{\rm{\theta }}_{\rm{2}}}{\rm{, \ldots ,}}{{\rm{\theta }}_{\rm{m}}}} \right){\rm{, n,m}} \in {\rm{N}}\)

where\({{\rm{\theta }}_{\rm{i}}}{\rm{,i = 1,2, \ldots ,m}}\)are unknown parameters. The likelihood function is defined as a function of parameters\({{\rm{\theta }}_{\rm{i}}}{\rm{,i = 1,2, \ldots ,m}}\)where function f is a function of parameter. The maximum likelihood estimates (mle's), or values\(\widehat {{{\rm{\theta }}_{\rm{i}}}}\)for which the likelihood function is maximised, are the maximum likelihood estimates,

\({\rm{f}}\left( {{{\rm{x}}_{\rm{1}}}{\rm{,}}{{\rm{x}}_{\rm{2}}}{\rm{, \ldots ,}}{{\rm{x}}_{\rm{n}}}{\rm{;}}{{{\rm{\hat \theta }}}_{\rm{1}}}{\rm{,}}{{{\rm{\hat \theta }}}_{\rm{2}}}{\rm{, \ldots ,}}{{{\rm{\hat \theta }}}_{\rm{m}}}} \right) \ge {\rm{f}}\left( {{{\rm{x}}_{\rm{1}}}{\rm{,}}{{\rm{x}}_{\rm{2}}}{\rm{, \ldots ,}}{{\rm{x}}_{\rm{n}}}{\rm{;}}{{\rm{\theta }}_{\rm{1}}}{\rm{,}}{{\rm{\theta }}_{\rm{2}}}{\rm{, \ldots ,}}{{\rm{\theta }}_{\rm{m}}}} \right)\)

As,\({\rm{i = 1,2, \ldots ,m}}\)for every\({{\rm{\theta }}_{\rm{i}}}\). Maximum likelihood estimators are derived by replacing\({{\rm{X}}_{\rm{i}}}\)with\({{\rm{x}}_{\rm{i}}}\).

Because of the independence, the likelihood function becomes,

\(\begin{array}{c}{\rm{f}}\left( {{{\rm{x}}_{\rm{1}}}{\rm{,}}{{\rm{x}}_{\rm{x}}}{\rm{, \ldots ,}}{{\rm{x}}_{\rm{n}}}{\rm{;\alpha ,\beta }}} \right){\rm{ = }}\frac{{\rm{1}}}{{{{\rm{\beta }}^{\rm{\alpha }}}{\rm{\Gamma (\alpha )}}}}{\rm{x}}_{\rm{1}}^{{\rm{\alpha - 1}}}{{\rm{e}}^{{\rm{ - }}{{\rm{x}}_{\rm{1}}}{\rm{/\beta }}}}{\rm{ \times }}\frac{{\rm{1}}}{{{{\rm{\beta }}^{\rm{\alpha }}}{\rm{\Gamma (\alpha )}}}}{\rm{x}}_{\rm{2}}^{{\rm{\alpha - 1}}}{{\rm{e}}^{{\rm{ - }}{{\rm{x}}_{\rm{2}}}{\rm{/\beta }}}}{\rm{ \times \ldots \times }}\frac{{\rm{1}}}{{{{\rm{\beta }}^{\rm{\alpha }}}{\rm{\Gamma (\alpha )}}}}{\rm{x}}_{\rm{n}}^{{\rm{\alpha - 1}}}{{\rm{e}}^{{\rm{ - }}{{\rm{x}}_{\rm{n}}}{\rm{/\beta }}}}\\{\rm{ = }}{\left( {{{\rm{x}}_{\rm{1}}}{{\rm{x}}_{\rm{2}}}{\rm{ \times \ldots \times }}{{\rm{x}}_{\rm{n}}}} \right)^{{\rm{\alpha - 1}}}}{\rm{ \times }}\frac{{\rm{1}}}{{{{\rm{\beta }}^{{\rm{n\alpha }}}}{{\rm{\Gamma }}^{\rm{n}}}{\rm{(\alpha )}}}}{\rm{ \times exp}}\left\{ {{\rm{ - }}\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{{\rm{x}}_{\rm{i}}}} {\rm{/\beta }}} \right\}\end{array}\)

03

Evaluating the maximum likelihood estimators

Look at the log likelihood function to determine the maximum.

\(\begin{array}{c}{\rm{ln f}}\left( {{{\rm{x}}_{\rm{1}}}{\rm{,}}{{\rm{x}}_{\rm{x}}}{\rm{, \ldots ,}}{{\rm{x}}_{\rm{n}}}{\rm{;\alpha ,\beta }}} \right){\rm{ = ln}}\left( {{{\left( {{{\rm{x}}_{\rm{1}}}{{\rm{x}}_{\rm{2}}}{\rm{ \times \ldots \times }}{{\rm{x}}_{\rm{n}}}} \right)}^{{\rm{\alpha - 1}}}}{\rm{ \times }}\frac{{\rm{1}}}{{{{\rm{\beta }}^{{\rm{n\alpha }}}}{{\rm{\Gamma }}^{\rm{n}}}{\rm{(\alpha )}}}}{\rm{ \times exp}}\left\{ {{\rm{ - }}\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{{\rm{x}}_{\rm{i}}}} {\rm{/\beta }}} \right\}} \right)\\{\rm{ = (\alpha - 1)}}\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{\rm{ln}}} {{\rm{x}}_{\rm{i}}}{\rm{ - n\alpha ln\beta - nln\Gamma (\alpha ) - }}\frac{{\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{{\rm{x}}_{\rm{i}}}} }}{{\rm{\beta }}}\end{array}\)

The maximum likelihood estimator is generated by taking the derivative of the log likelihood function in regard to\({\rm{\alpha }}\)and\({\rm{\beta }}\)equating it to\({\rm{0}}\).

As a result, the derivative,

\(\begin{array}{c}\frac{{\rm{d}}}{{{\rm{d\alpha }}}}{\rm{f}}\left( {{{\rm{x}}_{\rm{1}}}{\rm{,}}{{\rm{x}}_{\rm{x}}}{\rm{, \ldots ,}}{{\rm{x}}_{\rm{n}}}{\rm{;\alpha ,\beta }}} \right){\rm{ = }}\frac{{\rm{d}}}{{{\rm{d\alpha }}}}\left( {{\rm{(\alpha - 1)}}\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{\rm{ln}}} {{\rm{x}}_{\rm{i}}}{\rm{ - n\alpha ln\beta - nln\Gamma (\alpha ) - }}\frac{{\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{{\rm{x}}_{\rm{i}}}} }}{{\rm{\beta }}}} \right)\\{\rm{ = }}\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{\rm{ln}}} {{\rm{x}}_{\rm{i}}}{\rm{ - nln\beta - n}}\frac{{\rm{1}}}{{{\rm{\Gamma (\alpha )}}}}{\rm{ \times }}\frac{{\rm{d}}}{{{\rm{d\alpha }}}}{\rm{\Gamma (\alpha )}}\end{array}\)

In the case of\({\rm{\beta }}\), the derivative is,

\(\begin{array}{c}\frac{{\rm{d}}}{{{\rm{d\beta }}}}{\rm{f}}\left( {{{\rm{x}}_{\rm{1}}}{\rm{,}}{{\rm{x}}_{\rm{x}}}{\rm{, \ldots ,}}{{\rm{x}}_{\rm{n}}}{\rm{;\alpha ,\beta }}} \right){\rm{ = }}\frac{{\rm{d}}}{{{\rm{d\beta }}}}\left( {{\rm{(\alpha - 1)}}\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{\rm{ln}}} {{\rm{x}}_{\rm{i}}}{\rm{ - n\alpha ln\beta - nln\Gamma (\alpha ) - }}\frac{{\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{{\rm{x}}_{\rm{i}}}} }}{{\rm{\beta }}}} \right)\\{\rm{ = - n\alpha }}\frac{{\rm{1}}}{{\rm{\beta }}}{\rm{ + }}\frac{{\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{{\rm{x}}_{\rm{i}}}} }}{{{{\rm{\beta }}^{\rm{2}}}}}\end{array}\)

As a result, solving equation provides the maximum likelihood estimator.

\(\begin{array}{c}\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{\rm{ln}}} {{\rm{x}}_{\rm{i}}}{\rm{ - nln\hat \beta - n}}\frac{{\rm{1}}}{{{\rm{\Gamma (\hat \alpha )}}}}{\rm{ \times }}\frac{{\rm{d}}}{{{\rm{d\hat \alpha }}}}{\rm{\Gamma (\hat \alpha ) = 0}}\\{\rm{n\hat \alpha }}\frac{{\rm{1}}}{{{\rm{\hat \beta }}}}{\rm{ + }}\frac{{\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{{\rm{x}}_{\rm{i}}}} }}{{{{{\rm{\hat \beta }}}^{\rm{2}}}}}{\rm{ = 0}}\end{array}\)

For\({\rm{\hat \alpha }}\)and\({\rm{\hat \beta }}\).

The solution cannot be deduced explicitly since it is extremely complex and requires a great deal of background knowledge.

04

Explanation

(b) The following is true based on the second equation in (a).

\({\rm{ - n\hat \alpha }}\frac{{\rm{1}}}{{{\rm{\hat \beta }}}}{\rm{ + }}\frac{{\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{{\rm{x}}_{\rm{i}}}} }}{{{{{\rm{\hat \beta }}}^{\rm{2}}}}}{\rm{ = 0}}\)

or, alternatively,

\(\frac{{\rm{1}}}{{\rm{n}}}\sum\limits_{{\rm{i = 1}}}^{\rm{n}} {{{\rm{x}}_{\rm{i}}}} {\rm{ = \hat \alpha \times \hat \beta }}\)

The expected value of random variable X with gamma distribution, according to the proposition.

\({\rm{E(X) = \alpha \beta }}\)

As a result, the maximum likelihood estimator is,

\({\rm{\bar X = \hat mu}}\)

As, \({\rm{\mu = \alpha \beta }}\).

Unlock Step-by-Step Solutions & Ace Your Exams!

  • Full Textbook Solutions

    Get detailed explanations and key concepts

  • Unlimited Al creation

    Al flashcards, explanations, exams and more...

  • Ads-free access

    To over 500 millions flashcards

  • Money-back guarantee

    We refund you if you fail your exam.

Over 30 million students worldwide already upgrade their learning with 魅影直播!

One App. One Place for Learning.

All the tools & learning materials you need for study success - in one app.

Get started for free

Most popular questions from this chapter

The article from which the data in Exercise 1 was extracted also gave the accompanying strength observations for cylinders:

\(\begin{array}{l}\begin{array}{*{20}{r}}{{\rm{6}}{\rm{.1}}}&{{\rm{5}}{\rm{.8}}}&{{\rm{7}}{\rm{.8}}}&{{\rm{7}}{\rm{.1}}}&{{\rm{7}}{\rm{.2}}}&{{\rm{9}}{\rm{.2}}}&{{\rm{6}}{\rm{.6}}}&{{\rm{8}}{\rm{.3}}}&{{\rm{7}}{\rm{.0}}}&{{\rm{8}}{\rm{.3}}}\\{{\rm{7}}{\rm{.8}}}&{{\rm{8}}{\rm{.1}}}&{{\rm{7}}{\rm{.4}}}&{{\rm{8}}{\rm{.5}}}&{{\rm{8}}{\rm{.9}}}&{{\rm{9}}{\rm{.8}}}&{{\rm{9}}{\rm{.7}}}&{{\rm{14}}{\rm{.1}}}&{{\rm{12}}{\rm{.6}}}&{{\rm{11}}{\rm{.2}}}\end{array}\\\begin{array}{*{20}{l}}{{\rm{7}}{\rm{.8}}}&{{\rm{8}}{\rm{.1}}}&{{\rm{7}}{\rm{.4}}}&{{\rm{8}}{\rm{.5}}}&{{\rm{8}}{\rm{.9}}}&{{\rm{9}}{\rm{.8}}}&{{\rm{9}}{\rm{.7}}}&{{\rm{14}}{\rm{.1}}}&{{\rm{12}}{\rm{.6}}}&{{\rm{11}}{\rm{.2}}}\end{array}\end{array}\)

Prior to obtaining data, denote the beam strengths by X1, 鈥 ,Xm and the cylinder strengths by Y1, . . . , Yn. Suppose that the Xi 鈥檚 constitute a random sample from a distribution with mean m1 and standard deviation s1 and that the Yi 鈥檚 form a random sample (independent of the Xi 鈥檚) from another distribution with mean m2 and standard deviation\({{\rm{\sigma }}_{\rm{2}}}\).

a. Use rules of expected value to show that \({\rm{\bar X - \bar Y}}\)is an unbiased estimator of \({{\rm{\mu }}_{\rm{1}}}{\rm{ - }}{{\rm{\mu }}_{\rm{2}}}\). Calculate the estimate for the given data.

b. Use rules of variance from Chapter 5 to obtain an expression for the variance and standard deviation (standard error) of the estimator in part (a), and then compute the estimated standard error.

c. Calculate a point estimate of the ratio \({{\rm{\sigma }}_{\rm{1}}}{\rm{/}}{{\rm{\sigma }}_{\rm{2}}}\)of the two standard deviations.

d. Suppose a single beam and a single cylinder are randomly selected. Calculate a point estimate of the variance of the difference \({\rm{X - Y}}\) between beam strength and cylinder strength.

Let\({\rm{X}}\)denote the proportion of allotted time that a randomly selected student spends working on a certain aptitude test. Suppose the pdf of\({\rm{X}}\)is

\({\rm{f(x;\theta ) = }}\left\{ {\begin{array}{*{20}{c}}{{\rm{(\theta + 1)}}{{\rm{x}}^{\rm{\theta }}}}&{{\rm{0拢 x拢 1}}}\\{\rm{0}}&{{\rm{ otherwise }}}\end{array}} \right.\)

where\({\rm{ - 1 < \theta }}\). A random sample of ten students yields data\({{\rm{x}}_{\rm{1}}}{\rm{ = }}{\rm{.92,}}{{\rm{x}}_{\rm{2}}}{\rm{ = }}{\rm{.79,}}{{\rm{x}}_{\rm{3}}}{\rm{ = }}{\rm{.90,}}{{\rm{x}}_{\rm{4}}}{\rm{ = }}{\rm{.65,}}{{\rm{x}}_{\rm{5}}}{\rm{ = }}{\rm{.86}}\),\({{\rm{x}}_{\rm{6}}}{\rm{ = }}{\rm{.47,}}{{\rm{x}}_{\rm{7}}}{\rm{ = }}{\rm{.73,}}{{\rm{x}}_{\rm{8}}}{\rm{ = }}{\rm{.97,}}{{\rm{x}}_{\rm{9}}}{\rm{ = }}{\rm{.94,}}{{\rm{x}}_{{\rm{10}}}}{\rm{ = }}{\rm{.77}}\).

a. Use the method of moments to obtain an estimator of\({\rm{\theta }}\), and then compute the estimate for this data.

b. Obtain the maximum likelihood estimator of\({\rm{\theta }}\), and then compute the estimate for the given data.

A diagnostic test for a certain disease is applied to\({\rm{n}}\)individuals known to not have the disease. Let\({\rm{X = }}\)the number among the\({\rm{n}}\)test results that are positive (indicating presence of the disease, so\({\rm{X}}\)is the number of false positives) and\({\rm{p = }}\)the probability that a disease-free individual's test result is positive (i.e.,\({\rm{p}}\)is the true proportion of test results from disease-free individuals that are positive). Assume that only\({\rm{X}}\)is available rather than the actual sequence of test results.

a. Derive the maximum likelihood estimator of\({\rm{p}}\). If\({\rm{n = 20}}\)and\({\rm{x = 3}}\), what is the estimate?

b. Is the estimator of part (a) unbiased?

c. If\({\rm{n = 20}}\)and\({\rm{x = 3}}\), what is the mle of the probability\({{\rm{(1 - p)}}^{\rm{5}}}\)that none of the next five tests done on disease-free individuals are positive?

At time \({\rm{t = 0, 20}}\) identical components are tested. The lifetime distribution of each is exponential with parameter \({\rm{\lambda }}\). The experimenter then leaves the test facility unmonitored. On his return \({\rm{24}}\) hours later, the experimenter immediately terminates the test after noticing that \({\rm{y = 15}}\) of the \({\rm{20}}\) components are still in operation (so \({\rm{5}}\) have failed). Derive the mle of \({\rm{\lambda }}\). (Hint: Let \({\rm{Y = }}\) the number that survive \({\rm{24}}\) hours. Then \({\rm{Y}} \sim {\rm{Bin(n,p)}}\). What is the mle of \({\rm{p}}\)? Now notice that \({\rm{p = P(}}{{\rm{X}}_{\rm{i}}} \ge {\rm{24)}}\), where \({{\rm{X}}_{\rm{i}}}\) is exponentially distributed. This relates \({\rm{\lambda }}\) to \({\rm{p}}\), so the former can be estimated once the latter has been.)

Consider randomly selecting \({\rm{n}}\) segments of pipe and determining the corrosion loss (mm) in the wall thickness for each one. Denote these corrosion losses by \({{\rm{Y}}_{\rm{1}}}{\rm{,}}.....{\rm{,}}{{\rm{Y}}_{\rm{n}}}\). The article 鈥淎 Probabilistic Model for a Gas Explosion Due to Leakages in the Grey Cast Iron Gas Mains鈥 (Reliability Engr. and System Safety (\({\rm{(2013:270 - 279)}}\)) proposes a linear corrosion model: \({{\rm{Y}}_{\rm{i}}}{\rm{ = }}{{\rm{t}}_{\rm{i}}}{\rm{R}}\), where \({{\rm{t}}_{\rm{i}}}\) is the age of the pipe and \({\rm{R}}\), the corrosion rate, is exponentially distributed with parameter \({\rm{\lambda }}\). Obtain the maximum likelihood estimator of the exponential parameter (the resulting mle appears in the cited article). (Hint: If \({\rm{c > 0}}\) and \({\rm{X}}\) has an exponential distribution, so does \({\rm{cX}}\).)

See all solutions

Recommended explanations on Math Textbooks

View all explanations

What do you think about this solution?

We value your feedback to improve our textbook solutions.

Study anywhere. Anytime. Across all devices.