Knowee
Questions
Features
Study Tools

Let N be a random variable taking values 1, 2, . . . with known probabilities p1, p2, . . ., where Σpi = 1.Having observed N = n, perform n Bernoulli trials with success probability θ, getting X successes.(a) Prove that the pair (X, N ) is minimal sufficient and N is ancillary for θ.(b) Prove that the estimator X/N is unbiased for θ and has variance θ(1 − θ)E(1/N )

Question

Let N be a random variable taking values 1, 2, . . . with known probabilities p1, p2, . . ., where Σpi = 1.Having observed N = n, perform n Bernoulli trials with success probability θ, getting X successes.(a) Prove that the pair (X, N ) is minimal sufficient and N is ancillary for θ.(b) Prove that the estimator X/N is unbiased for θ and has variance θ(1 − θ)E(1/N )

🧐 Not the exact question you are looking for?Go ask a question

Solution 1

(a) To prove that the pair (X, N) is minimal sufficient and N is ancillary for θ, we need to use the Factorization Theorem and Basu's Theorem.

The Factorization Theorem states that a statistic T(X) is sufficient for θ if the joint pdf/pmf of X can be factorized into two functions g(T, θ) and h(X), where g does not contain X and h does not contain θ.

In this case, the joint pmf of X and N can be written as:

P(X=x, N=n) = P(N=n)P(X=x|N=n) = p_n * (n choose x) * θ^x * (1-θ)^(n-x)

This can be factorized into:

g(X, N, θ) = (n choose x) * θ^x * (1-θ)^(n-x) h(X, N) = p_n

Here, g contains θ and h does not, so by the Factorization Theorem, (X, N) is sufficient for θ.

Basu's Theorem states that if T is a complete sufficient statistic and U is a statistic that is independent of T, then U is ancillary.

In this case, N is independent of θ, so by Basu's Theorem, N is ancillary for θ.

(b) To prove that the estimator X/N is unbiased for θ and has variance θ(1 − θ)E(1/N), we need to calculate the expected value and variance of X/N.

The expected value of X/N is:

E(X/N) = E(E(X/N|N)) = E(θ) = θ

So X/N is an unbiased estimator of θ.

The variance of X/N is:

Var(X/N) = E(Var(X/N|N)) + Var(E(X/N|N)) = E(Nθ(1-θ)/N^2) + Var(θ) = θ(1-θ)E(1/N)

So the variance of X/N is θ(1 − θ)E(1/N).

This problem has been solved

Solution 2

(a) To prove that the pair (X, N) is minimal sufficient and N is ancillary for θ, we need to show that the joint distribution of (X, N) does not depend on θ and that the conditional distribution of X given N = n does not depend on the probabilities p1, p2, ...

The joint distribution of (X, N) is given by the product of the probability mass function of N and the binomial distribution of X given N = n. The probability mass function of N does not depend on θ, and the binomial distribution of X given N = n depends on θ but not on the probabilities p1, p2, ..., so the joint distribution of (X, N) does not depend on θ.

The conditional distribution of X given N = n is a binomial distribution with parameters n and θ, which does not depend on the probabilities p1, p2, ..., so N is ancillary for θ.

(b) To prove that the estimator X/N is unbiased for θ and has variance θ(1 − θ)E(1/N), we need to show that the expected value of X/N is θ and that the variance of X/N is θ(1 − θ)E(1/N).

The expected value of X/N is E[X/N] = E[E[X/N|N]] = E[θ] = θ, so X/N is an unbiased estimator for θ.

The variance of X/N is Var[X/N] = E[Var[X/N|N]] + Var[E[X/N|N]] = E[θ(1 − θ)/N] + Var[θ] = θ(1 − θ)E[1/N] + 0 = θ(1 − θ)E[1/N], so the variance of X/N is θ(1 − θ)E(1/N).

This problem has been solved

Similar Questions

Suppose that there are n trials x1, x2,...,xn from a Bernoulli process with parameter p, the probability of a success. That is, the probability of r successes is given by n r  pr(1 − p) n−r. Work out the maximum likelihood estimator for the parameter p.

Let X denote the number of failures before the first success in a Bernoulli scheme with probabilityof success equal to θ, i.e. Pθ (X = k) = θ(1 − θ)k, for k = 0, 1, .... Find the method of momentsestimator for θ, based on the mean. What will be the precise value of the estimator, if in a sample ofn observations, the average number of failures is equal to 4? Find the method of moments estimatorfor θ, based on the variance. What will be the precise value of the estimator, if in a sample of nobservations, the variance of the number of failures is equal to 20?

Let X = {X1, X2, . . . , Xn} be a random sample of size n from the geometricdistribution with probability mass function:pX (x; π) ={(1 − π)x−1π for x = 1, 2, . . .0 otherwisewhere π is the probability of success. Show that n∑i=1Xi is a sufficient statisti

Suppose X is a 0/1 random variable (i.e. a Bernoulli random variable) such that  P ( X = 1 ) = p,   and   P ( X = 0 ) = 1 − p . (a) Derive E( X ).(b) Derive var( X ).Now suppose X = ( X1 + X2 ) / 2, where X1 and X2 are independent and  P ( Xi = 1 ) = p,   and   P ( Xi = 0 ) = 1 − p  where i can be 1 or 2. (a) Derive E( X ).(b) Derive var( X ).

hen n independent Bernoulli trials are carried out with 𝑝 = 14, the number of successes,Y, can be modelled by another distribution.i) State the distribution of Y. (1mark)ii) Given that the variance of Y is 4, determine 𝐸(𝑌)

1/1

Upgrade your grade with Knowee

Get personalized homework help. Review tough concepts in more detail, or go deeper into your topic by exploring other relevant questions.