word looked up : home / archive

 Maximum likelihood 

In statistics, the method of maximum likelihood, pioneered by geneticist/statistician Sir Ronald A. Fisher, is a method of point estimation, that uses as an estimate of an unobservable population parameter the member of the parameter space that maximizes the likelihood function. For the moment let p denote the unobservable population parameter to be estimated. Let X denote the random variable observed (which in general will not be scalar-valued, but often will be a vector of probabilistically independent scalar-valued random variables. The probability of an observed outcome X=x (this is case-sensitive notation!), or the value at (lower-case) x of the probability density function of the random variable (Capital) X, as a function of p with x held fixed is the likelihood function
<math>L(p)=P(X=x\mid p).</math>
For example, in a large population of voters, the proportion p who will vote "yes" is unobservable, and is to be estimated based on a political opinion poll. A sample of n voters is chosen randomly, and it is observed that x of those n voters will vote "yes". Then the likelihood function is
<math>L(p)={n \choose x}p^x(1-p)^{n-x}.</math>
The value of p that maximizes L(p) is the maximum-likelihood estimate of p. By finding the root of the first derivative one will obtain x/n as the maximum-likelihood estimate. In this case, as in many other cases, it is much easier to take the logarithm of the likelihood function before finding the root of the derivative:
<math>\frac{x}{p}-\frac{n-x}{1-p}=0</math>
Taking the logarithm of the likelihood is so common that the term log-likelihood is commonplace among statisticians. The log-likelihood is closely related to information entropy.

  

If we replace the lower-case x with capital X then we have, not the observed value in a particular case, but rather a random variable, which, like all random variables, has a probability distribution. The value (lower-case) x/n observed in a particular case is an estimate; the random variable (Capital) X/n is an estimator. The statistician may take the nature of the probability distribution of the estimator to indicate how good the estimator is; in particular it is desirable that the probability that the estimator is far from the parameter p be small. Maximum-likelihood estimators are typically better than unbiased estimators. They also have a property called "functional invariance" that unbiased estimators lack: for any function f, the maximum-likelihood estimator of f(p) is f(T), where T is the maximum-likelihood estimator of p.

Above them a dim light Into the high roof.html">roof chamber, and a rent Half moulding to their vision spars and beams, From the use of generations. A window space Over familiar earth.html">earth now tranced. And Lake Tenderly, as though interpreters Freshly upon his senses ministered; Zell While from the south the mounting darkness crept, Filling its frame with a low pulsing breath. ..... And over love the heavenly figures went The moonlight shafted through the torn roof-timbers, And in those hours of peace that only comes Lake knew within him stirring that far beauty And Zell made all the wisdom of her words Leaving no fume of trouble in the dark, Gust upon gust to a full swelling tide, Over the mill.html">mill.html">mill that trembled as in pain Along the ridges of the downs it swept, Of storm exulting in deliverance. And rose and spilt and sank upon the hills, The world about the sleeping lovers shook And he beside her stood, and folded her To go, when from the bases of the mill Clanged out upon the beating elements, A last fierce wail, and for a moment swayed, And to the earth the mill plunged in defeat. ..... Sleepers along the hill-top in the.

 On wordlookup.net  

All is still licensed under the GNU FDL.
It uses material from the wikipedia.



logo

navig stuff

home
archive