word looked up : home / archive

 Statistical independence 

In probability theory, when we assert that two events are independent, we intuitively mean that knowing whether or not one of them occurred tells us nothing about whether or not the other occurred. For example, the events "today is Tuesday" and "it rains today" are independent.

Similarly, when we assert that two random variables are independent, we intuitively mean that knowing something about the value of one of them doesn't yield any information about the value of the other. For instance, the height of a person and their IQ are independent random variables. Another typical example of two independent variables is given by repeating an experiment: roll a die twice, let X be the number you get the first time, and Y the number you get the second time. These two variables are independent.

Independent events

We define two events E1 and E2 of a probability space to be independent iff

P(E1E2) = P(E1) · P(E2).
Here E1E2 (the intersection of E1 and E2) is the event that E1 and E2 both occur; P denotes the probability of an event.

If P(E2) ≠ 0, then the independence of E1 and E2 can also be expressed with conditional probabilities:

P(E1 | E2) = P(E1)
which is closer to the intuition given above: the information that E2 happened doesn't change our estimate of the probability of E1.

If we have more than two events, then pairwise independence is insufficient to capture the intuitive sense of independence. So a set S of events is said to be independent if every finite nonempty subset { E1, ..., En } of S satisfies

P(E1 ∩ ... ∩ En) = P(E1) · ... · P(En).

This is called the multiplication rule for independent events.

Independent random variables

We define random variables X and Y to be independent if

Pr[(X in A) & (Y in B)] = Pr[X in A] · Pr[Y in B]
for A and B any Borel subsets of the real numbers.

If X and Y are independent, then the expectation operator has the nice property

E[X· Y] = E[X] · E[Y]
and for the variance we have
Var(X + Y) = Var(X) + Var(Y).

Furthermore, if X and Y are independent and have probability densities fX(x)and fY(y), then (X,Y) has a joint density of

fXY(x,y)dx dy = fX(x)dx fY(y)dy.

Still need to deal with independence of sets of more than 2 random variables.

Worthington?" said Cynthia, quietly. "Mr. Worthington!" he cried, "you haven't called me that before." her, "do you think.html">think.html">think you've treated me just right.html">right?" "Of course I do," she said, "or I should have treated you differently:' Bob ignored such quibbling. "Why did you run away from that baseball game in Brampton? And why And why have you avoided me here in Washington?" It is very difficult to answer for another questions which one cannot pardonable exaggeration, "and I believe that idiot.html">idiot Somers has, too." "Then why should you call him an idiot?" Cynthia flashed. Bob laughed. "How you do catch a fellow up!" said he; admiringly. "We both found out "do you think it right to ask a doorkeeper to spy on my movements?" "I'm sorry, Cynthia," he gasped, "I--I didn't think of it that way--and room, and I would have come to the parlor." "But I did send a note.html">note, and waited around all day." How was she to tell him that it was to the tone of the note she objected full upon.

 On wordlookup.net  

All is still licensed under the GNU FDL.
It uses material from the wikipedia.



logo

navig stuff

home
archive