Standard deviation

In probability and statistics, the standard deviation is the most commonly used measure of statistical dispersion. Simply put, it measures how spread out the values in a data set are.
The standard deviation is defined as the square root of the variance. This means it is the root mean square (RMS) deviation from the average. It is defined this way in order to give us a measure of dispersion that is (1) a nonnegative number, and (2) has the same units as the data.
A distinction is made between the standard deviation σ (sigma) of a whole population or of a random variable, and the standard deviation s of a subsetpopulation sample. The formulae are given below.
The term standard deviation was introduced to statistics by Karl Pearson (On the dissection of asymmetrical frequency curves, 1894).
Contents 
Interpretation and application
The standard deviation is a measure of the degree of dispersion of the data from the mean value. Stated another way, the standard deviation is simply the "average" or "expected" variation around an average (i.e., square all individual deviations around the average, add these up, divide by 'N', then take the square root. You then have the 'root' of the mean squared deviation [RMS]: in a very simple sense the "average" or expected variation around the average).
A large standard deviation indicates that the data points are far from the mean and a small standard deviation indicates that they are clustered closely around the mean.
For example, the three samples (0, 0, 14, 14), (0, 6, 8, 14), and (6, 6, 8, 8) each have an average of 7. Their standard deviations are 7, 5 and 1, respectively. The third set has a much smaller standard deviation than the other two because its values are all close to 7.
Standard deviation may be thought of as a measure of uncertainty. In physical science for example, the standard deviation of a group of repeated measurements gives the precision of those measurements. When deciding whether measurements agree with a theoretical prediction, the standard deviation of those measurements is of crucial importance: if the mean of the measurements is too far away from the prediction (with the distance measured in standard deviations), then we consider the measurements as contradicting the prediction. This makes sense since they fall outside the range of values that could reasonably be expected to occur if the prediction were correct. See prediction interval.
Definition and shortcut calculation of standard deviation
Suppose we are given a population x_{1}, ..., x_{N} of values (which are real numbers). The arithmetic mean of this population is defined as
 <math>\overline{x}=\frac{1}{N}\sum_{i=1}^N x_i<math>.
(see summation notation) and the standard deviation of this population is defined as
 <math>\sigma = \sqrt{\frac{1}{N} \sum_{i=1}^N (x_i  \overline{x})^2}<math>.
A slightly faster way to compute the same number is given by the formula (but this can exacerbate roundoff error)
 <math>\sigma = \sqrt{{\sum_{i=1}^N{{x_i}^2}\over{N}}\left({\sum_{i=1}^N{x_i}\over{N}}\right)^2\ } = \sqrt{\frac{N\sum_{i=1}^N{{x_i}^2}  \left(\sum_{i=1}^N{x_i}\right)^2}{N^2}\ }.<math>
The standard deviation of a random variable X is defined as
 <math>\sigma = \sqrt{\operatorname{E}((X\operatorname{E}(X))^2)} = \sqrt{\operatorname{E}(X^2)  (\operatorname{E}(X))^2}<math>.
Note that not all random variables have a standard deviation, since these expected values need not exist. If the random variable X takes on the values x_{1},...,x_{N} with equal probability, then its standard deviation can be computed with the formula given earlier.
Given only a sample of values x_{1},...,x_{n} from some larger population, many authors define the sample standard deviation by
 <math>
s = \sqrt{\frac{1}{n1} \sum_{i=1}^n (x_i  \overline{x})^2} .<math>
A slightly faster way to compute the same number is given by the formula (but this can exacerbate roundoff error)
 <math>
s = \sqrt{\frac{n\sum_{i=1}^n{{x_i}^2}  \left(\sum_{i=1}^n{x_i}\right)^2}{n \, (n1)}\ } .<math>
The reason for this definition is that s^{2} is an unbiased estimator for the variance σ^{2} of the underlying population. (The derivation of this equation assumes only that the samples are uncorrelated and makes no assumption as to their distribution.) Note however that s itself is not an unbiased estimator for the standard deviation σ; it tends to underestimate the population standard deviation. Although an unbiased estimator for "s" is known, the formula is overly complicated and amounts to a minor correction. Moreover, unbiasedness, in this sense of the word, is not always desirable; see bias (statistics). Some have even argued that the difference between n and n − 1 in the denominator is overly complex and trivial and thus exclude it. Without that term, what is left is the simpler expression
 <math>
s = \sqrt{\frac{1}{n} \sum_{i=1}^n (x_i  \overline{x})^2}. <math>
This form has the desirable property of being the maximumlikelihood estimate if the population is normally distributed.
Examples
Here is shown how to calculate the standard deviations of a set of data. The set of data is the ages of the members of a group of young children. { 5, 6, 8, 9 }
Step 1. Calculate the mean/average <math>\overline{x}<math>.
 <math>\overline{x}=\frac{1}{N}\sum_{i=1}^N x_i<math>.
We have N = 4 because there are four data points:
 <math>x_1 = 5\,\!<math>
 <math>x_2 = 6\,\!<math>
 <math>x_3 = 8\,\!<math>
 <math>x_4 = 9\,\!<math>
 <math>\overline{x}=\frac{1}{4}\sum_{i=1}^4 x_i<math> Replacing N with 4
 <math>\overline{x}=\frac{1}{4} \left ( x_1 + x_2 + x_3 +x_4 \right ) <math>
 <math>\overline{x}=\frac{1}{4} \left ( 5 + 6 + 8 + 9 \right ) <math>
 <math>\overline{x}= 7<math> This is the mean.
Step 2. Calculate the standard deviation <math>\sigma\,\!<math>
 <math>\sigma = \sqrt{\frac{1}{N} \sum_{i=1}^N (x_i  \overline{x})^2}<math>
 <math>\sigma = \sqrt{\frac{1}{4} \sum_{i=1}^4 (x_i  \overline{x})^2}<math> Replacing N with 4
 <math>\sigma = \sqrt{\frac{1}{4} \sum_{i=1}^4 (x_i  7)^2}<math> Replacing <math>\overline{x}<math> with 7
 <math>\sigma = \sqrt{\frac{1}{4} \left [ (x_1  7)^2 + (x_2  7)^2 + (x_3  7)^2 + (x_4  7)^2 \right ] }<math>
 <math>\sigma = \sqrt{\frac{1}{4} \left [ (5  7)^2 + (6  7)^2 + (8  7)^2 + (9  7)^2 \right ] }<math>
 <math>\sigma = \sqrt{\frac{1}{4} \left ( (2)^2 + (1)^2 + 1^2 + 2^2 \right ) }<math>
 <math>\sigma = \sqrt{\frac{1}{4} \left ( 4 + 1 + 1 + 4 \right ) }<math>
 <math>\sigma = \sqrt{\frac{10}{4}}<math>
 <math>\sigma = 1.5811\,\!<math> This is the standard deviation.
Rules for normally distributed data
Standard_deviation_diagram.png
In practice, one often assumes that the data are from an approximately normally distributed population. If that assumption is justified, then about 68% of the values are at within 1 standard deviation away from the mean, about 95% of the values are within two standard deviations and about 99.7% lie within 3 standard deviations. This is known as the "689599.7 rule".
Relationship between standard deviation and mean
The mean and the standard deviation of a set of data are usually reported together. In a certain sense, the standard deviation is the "natural" measure of statistical dispersion if the center of the data is measured by the mean. The precise statement is the following: suppose x_{1}, ..., x_{n} are real numbers and define the function
 <math>\sigma(r) = \sqrt{\frac{1}{N} \sum_{i=1}^N (x_i  r)^2}<math>
Using calculus, it is not difficult to show that σ(r) has a unique minimum for
 <math>r = \overline{x}\,<math>
(this can also be done with fairly simple algebra alone, since, as a function of r, it is a quadratic polynomial).
The coefficient of variation of a sample is the ratio of the standard devation to the mean. It is a dimensionless number that can be used to compare the amount of variance between populations with different means.
Geometric interpretation
To gain some geometric insights, we will start with a population of three values, x_{1}, x_{2}, x_{3}. This defines a point P = (x_{1}, x_{2}, x_{3}) in R^{3}. Consider the line L = {(r, r, r) : r in R}. This is the "main diagonal" going through the origin. If our three given values were all equal, then the standard deviation would be zero and P would lie on L. So it is not unreasonable to assume that the standard deviation is related to the distance of P to L. And that is indeed the case. Moving orthogonally from P to the line L, one hits the point
 <math>R = (\overline{x},\overline{x},\overline{x})<math>
whose coordinates are the mean of the values we started out with. A little algebra shows that the distance between P and R (which is the same as the distance between P and the line L) is given by σ√3. An analogous formula (with 3 replaced by N) is also valid for a population of N values; we then have to work in R^{N}.
Related articles
 Variance
 Chebyshev's inequality
 Saturation (color theory)
 Root mean square
 Mean
 Skewness
 Kurtosis
 Raw score
 Standard score
 Algorithms for calculating variance
 An inequality on location and scale parameters
External links
 Standard Deviation Calculator (http://invsee.asu.edu/srinivas/stdev.html)de:Standardabweichung
et:Standardhälve es:Desviación estándar fr:Écart type it:Deviazione standard he:סטיית תקן lt:Standartinis nuokrypis nl:Standaarddeviatie ja:標準偏差 no:Standardavvik pl:Odchylenie standardowe pt:Desvio padrão sk:Smerodajná odchýlka sr:Стандардна девијација su:Simpangan baku fi:Hajontaluku sv:Standardavvikelse zh:標準差