Index of dissimilarity

The index of dissimilarity is a demographic measure of the evenness with which two groups are distributed across component geographic areas that make up a larger area. A group is evenly distributed when each geographic unit has the same percentage of group members as the total population. The index score can also be interpreted as the percentage of one of the two groups included in the calculation that would have to move to different geographic areas in order to produce a distribution that matches that of the larger area. The index of dissimilarity can be used as a measure of segregation. A score of zero (0%) reflects a fully integrated environment; a score of 1 (100%) reflects full segregation. In terms of black–white segregation, a score of .60 means that 60 percent of blacks would have to exchange places with whites in other units to achieve an even geographic distribution. ^{[1] [2]}

Basic formula

The basic formula for the index of dissimilarity is:

${\displaystyle D={\frac {1}{2}}\sum _{i=1}^{N}\left|{\frac {a_{i}}{A}}-{\frac {b_{i}}{B}}\right|}$

where (comparing a black and white population, for example):

a_i = the population of group A in the i^th area, e.g. census tract

A = the total population in group A in the large geographic entity for which the index of dissimilarity is being calculated.

b_i = the population of group B in the i^th area

B = the total population in group B in the large geographic entity for which the index of dissimilarity is being calculated.

The index of dissimilarity is applicable to any categorical variable (whether demographic or not) and because of its simple properties is useful for input into multidimensional scaling and clustering programs. It has been used extensively in the study of social mobility to compare distributions of origin (or destination) occupational categories.

Linear algebra perspective

The formula for the Index of Dissimilarity can be made much more compact and meaningful by considering it from the perspective of Linear algebra. Suppose we are studying the distribution of rich and poor people in a city (e.g. London). Suppose our city contains ${\displaystyle N}$ blocks:

${\displaystyle \{{\text{block 1}},{\text{block 2}},\ldots ,{\text{block N}}\}}$

Let's create a vector ${\displaystyle \mathbf {r} }$ which shows the number of rich people in each block of our city:

${\displaystyle \mathbf {r} =[r_{1},r_{2},\cdots ,r_{N}]}$

Similarly, let's create a vector ${\displaystyle \mathbf {p} }$ which shows the number of poor people in each block of our city:

${\displaystyle \mathbf {p} =[p_{1},p_{2},\cdots ,p_{N}]}$

Now, the ${\displaystyle L^{1}}$-norm of a vector is simply the sum of (the magnitude of) each entry in that vector. ^[3] That is, for a vector ${\displaystyle \mathbf {v} =[v_{1},v_{2},\cdots ,v_{N}]}$, we have the ${\displaystyle L^{1}}$-norm:

${\displaystyle |\mathbf {v} |_{1}=\sum _{i=1}^{N}|v_{i}|}$

If we denote ${\displaystyle R}$ as the total number of rich people in our city, than a compact way to calculate ${\displaystyle R}$ would be to use the ${\displaystyle L^{1}}$-norm:

${\displaystyle R=|\mathbf {r} |_{1}=\sum _{i=1}^{N}|r_{i}|}$

Similarly, if we denote ${\displaystyle P}$ as the total number of poor people in our city, then:

${\displaystyle P=|\mathbf {p} |_{1}=\sum _{i=1}^{N}|p_{i}|}$

When we divide a vector ${\displaystyle \mathbf {v} }$ by its norm, we get what is called the normalized vector or Unit vector ${\displaystyle {\hat {\mathbf {v} }}}$:

${\displaystyle {\hat {\mathbf {v} }}={\frac {\mathbf {v} }{|\mathbf {v} |_{1}}}}$

Let us normalize the rich vector ${\displaystyle \mathbf {r} }$ and the poor vector ${\displaystyle \mathbf {p} }$:

${\displaystyle {\hat {\mathbf {r} }}={\frac {\mathbf {r} }{|\mathbf {r} |_{1}}}={\frac {\mathbf {r} }{R}}}$

${\displaystyle {\hat {\mathbf {p} }}={\frac {\mathbf {p} }{|\mathbf {p} |_{1}}}={\frac {\mathbf {p} }{P}}}$

We finally return to the formula for the Index of Dissimilarity (${\displaystyle D}$); it is simply equal to one-half the ${\displaystyle L^{1}}$-norm of the difference between the vectors ${\displaystyle {\hat {\mathbf {r} }}}$ and ${\displaystyle {\hat {\mathbf {p} }}}$:

Index of Dissimilarity
(in Linear Algebraic notation)

${\displaystyle D={\frac {1}{2}}|{\hat {\mathbf {r} }}-{\hat {\mathbf {p} }}|_{1}}$

Numerical example

Consider a city consisting of four blocks of 2 people each. One block consists of 2 rich people. One block consists of 2 poor people. Two blocks consist of 1 rich and 1 poor person. What is the index of dissimilarity for this city?

Our fictional city has 4 blocks: one block containing 2 rich people; another containing 2 poor people; and two blocks containing 1 rich and 1 poor person.

Firstly, let's find the rich vector ${\displaystyle \mathbf {r} }$ and poor vector ${\displaystyle \mathbf {p} }$:

${\displaystyle \mathbf {r} =[2,0,1,1]}$

${\displaystyle \mathbf {p} =[0,2,1,1]}$

Next, let's calculate the total number of rich people and poor people in our city:

${\displaystyle R=2+0+1+1=4}$

${\displaystyle P=0+2+1+1=4}$

Next, let's normalize the rich and poor vectors:

${\displaystyle {\hat {\mathbf {r} }}={\frac {\mathbf {r} }{R}}={\frac {1}{4}}[2,0,1,1]=[0.5,0,0.25,0.25]}$

${\displaystyle {\hat {\mathbf {p} }}={\frac {\mathbf {p} }{P}}={\frac {1}{4}}[0,2,1,1]=[0,0.5,0.25,0.25]}$

We can now calculate the difference ${\displaystyle {\hat {\mathbf {r} }}-{\hat {\mathbf {p} }}}$:

${\displaystyle {\hat {\mathbf {r} }}-{\hat {\mathbf {p} }}=[0.5,0,0.25,0.25]-[0,0.5,0.25,0.25]=[0.5,-0.5,0,0]}$

Finally, let's find the index of dissimilarity (${\displaystyle D}$):

${\displaystyle D={\frac {1}{2}}|{\hat {\mathbf {r} }}-{\hat {\mathbf {p} }}|_{1}={\frac {1}{2}}(|0.5|+|-0.5|)=0.5}$

Equivalence between formulae

We can prove that the Linear Algebraic formula for ${\displaystyle D}$ is identical to the basic formula for ${\displaystyle D}$. Let's start with the Linear Algebraic formula:

${\displaystyle D={\frac {1}{2}}|{\hat {\mathbf {r} }}-{\hat {\mathbf {p} }}|_{1}}$

Let's replace the normalized vectors ${\displaystyle \mathbf {r} }$ and ${\displaystyle \mathbf {p} }$ with:

${\displaystyle D={\frac {1}{2}}\left|{\frac {\mathbf {r} }{R}}-{\frac {\mathbf {p} }{P}}\right|_{1}}$

Finally, from the definition of the ${\displaystyle L^{1}}$-norm, we know that we can replace it with the summation:

${\displaystyle D={\frac {1}{2}}\sum _{i=1}^{N}|{\frac {r_{i}}{R}}-{\frac {p_{i}}{P}}|}$

Thus we prove that the linear algebra formula for the index of dissimilarity is equivalent to the basic formula for it:

${\displaystyle D={\frac {1}{2}}|{\hat {\mathbf {r} }}-{\hat {\mathbf {p} }}|_{1}={\frac {1}{2}}\sum _{i=1}^{N}|{\frac {r_{i}}{R}}-{\frac {p_{i}}{P}}|}$

Zero segregation

When the Index of Dissimilarity is zero, this means that the community we are studying has zero segregation. For example, if we are studying the segregation of rich and poor people in a city, then if ${\displaystyle D=0}$, it means that:

• There are no blocks in the city which are "rich blocks", and there are no blocks in the city which are "poor blocks"
• There is a homogeneous distribution of rich and poor people throughout the city

If we set ${\displaystyle D=0}$ in the linear algebraic formula, we get the necessary condition for having zero segregation:

${\displaystyle \mathbf {\hat {r}} =\mathbf {\hat {p}} }$

For example, suppose you have a city with 2 blocks. Each block has 4 rich people and 100 poor people:

${\displaystyle \mathbf {r} =[4,4]}$

${\displaystyle \mathbf {p} =[100,100]}$

Then, the total number of rich people is ${\displaystyle R=4+4=8}$, and the total number of poor people is ${\displaystyle P=100+100=200}$. Thus:

${\displaystyle \mathbf {\hat {r}} =[4/8,4/8]=[0.5,0.5]}$

${\displaystyle \mathbf {\hat {p}} =[100/200,100/200]=[0.5,0.5]}$

Because ${\displaystyle \mathbf {\hat {r}} =\mathbf {\hat {p}} }$, thus this city has zero segregation.

As another example, suppose you have a city with 3 blocks:

${\displaystyle \mathbf {r} =[1,2,3]}$

${\displaystyle \mathbf {p} =[100,200,300]}$

Then, we have ${\displaystyle R=1+2+3=6}$ rich people in our city, and ${\displaystyle P=100+200+300=600}$ poor people. Thus:

${\displaystyle \mathbf {\hat {r}} =[1/6,2/6,3/6]}$

${\displaystyle \mathbf {\hat {p}} =[100/600,200/600,300/600]=[1/6,2/6,3/6]}$

Again, because ${\displaystyle \mathbf {\hat {r}} =\mathbf {\hat {p}} }$, thus this city also has zero segregation.

See also

• Kullback–Leibler divergence
• Isolation index
• self-dissimilarity
• Hoover index

References

1. Bureau, US Census. "Housing Patterns: Appendix B: Measures of Residential Segregation". Census.gov. Retrieved 2022-04-28.
2. Massey, Douglas S.; Rothwell, Jonathan; Domina, Thurston (2009-10-26). "The Changing Bases of Segregation in the United States". The Annals of the American Academy of Political and Social Science. 626 (1): 74–90. doi:10.1177/0002716209343558. ISSN   0002-7162. PMC   3844132 . PMID   24298193.
3. Wolfram MathWorld: L1 Norm

External links

• http://enceladus.isr.umich.edu/race/calculate.html