A relation \(\approx\) on a nonempty set \(S\) that is reflexive, symmetric, and transitive is said to be an equivalence relation on \(S\). As the name and notation suggest, an equivalence relation is intended to define a type of equivalence among the elements of \(S\). Like partial orders, equivalence relations occur naturally in most areas of mathematics, including probability. The equivalence class of an element \(x \in S\) is the set of all elements that are equivalent to \(x\):
\[ [x] = \{y \in S: y \approx x\} \]The most important result is that an equivalence relation on a set \(S\) defines a partition of \(S\).
Suppose that \(\approx\) is an equivalence relation on a set \(S\).
Sometimes the set \(\mathscr{S}\) of equivalence classes is denoted \(S / \approx\). The idea is that the equivalence classes are new objects
obtained by identifying
elements in \(S\) that are equivalent. Conversely, every partition of a set defines an equivalence relation on the set.
Suppose that \(\mathscr{S}\) is a collection of non-empty sets that partition a given set \(S\). The relation defined below is an equivalence relation on \(S\):
\[ x \approx y \text{ if and only if } x \in A \text{ and } y \in A \text{ for some } A \in \mathscr{S} \]
Sometimes the equivalence relation \(\approx\) associated with a given partition \(\mathscr{S}\) is denoted \(S / \mathscr{S}\).
The process of forming a partition from an equivalence relation, and the process of forming an equivalence relation from a partition are inverses of each other.
Suppose that \(S\) is a nonempty set.
Every function \(f\) defines an equivalence relation on its domain, known as the equivalence relation associated with \(f\). Moreover, the equivalence classes have a simple description in terms of the inverse images of \(f\).
Suppose that \(f: S \to T\). Define a relation \(\approx\) on \(S\) by \(t \approx x\) if and only if \(f(t) = f(x)\).
Suppose again that \(f: S \to T\).
Give the equivalence classes explicitly for the functions from \(\R\) into \(\R\) defined below:
Suppose that \(I\) is a fixed interval of \(\R\), and that \(S\) is the set of differentiable functions from \(I\) into \(\R\). Consider the equivalence relation associated with the derivative operator \(D\) on \(S\), so that \(D(f) = f^{\prime}\). For \(f \in S\), give a simple description of \([f]\).
Let \(d\) be a positive integer. Define the relation \(\equiv_d\) on the set of integers \(\Z\) by \(m \; \equiv_d \; n\) if and only if \(d \mid (n - m)\).
The equivalence relation \(\equiv_d\) is known as congruence modulo \(d\).
Equivalence relations associated with functions are universal: every equivalence relation is of this form:
Suppose that \(\approx\) is an equivalence relation on a set \(S\). Define \(f: S \to \mathscr{P}(S)\) by \(f(x) = [x]\). Then \(\approx\) is the equivalence relation associated with \(f\).
Suppose that \(\approx\) and \(\cong\) are equivalence relations on a set \(S\). Let \(\equiv\) denote the intersection of \(\approx\) and \(\cong\) (thought of as subsets of \(S \times S\)). Equivalently, \(x \equiv y\) if and only if \(x \approx y\) and \(x \cong y\).
Suppose that we have a relation that is reflexive and transitive, but fails to be a partial order because it's not anti-symmetric. The relation and its inverse naturally lead to an equivalence relation, and then in turn, the original relation defines a true partial order on the equivalence classes. This is a common construction. The details are given in the next exercise.
Suppose that \(\preceq\) is a relation on a set \(S\) that is reflexive and transitive. Define the relation \(\approx\) on \(S\) by \(x \approx y\) if and only if \(x \preceq y\) and \(y \preceq x\).
Suppose that \(S\) and \(T\) are sets and that \(\preceq_T\) is a partial order on \(T\). Suppose also that \(f: S \to T\). Define the relation \(\preceq_S\) on \(S\) by \(x \; \preceq_S \; y\) if and only if \(f(x) \; \preceq_T \; f(y)\). The relation \(\preceq_S\) is reflexive and transitive. The equivalence relation on \(S\) constructed in the previous exercise is the equivalence relation associated with the function \(f\). Hence the relation \(\preceq_S\) can be extended to a partial order on the equivalence classes corresponding to \(f\).
Linear algebra provides several examples of important and interesting equivalence relations. To set the stage, let \(\R^{m \times n}\) denote the set of \(m \times n\) matrices with real entries.
First recall that the following are row operations on a matrix:
Row operations are essential for inverting matrices and solving systems of linear equations. If \(A \in \R^{m \times n}\) and \(B \in \R^{m \times n}\), then \(A\) and \(B\) are said to be row equivalent if \(A\) can be transformed into \(B\) by a finite sequence of row operations.
Row equivalence is an equivalence relation on \(\R^{m \times n}\).
Note that each row operation can be reversed by another row operation.
Next recall that \(n \times n\) matrices \(A\) and \(B\) are said to be similar if there exists an invertible \(n \times n\) matrix \(P\) such that \(P^{-1} A P = B\). Similarity is very important in the study of linear transformations, change of basis, and the theory of eigenvalues and eigenvectors.
Similarity is an equivalence relation on \(\R^{n \times n}\).
Equivalence relations play an important role in the construction of complex mathematical structures from simpler ones. Often the objects in the new structure are equivalence classes of objects constructed from the simpler structures, modulo an equivalence relation that captures the essential properties of equality
for the new objects.
The construction of number systems is a prime example of this general idea. The next exercise explores the construction of rational numbers from integers.
Define a relation \(\approx\) on \(\Z \times \N_+\) by \((j, k) \approx (m, n)\) if and only if \(j\,n = k\,m\).