Verhoeff algorithm

The Verhoeff algorithm^[1] is a checksum for error detection first published by Dutch mathematician Jacobus Verhoeff in 1969.^[2][3] It was the first decimal check digit algorithm that detects all single-digit errors, and all transposition errors involving two adjacent digits,^[4] which was at the time thought impossible with such a code.

The method was independently discovered by H. Peter Gumm in 1985, this time including a formal proof and an extension to any base.^[5]

Verhoeff had the goal of finding a decimal code—one where the check digit is a single decimal digit—which detected all single-digit errors and all transpositions of adjacent digits. At the time, supposed proofs of the nonexistence^[6] of these codes made base-11 codes popular, for example in the ISBN check digit.

His goals were also practical, and he based the evaluation of different codes on live data from the Dutch postal system, using a weighted points system for different kinds of error. The analysis broke the errors down into a number of categories: first, by how many digits are in error; for those with two digits in error, there are transpositions (ab → ba), twins (aa → bb), jump transpositions (abc → cba), phonetic (1a → a0), and jump twins (aba → cbc). Additionally there are omitted and added digits. Although the frequencies of some of these kinds of errors might be small, some codes might be immune to them in addition to the primary goals of detecting all singles and transpositions.

The phonetic errors in particular showed linguistic effects, because in Dutch, numbers are typically read in pairs; and also while 50 sounds similar to 15 in Dutch, 80 does not sound like 18.

Taking six-digit numbers as an example, Verhoeff reported the following classification of the errors:.

Digits in error	Classification	Count	Frequency
1	Transcription	9,574	79.05%
2	Transpositions	1,237	10.21%
	Twins	67	0.55%
	Phonetic	59	0.49%
	Other adjacent	232	1.92%
	Jump transpositions	99	0.82%
	Jump Twins	35	0.29%
	Other jump errors	43	0.36%
	Other	98	0.81%
3		169	1.40%
4		118	0.97%
5		219	1.81%
6		162	1.34%
Total		12,112

The general idea of the algorithm is to represent each of the digits (0 through 9) as elements of the dihedral group D₅. That is, map digits to D₅, manipulate these, then map back into digits. Let this mapping be m : [0, 9] → D₅

m = ( 0 1 2 3 4 5 6 7 8 9 e r r 2 r 3 r 4 s r s r 2 s r 3 s r 4 s ) {\displaystyle m={\begin{pmatrix}0&1&2&3&4&5&6&7&8&9\\e&r&r^{2}&r^{3}&r^{4}&s&rs&r^{2}s&r^{3}s&r^{4}s\end{pmatrix}}}

Let the nth digit be a_n and let the number of digits be k.

For example given the code 942 then k is 3 and a₃ = m(2) = r².

Now define the permutation f : D₅ → D₅

f = ( e r r 2 r 3 r 4 s r s r 2 s r 3 s r 4 s r s r 2 s r s r 2 r 3 s r 3 e r 4 s r 4 ) {\displaystyle f={\begin{pmatrix}e&r&r^{2}&r^{3}&r^{4}&s&rs&r^{2}s&r^{3}s&r^{4}s\\r&s&r^{2}s&rs&r^{2}&r^{3}s&r^{3}&e&r^{4}s&r^{4}\end{pmatrix}}}

For example, f ( r 3 ) = r s {\displaystyle f(r^{3})=rs} . Another example is f 2 ( r 3 ) = r 3 {\displaystyle f^{2}(r^{3})=r^{3}} since f ( f ( r 3 ) ) = f ( r s ) = r 3 {\displaystyle f(f(r^{3}))=f(rs)=r^{3}} .

Using multiplicative notation for the group operation of D₅, the check digit is then simply a value c such that

f 0 ( c ) ⋅ f 1 ( a k ) ⋅ … ⋅ f k − 1 ( a 2 ) ⋅ f k ( a 1 ) = e {\displaystyle f^{0}(c)\cdot f^{1}(a_{k})\cdot \ldots \cdot f^{k-1}(a_{2})\cdot f^{k}(a_{1})=e}

c is explicitly given by multiplicative inverse:

c = ( ∏ n = 1 k f n ( a k + 1 − n ) ) − 1 {\displaystyle c=\left(\prod _{n=1}^{k}f^{n}(a_{k+1-n})\right)^{-1}}

For example the check digit for 942 is 7. To verify this, use the mapping to D₅ and insert into the LHS of the previous equation

f 0 ( r 2 s ) ⋅ f 1 ( r 2 ) ⋅ f 2 ( r 4 ) ⋅ f 3 ( r 4 s ) = e {\displaystyle f^{0}(r^{2}s)\cdot f^{1}(r^{2})\cdot f^{2}(r^{4})\cdot f^{3}(r^{4}s)=e}

To evaluate this permutation quickly use that

f 3 ( r 4 s ) = f 2 ( r 4 ) = f 1 ( r 2 ) = f 0 ( r 2 s ) = r 2 s {\displaystyle f^{3}(r^{4}s)=f^{2}(r^{4})=f^{1}(r^{2})=f^{0}(r^{2}s)=r^{2}s}

to get that

r 2 s ⋅ r 2 s ⋅ r 2 s ⋅ r 2 s = e {\displaystyle r^{2}s\cdot r^{2}s\cdot r^{2}s\cdot r^{2}s=e}

This is the same reflection being iteratively multiplied. Use that reflections are their own inverse.^[7]

( r 2 s ⋅ r 2 s ) ⋅ ( r 2 s ⋅ r 2 s ) = e 2 = e {\displaystyle (r^{2}s\cdot r^{2}s)\cdot (r^{2}s\cdot r^{2}s)=e^{2}=e}

In practice, the algorithm is implemented using simple lookup tables without needing to understand how to generate those tables from the underlying group and permutation theory. This is more properly considered a family of algorithms, as other permutations work too. Verhoeff's notes that the particular permutation, given above, is special as it has the property of detecting 95.3% of the phonetic errors.^[8]

The strengths of the algorithm are that it detects all transliteration and transposition errors, and additionally most twin, twin jump, jump transposition and phonetic errors.

The main weakness of the Verhoeff algorithm is its complexity. The calculations required cannot easily be expressed as a formula in say Z / 10Z. Lookup tables are required for easy calculation. A similar code is the Damm algorithm, which has similar qualities.

The Verhoeff algorithm can be implemented using three tables: a multiplication table d, an inverse table inv, and a permutation table p.

The first table, d, is based on multiplication in the dihedral group D₅.^[7] and is simply the Cayley table of the group. Note that this group is not commutative, that is, for some values of j and k, d(j,k) ≠ d(k, j).

The inverse table inv represents the multiplicative inverse of a digit, that is, the value that satisfies d(j, inv(j)) = 0.

The permutation table p applies a permutation to each digit based on its position in the number. This is actually a single permutation (1 5 8 9 4 2 7 0)(3 6) applied iteratively; i.e. p(i + j, n) = p(i, p(j, n)).

The Verhoeff checksum calculation is performed as follows:

1. Create an array n out of the individual digits of the number, taken from right to left (rightmost digit is n₀, etc.).
2. Initialize the checksum c to zero.
3. For each index i of the array n, starting at zero, replace c with d(c, p(i mod 8, n_i)).

The original number is valid if and only if c = 0.

To generate a check digit, append a 0, perform the calculation: the correct check digit is inv(c).

The Verhoeff algorithm is used in a variety of systems, including:

• German Deutschemark banknotes ^[10]
• Indian Aadhaar numbers ^[11]
• Irish Meter Registration System Operator ^[12]
• The SNOMED Clinical Terms dictionary ^[13]

• Luhn algorithm – Simple checksum formula
• Damm algorithm – Check digit algorithm

• Detailed description of the Verhoeff algorithm Archived 2006-04-26 at the Wayback Machine