Vernier Caliper Reading Trainer

Look at a pointer resting in the gap between two millimeter lines and try to say that it sits 64 hundredths of the way across. It is a guess. Asking which two lines out of fifty form one unbroken stroke is a different kind of question, with an answer that can be checked. A vernier scale exists to swap the first question for the second.

That swap is the whole instrument. The beam, the jaws and the thumb wheel only carry two sets of lines past each other. It is worth learning as geometry first, because the procedure is three short steps and the mistakes come from forgetting what the lines mean.

Short by one step

Take a main scale marked in millimeters. Beside it, on the sliding part, mark a second scale whose ten divisions cover nine millimeters. Each of its divisions is 0.9 mm, short of a millimeter by a tenth. School laboratory manuals write the rule as n vernier divisions equal to n minus 1 main divisions, and define the least count as one main division divided by n.

Now slide the second scale a tenth of a millimeter to the right. Its zero line no longer meets a main line, but its first line does, because that line had been a tenth short and has just made the tenth up. Slide another tenth and the second line meets instead. The number of the vernier line that meets a main line counts the tenths by which the zero has passed the last main line.

Nothing limits the idea to tenths. The UK National Physical Laboratory tabulates the usual metric forms: 20 divisions in 19 mm for a step of 0.05 mm, and 50 divisions in 49 mm for 0.02 mm. It also lists a stretched form, 20 divisions in 39 mm. Each division there is 1.95 mm, short of two millimeters by the same twentieth, so it reads identically while its lines stand twice as far apart and are easier to tell from one another.

Inch calipers follow the same arithmetic with less convenient numbers. The main scale is cut in fortieths of an inch, 0.025 in each, and a 25 division vernier makes each division one thousandth short, either over 24 main divisions or, in the stretched form the laboratory lists, over 49 of them, a length of 1.225 in. A fractional pattern puts 8 divisions across 7 sixteenths and reads to 1/128 in.

A surveyor’s scale, and the nonius before it

The scale is older than the caliper it is known from. Pierre Vernier was born in 1584 at Ornans in Franche-Comte, then a Habsburg territory ruled from Spain, and died there in 1638. His father, a lawyer and engineer, taught him and set him reading Clavius and Tycho Brahe, and he spent his working life as a military engineer and official, fortifying cities and mapping the region.

Dividing a degree was the problem he inherited. The Portuguese mathematician Pedro Nunes, who lived from 1502 to 1578 and wrote in Latin as Petrus Nonius, had proposed an answer: draw 45 concentric arcs on a quadrant, divide the first into 90 equal parts and the rest into 89, 88, 87 and so on down to 46. Wherever the index fell, it passed near a division on one arc or another, and the fraction could be calculated from which one. Tycho Brahe applied the scheme to his quadrants, and he also divided their degrees with slanting lines called transversals, a technique he did much to popularize.

It worked on paper. In brass it meant engraving dozens of differently divided arcs and consulting a table afterward. The nonius was never in common use, and Tycho appears to be the only prominent astronomer who took it up.

Vernier’s change was to make the extra scale move. In 1631 he published in Brussels a treatise whose title translates as the construction, use and properties of a new mathematical quadrant, and dedicated it to the Infanta. In place of a stack of fixed arcs he proposed one short movable arc on a quadrant divided in half degrees. The arc was thirty-one half degrees long and divided into thirty equal parts, so the line that coincided gave the minutes.

Recognition was slow. Verniers became common only in the late eighteenth century, more than a century after he introduced the idea, and the device took his name in that same century, through the French astronomer Lalande. English writers called it a nonius until about then, and some languages still do. Even his dates are not settled in print: the biography used here gives 1584 to 1638, while a widely read encyclopedia article gives 1580 to 1637.

Three steps and a worked reading

The reading procedure, as the National Physical Laboratory sets it out, has three steps. Take the main scale line at or just before the vernier’s zero. Find the vernier line that meets a main line. Add the two.

Try it on a caliper with a 0.02 mm vernier, the kind with fifty divisions numbered 0 to 10. Suppose the zero line lies between 20 and 21 on the main scale: the main reading is 20 mm. Suppose the line that meets a main line is the second one past the 6, which is line 32 of the fifty. Thirty-two steps of 0.02 mm are 0.64 mm, the figure the vernier’s own numbering shows. The reading is 20.64 mm.

Set the trainer above to 20.64 on the 0.02 mm caliper and the geometry can be checked directly. Line 32 sits exactly on the main line at 52 mm, since 20.64 plus 32 times 0.98 is 52. Lines 31 and 33 each miss their nearest main line by 0.02 mm, and lines 30 and 34 by 0.04 mm. That is the real difficulty of a fine vernier. There is always exactly one right line, but its neighbors are nearly right, and the reader has to pick the best of several close candidates. The same check works at any setting, because every miss is a whole number of least counts.

Two habits make that choice reliable. One is to look square at the scales. The vernier and the main scale are usually not in the same plane, so the apparent alignment shifts with the viewing angle; the guide’s advice is to look from directly above the matching lines. The other is to scan outward: on either side of the true line the misses grow evenly, so the right line sits in the middle of a symmetrical pattern.

A screw turned into a scale

A micrometer reaches finer steps by a different route. Its spindle is a screw, and a screw converts a large, easily seen rotation into a small advance. The standard metric instrument has a thread of 0.5 mm pitch and a thimble divided into fifty parts, so one division of rotation moves the spindle a fiftieth of half a millimeter, or 0.01 mm.

The reading is again a sum. The sleeve carries millimeter lines on one side of a datum line and half-millimeter lines on the other, uncovered one by one as the thimble backs away; the thimble line at the datum supplies the hundredths. Because the screw needs two turns per millimeter, a thimble showing 28 could mean 5.28 mm or 5.78 mm. Only the half line on the sleeve says which.

The inch instrument uses a thread of 40 turns per inch. One turn is 0.025 in, the sleeve is ruled to match, and 25 thimble divisions give thousandths. For a further decimal place the vernier returns, wrapped around the sleeve. A maker’s instruction sheet describes ten divisions on the sleeve occupying the same space as nine on the thimble, so whichever sleeve line meets a thimble line counts tenths of a thimble division: 0.0001 in, or 0.001 mm on the metric version.

Where readings go wrong

Three mistakes account for most wrong answers. On a caliper, the main scale gets read at the edge of the sliding plate instead of at the vernier’s zero line, which gives a figure a few millimeters low with a perfectly good vernier part attached. On a micrometer, the half-millimeter line is missed or counted before it has appeared, an error of exactly 0.5 mm that the laboratory’s guide warns about by name.

The third is zero error. Close the jaws and the instrument should read nothing. If the vernier zero rests to the right of the main zero, every reading is too large and the error is called positive; to the left, too small and negative. University and school manuals agree on one rule that covers both cases: subtract the zero error, with its sign. A caliper that reads 0.04 mm when closed and 12.34 mm on a part is reporting 12.30 mm.

None of this makes a reading true. Least count is the size of the step on the scale, not the accuracy of the instrument. The same guide reproduces a Japanese standard’s limits for overall error, and for a caliper of 150 mm range with a 0.02 mm vernier the limit is plus or minus 0.05 mm, more than twice the step. For 0.05 mm and 0.1 mm verniers the limits are 0.08 mm and 0.1 mm.

A drawing on a screen cannot teach the rest. Most calipers have no device to hold the measuring force constant, so the result changes with how hard the jaws are squeezed, which is why micrometers carry a ratchet. Parts are defined at 20 degrees Celsius and are larger when still warm from the machine. A burr, a film of oil or a tilted jaw adds error that no amount of care with the scale can remove.

What practice with the scales does buy is speed, and the removal of one whole class of error. Someone who has read a few hundred settings stops counting lines and starts seeing the pattern: the place where the two scales agree, with disagreement growing evenly on either side. That is the judgment Vernier’s short arc was built to use, and it is the same on a brass quadrant of 1631 as on a steel caliper today.