Timbre and acoustics

Which instrument is underneath

Every roughness curve so far compares two tones of the same timbre, which is a duet nobody plays. Give the two notes different instruments and the sum stops being symmetric: the same written interval, on the same two players, is up to five times rougher depending on which of them takes the lower note. From G3 upward the fifth is a well in all twenty-five pairings and no other interval is; below it, three pairings lose even that, and all three have a clarinet on top.

Assumes: An instrument is not one timbre · A third is rougher in the bass

The previous rung of this ladder ended by naming the thing it had made both possible and necessary: a dissonance curve for two different instruments. Every roughness figure on this site — and, as far as the literature goes, very nearly every roughness figure anywhere — compares two tones of the same timbre. That is a duet nobody plays.

The obstacle was one line of code. The function that computes a dissonance curve takes a spectrum and uses it for both notes; the general case takes two, and the sum runs over every pair of partials exactly as before. What comes out is not a generalisation. It is a different object, because the sum with one spectrum is symmetric under swapping the notes and the sum with two is not.

How many intervals a duet is smooth at. Every ordered pairing of 5 radiators, with the number of wells in its dissonance curve over an octave from 262 hertz. Rows are the instrument underneath and columns the one above, so the grid is not symmetric about its diagonal and that asymmetry is the result. The count runs from 1 to 7 across the grid, and a cell and its mirror need not agree: a violin under a clarinet has 1 and a clarinet under a violin has 2. The fifth is a well in every one of the 25 pairings and no other interval is.
Fig. 1 Every ordered pairing of five radiators, with the number of wells its dissonance curve has across an octave. Rows are the instrument underneath and columns the one above. If timbre were a property of a duet rather than of each player, this grid would be symmetric about its diagonal. It is not: a violin under a clarinet has one smooth interval and a clarinet under a violin has two, and a voice under a clarinet has six.

What each of them is putting into the air

The rung rests on five spectra, and not one of them is a new table. Each is a source this collection already carries multiplied by a filter it already carries, because inventing a partial list to make an argument come out is exactly the failure this site is arranged against.

What each of them radiates at 262 hertz. The partial amplitudes each radiator actually puts into the air at 262 hertz, normalised to its own strongest partial. Every one is a source already to hand through a filter already to hand — the string through the measured violin body, the glottal pulse through a published vowel, the odd-dominant list cut off above a woodwind's computed tone-hole cutoff. The filters do not move with the note, which is why these pictures are different at every pitch and why a duet is not symmetric.
Fig. 2 What each radiator actually puts into the air at middle C, normalised to its own strongest partial. The violin is a string’s one-over-n source through the measured body; the voice is a computed glottal pulse through a published vowel’s formants; the clarinet is the site’s odd-dominant list rolled off above a woodwind’s computed tone-hole cutoff; the oboe and the flue pipe are the reed and organ lists the synthesiser already plays. The differences between these five rows are the whole of what follows.

The crucial property is not the shape of any one row. It is that the filters do not move with the note. A body resonance sits at 460 hertz whatever is being played, exactly as a vowel’s first formant sits at 730 hertz whatever the pitch. So the filter weights the fourth partial of one note and the first partial of a note two octaves up, and the two notes of an interval are therefore filtered differently even when the same instrument plays both.

What each of them radiates at 196 hertz. The partial amplitudes each radiator actually puts into the air at 196 hertz, normalised to its own strongest partial. Every one is a source already to hand through a filter already to hand — the string through the measured violin body, the glottal pulse through a published vowel, the odd-dominant list cut off above a woodwind's computed tone-hole cutoff. The filters do not move with the note, which is why these pictures are different at every pitch and why a duet is not symmetric.
Fig. 3 The same five radiators an octave and a bit lower, at 196 hertz, which is the whole of what “the filters do not move” means. Every source is unchanged — the same string, the same odd-partial list, the same glottal pulse — and every radiated list is different from the row above it, because a violin body’s resonance sits at 460 hertz whatever is played and a vowel’s first formant at 730. At 262 hertz the body’s air resonance weights the first partial; here it weights the second. The two notes of an interval are filtered differently even when one instrument plays both, and that is the whole mechanism of everything below.

The symmetry that was never noticed because it was never tested

Sensory dissonance between two tones is a double sum: every partial of the first against every partial of the second, each pair contributing an amount that depends only on the two frequencies. Swap the two tones and the sum is unchanged, because addition commutes.

That is true when both tones have the same spectrum. When they do not, the swap is not a swap of the summation order — it is a swap of which spectrum is at which frequency, and the answer changes.

a violin underneath, a clarinet above. A violin holds the lower note and a clarinet sweeps above it, each with its own radiated spectrum: a source already to hand through a filter already to hand, recomputed at every pitch because a fixed filter weights a moving note's partials differently. The curve is not symmetric — putting the same two instruments the other way round is a different picture. Sensory dissonance between two complex tones as the upper one is swept through an octave, computed by summing the roughness between every pair of their partials. Nothing here is placed by hand. The wells this spectrum produces sit on 3/2, found by scanning the curve rather than by marking them. And the tempered minor third sits 402 cents below the nearest well, and the tempered major third sits 302 cents below the nearest well, which is a real feature of this model and not a defect of the drawing.
Fig. 4 A violin holds middle C and a clarinet sweeps an octave above it. The curve has one well, at the fifth, and the whole of the rest of the octave is a slope. The violin’s body squashes its own upper partials at this pitch, so there is very little for the clarinet’s odd partials to coincide with, and very little to be rough against either.
a clarinet underneath, a violin above. A clarinet holds the lower note and a violin sweeps above it, each with its own radiated spectrum: a source already to hand through a filter already to hand, recomputed at every pitch because a fixed filter weights a moving note's partials differently. The curve is not symmetric — putting the same two instruments the other way round is a different picture. Sensory dissonance between two complex tones as the upper one is swept through an octave, computed by summing the roughness between every pair of their partials. Nothing here is placed by hand. The wells this spectrum produces sit on 3/2, on 7/4, found by scanning the curve rather than by marking them. And the tempered minor third sits 402 cents below the nearest well, and the tempered major third sits 302 cents below the nearest well, which is a real feature of this model and not a defect of the drawing.
Fig. 5 The same two instruments, the same two notes at every point, the clarinet now underneath. Three wells rather than one, and the extra two are at the major sixth and near a seventh. Nothing about the interval has changed; what has changed is which player’s spectrum is at the bottom of it.

Where a clarinet’s missing partials come from

The clarinet is the sharpest case in the set and it is worth saying why its spectrum is what it is, because the reason is not a fact about clarinets but a fact about a stopped tube.

A cylinder closed at one end supports only the odd modes: the even ones would need a pressure antinode where the reed forces one and a node where the open end forces one, and no wave can do both. So the second, fourth and sixth partials are not weak, they are structurally absent, and the site’s own partial list has them at four hundredths.

The other half of the clarinet’s row is the top end, and that is the tone-hole lattice. Above a computable cutoff the wave runs straight past the open holes and leaves from the bell, so the radiated spectrum rolls off above that frequency whatever the fingering. Both features are computed elsewhere in this collection for reasons that had nothing to do with roughness, and both turn out to decide which intervals a clarinet is smooth at.

The same is true in the other direction for the oboe. A strong reed driving a conical bore produces the complete series with slowly falling amplitudes, which is why the oboe’s row is the densest in the figure and why the pairings involving it have the most wells. An instrument with more partials has more chances to coincide, and more chances to be rough.

There is a third radiator in the set whose row is decided somewhere else again, and it is the one whose filter moves. A singer choosing a vowel is choosing a pair of formant frequencies, and unlike a violin’s body those frequencies are under continuous control — so the voice is the one instrument here whose radiated spectrum at a fixed pitch is a decision rather than a property. That has a consequence for every count in this essay: the voice’s row is not one row but a family, and the pairings it appears in are scored against whichever vowel the figure’s filter was built from. A duet result involving the voice is therefore a result about a vowel, and a singer who changes vowel on a held note changes which intervals are smooth underneath the note being held.

The same caution applies more weakly to every wind instrument, since a player’s embouchure and breath pressure move the upper partials by several decibels without moving anything else. What none of them can move is the positions of the filter’s peaks, which is the quantity all of these results turn on. A performer controls how much of the spectrum is radiated and not where the radiation is possible, and it is the second that makes a duet curve register-dependent.

How large the asymmetry is

Scoring intervals both ways round puts a number on it.

The same intervals, a clarinet under and over. Each interval scored twice: once with a clarinet on the lower note and a violin above, once the other way round. With one spectrum for both notes these bars would be identical, because the roughness sum is symmetric; with two spectra they are not. The largest disagreement is at the major sixth, where one arrangement is 5.1 times rougher than the other with the same two notes in it.
Fig. 6 Seven intervals, each scored with the clarinet below and again with the violin below. If both notes had one spectrum every pair of bars would be the same height. The thirds barely move; the major sixth moves by a factor of five, and the direction is that the clarinet underneath is the smooth arrangement.

Five to one, at the major sixth, with the same two notes and the same two players. The mechanism is visible in the partial rows above. A clarinet’s second partial is almost absent, so a clarinet on the lower note contributes nothing at the octave above itself — which is precisely where the violin’s fundamental sits when the interval is a sixth or a seventh. Put the violin underneath and its second partial, which is strong, lands in the critical band around the clarinet’s fundamental and beats with it.

The pattern is not confined to that pair, and one interval stands out for a different reason.

The same intervals, a voice on “hod” under and over. Each interval scored twice: once with a voice on “hod” on the lower note and a violin above, once the other way round. With one spectrum for both notes these bars would be identical, because the roughness sum is symmetric; with two spectra they are not. The largest disagreement is at the octave, where one arrangement is 4.2 times rougher than the other with the same two notes in it.
Fig. 7 A voice against a violin, both ways round. The largest disagreement here is at the octave — a factor of four — and it runs the way a vowel’s formants dictate: a voice on the lower note has strong third, fourth and ninth partials sitting exactly where the violin’s lower partials are, while a violin on the lower note has almost nothing up there to interfere with.

An octave doubling is not one sound. It is rougher with the spectrally rich instrument underneath than with the spectrally rich instrument on top, by a factor of three to four across the pairs tested. That is an orchestration rule with an arithmetic behind it, and it is the reverse of the shape most doubling advice takes.

The fifth, and only the fifth

Across all twenty-five ordered pairings the well counts run from one to seven. Something has to be said about which intervals appear and which do not, and the answer is unusually clean.

At middle C the fifth is a well in every one of the twenty-five. No other interval is — the major sixth, which is next, manages seventeen.

That is worth putting beside three results this collection already has. Three is the largest agreeable number scored every chord of every size for roughness and found the fifth in the answer at every size. A spectrum chooses its own scale found that the minima of a dissonance curve move when the spectrum does, which is the argument that a gamelan’s scale follows its bars. The previous rung of this ladder found that the count of minima changes with register on one instrument — three at the bottom of a violin’s range, two in the middle, four at the top. This one adds the third axis, the pairing, and in all three the fifth is the invariant.

The reason is arithmetic rather than aesthetic. A fifth puts the upper tone’s fundamental at 1.5 times the lower one’s, so the upper tone’s second partial coincides with the lower tone’s third — and the second and third partials are the two that survive nearly every filter, because a filter has to be extraordinarily selective to remove both. Every other interval’s coincidences involve a partial high enough for some filter in the set to have taken it out.

And the invariance is a fact about this register

That explanation makes a prediction the claim above does not survive, and finding out costs one line: run the census at other roots.

root pairings with a well at the fifth mean wells next most universal
C3 22 of 25 4.5 major sixth, 18
E3 22 of 25 4.2 major sixth, 21
G3 25 of 25 3.7 major sixth, 18
C4 25 of 25 3.2 major sixth, 17
G4 25 of 25 3.6 major sixth, 22
C5 25 of 25 3.8 major sixth, 23

The fifth is a well in all twenty-five pairings from G3 upward and in twenty-two of them below it, so the invariant this section names holds over most of the range and is not a property of the pairing axis on its own. It is one more thing that is true at middle C.

And the three pairings that lose it are the three the explanation predicts. At C3 they are clarinet under clarinet, oboe under clarinet and flue under clarinet; at E3, clarinet, flue and voice under clarinet. Every one of them has a clarinet on the upper note, and the fifth’s coincidence is the upper note’s second partial against the lower note’s third. The clarinet is the one radiator in the set whose second partial is not merely filtered but structurally absent, at four hundredths of the fundamental — so the argument that the second and third partials survive nearly every filter is exactly right, and the exception it allows for is the one instrument here whose second partial was never there to be filtered.

Why the exception appears only low down is the register mechanism again. Above G3 the lower note’s own third partial is strong enough to make a well by itself against whatever little the clarinet has at its second; at C3 the lower note’s partials sit under the fixed filters differently and the coincidence has nothing left to be a coincidence with.

So the honest statement is narrower and better founded than the flat one. The fifth is the only interval that is a well in every pairing at any register tested, it fails in three of twenty-five in the bottom fifth of the range, and the three failures are all the same instrument in the same position for a reason the model gives in advance.

Which pairs blend, and what blending is. Every pair of radiators playing one note at equal level, ranked by how much of the composite belongs to neither of them. The best is a clarinet with an oboe at 0.58, and the worst is under a tenth of that. The quantity that sorts the list is not similarity: it is whether the level at which the composite changes owner falls inside the range a player can reach. A pair whose crossing is at 3 decibels blends, and one whose crossing is off the end of the dial does not, because there is no balance at which the quieter instrument is doing anything but colouring the louder. That is a definition of blend rather than a description of one, and it is computed from two spectra and nothing else.
Fig. 8 The version drawn here from the beginning is one string spectrum against itself: three wells, at the fourth, the fifth and the sixth, all on simple ratios. Every duet figure above is a departure from it and the departure is not small. This is the other question the same model answers — which pairs blend, ranked by how much of the composite belongs to neither of them. A clarinet with an oboe leads at 0.58 and the worst pair is under a tenth of that, and what sorts the list is not similarity: it is whether the level at which the composite changes owner falls inside the range a player controls.

It is also a function of register

Because the filters are fixed and the notes are not, a duet curve is a different curve at every pitch — which means the asymmetry is not a constant of a pair of instruments either.

The same intervals, a clarinet under and over. Each interval scored twice: once with a clarinet on the lower note and a violin above, once the other way round. With one spectrum for both notes these bars would be identical, because the roughness sum is symmetric; with two spectra they are not. The largest disagreement is at the octave, where one arrangement is 1.9 times rougher than the other with the same two notes in it.
Fig. 9 The asymmetry an octave below where it was measured, which is where the exception lives. With one spectrum for both notes these bars would be identical, because the roughness sum is symmetric; with two spectra they are not, and at C3 the largest disagreement is at the octave, where one arrangement is 1.9 times rougher than the other. Down here the violin’s fundamental and second partial sit under the body’s air resonance and its corpus modes, so much more of its spectrum is radiated and there is much more to coincide with — which is why the same pairing has five wells at C3, one at C4 and two at C5. Whether a duet has any smooth interval beyond the fifth is a fact about where it is playing.

The count for this one pairing goes five, one, two as the lower note rises from C3 to C4 to C5. Whether a duet has any smooth intervals at all beyond the fifth is a fact about where it is playing, and a scoring decision made at one register does not transfer to another.

That is a strong claim and it should be read with the model’s limits in mind, which the last section does. What survives the limits is the direction: a fixed filter and a moving note cannot produce a register-independent curve, whatever the filter is.

Which computation produced the numbers

The roughness of a pair of partials is Plomp and Levelt’s, in the form this site has used from the beginning: for two partials at frequencies a and b with amplitudes weighting the pair, the contribution falls off with the separation scaled by a critical bandwidth at the lower frequency. Nothing in that has changed.

What has changed is the two lists it runs over. The lower note’s partials are computed once, at its own frequency, through its own filter. The upper note’s partials are recomputed at every step of the sweep, because a fixed filter applied to a moving note gives a different spectrum at every point — that is the previous rung’s whole finding, and leaving it out would have produced a smooth curve that was wrong everywhere except at one pitch.

The well-finding is a windowed local-minimum search: a sample counts as a well if it is no higher than any of the twelve samples on either side of it, which at 360 steps to the octave is a window of forty cents. That is a weaker test than a prominence rule and it is what the census figure runs, so the counts here are counts of dips of any depth. It matters most where it is least visible — a pairing whose curve is nearly flat contributes wells that a prominence rule would refuse — and it is the reason the well counts should be read against each other rather than as a number of consonances.

The amplitudes are normalised so that each radiator’s strongest partial is 1. That choice matters and is not neutral: roughness is quadratic in amplitude, so an unnormalised comparison would report which instrument had been set louder. Normalising per instrument answers the question “which pairing is rougher at equal prominence”, which is the orchestration question. It does not answer “which pairing is rougher as actually balanced”, which needs a balance, and a balance is a decision rather than a measurement.

Whose music, and when

The claim that doubling at the octave sounds better one way round than the other is a claim about a repertoire, and it is a claim European orchestration made long before anybody computed anything. Rimsky-Korsakov’s Principles of Orchestration prescribes which instrument takes the upper note of a doubling and gives the reason as blend; Berlioz gives lists of good and bad combinations with no reason at all. The arithmetic here does not confirm those lists — several of them turn on carrying power and attack, which nothing above models — but it supplies a mechanism that has to be present in whatever the right explanation is.

The one place the result is testable against practice without any interpretation is the octave doubling, and there the tradition and the arithmetic agree: the standard advice is to put the richer, reedier instrument above and the simpler one below, and the computation says that arrangement is three to four times smoother.

Where it says nothing at all is any repertoire in which two instruments of the same family play together, which is most chamber music. Two violins are a symmetric duet again, and every figure in this rung collapses back to the one this site already had.

What the picture cannot show

The body model has four resonances and a real violin has hundreds. Between the four, the modelled response falls to a floor, which is why the violin’s partials above the third are so weak at middle C in the partial figure — weaker than a real instrument’s. Every violin result above therefore overstates how much the body removes, and the direction of the error is known even though its size is not.

The filters are static and instruments are not. A player’s dynamic changes the source spectrum, and on several of these instruments it changes it more than the filter does. Nothing here varies level at all.

Roughness is not consonance. Consonance is half learned, and the two models this site carries disagree about the other half, and roughness is the one that knows nothing about harmony, expectation or context. A pairing with fewer wells is not a worse duet; it is a duet whose smoothness is less determined by the interval.

The register sweep is over roots and not over intervals. Every census in this essay sweeps the upper note across one octave above a fixed lower note, so a “pairing at C3” means a lower note at C3 and an upper note anywhere from C3 to C4. A duet whose two players are three octaves apart — a piccolo over a bassoon, which is an ordinary orchestral texture — is outside every figure here, and the fixed filters guarantee it is a different curve again rather than an extrapolation of these.

And the well count is a count of a model’s features, not of anything heard. Whether a listener can tell that a clarinet-under-violin sixth is smoother than a violin-under-clarinet sixth is a listening question, and the prediction — a factor of five in a quantity whose relation to judgement is itself a model — is the kind that has been wrong before.

Where this ladder goes next

Five rungs. The first said a spectrum is a list of frequencies and strengths, with the relative timing of the partials discarded. The second and third found the filter — a mouth, then a body — and the fourth found that a fixed filter under a moving note makes the list a function of pitch. This one puts two such lists together and finds that the pair does not commute.

The rung after it is the one the asymmetry makes available and nothing here has taken. If an interval’s roughness depends on which instrument is underneath, then a chord of three different instruments has an assignment problem: six ways to distribute three players over three notes, with a roughness for each, and the same machinery that scored the seven intervals above can score all six. That is the orchestration question in its smallest complete form — not which chord, and not which voicing, but which player on which note — and it is a computation this collection can now run.

The rung after that is the one the register result points at from the other side: an assignment that is smooth at one pitch need not be smooth at another, so the answer is a function of where the chord sits as well as of who is in it. That is a surface rather than a ranking, and drawing a surface honestly is a harder problem than computing one.

Part 5 of 13

One essay in the series on spectrum. The essays either side of this one:

What links here

Essays that reach for this one mid-argument — the half of a link its own author cannot write down.

What this makes readable

Essays that declare this one a prerequisite.

The objects named here

The third way in, after the field and the series: the things themselves, and every essay that touches each one.

Critical bandwidthDissonance curveFormantOrchestrationPlomp–Levelt curveRoughnessSource-filterSpectral envelope