Acoustics & Music Theory
why it sounds like that
Concept

Onset — where it appears

The moment at which a note begins, which is the event a rhythm is a pattern of. Two onsets closer together than about twenty milliseconds are not heard as two events, which puts a bound on how complex a cross-rhythm can be.

Named by 18 essays across 5 fields — each of them below, with the objects they name alongside it.

Three envelopes. How loudness changes over the life of a note, for plucked, bowed and struck. Remove the attack from a recorded piano and it stops sounding like a piano, which is the shortest demonstration that the envelope carries as much identity as the spectrum.

The shape of a note, which is most of what an instrument is

Cut the first fifty milliseconds off a recorded piano and listeners stop calling it a piano. The attack carries more identity than the steady tone it leads into, and it is the part every spectrum plot leaves out.

timbre · Envelope Three attacks, the first 50 ms. How loudness changes over the life of a note, for plucked, bowed and struck, drawn over the first 50 milliseconds. By the right-hand edge the plucked note is at 91%, the bowed note is at 36%, the struck note is at 97% — attack times of 4 ms, 140 ms, 2 ms, a spread of 70 to one, and the part a listener uses to tell them apart. Remove the attack from a recorded piano and it stops sounding like a piano, which is the shortest demonstration that the envelope carries as much identity as the spectrum.

The first fifty milliseconds

A spectrum is supposed to be what makes a trumpet a trumpet. Cut the first fifty milliseconds off a recorded note and listeners stop being able to name the instrument — while the spectrum they are hearing is unchanged. Identity is in the part of the sound that ends before the note has properly started.

timbre · Envelope What a spread costs a chord. a major triad of 3 notes lasting 600 ms each, with the onsets spread by up to 320 ms. The upper line is the share of each note's length during which every note is sounding; the lower is the chord's roughness weighted by that share, since roughness is a property of two partials sounding at the same time. At a spread of 30 ms — the asynchrony at which a mistimed partial stops belonging to its note — the chord is still 89 per cent simultaneous. It stops being simultaneous at all at 300 ms, which is where the last note arrives after the first has finished.

The chord that is not played at once

Every chord until now starts its notes at the same instant, and no figure ever set the asynchrony to anything else. A spread chord is not a defective simultaneity: at forty milliseconds a triad of half-second notes is still eighty-seven per cent simultaneous, so it carries almost all its roughness, and it stops being a chord at all only when the last note arrives after the first has finished. What none of this can explain is the one thing every keyboard player knows — that a chord is rolled upward. The masking asymmetry that ought to explain it is 2.4 decibels at a close voicing, which is not enough.

intervals · The triad One envelope, and the three places a listener might be said to hear it. The amplitude envelope of a note with a 90 millisecond exponential attack, with the three criteria the literature offers drawn across it. The heard moment is 8.0 ms at the detection criterion, 28 ms at the perceptual-onset criterion and 94 ms at the perceptual-attack criterion. The physical onset is at zero on this axis and no criterion puts the heard moment there. The buttons play this attack against a two-millisecond one, started at the same instant.

A note is heard after it starts

Every rhythm essay until now has treated a note's onset as the moment it happens. It is not: the instant a listener aligns a note with a beat is later than its physical start by an amount the note's own attack decides, and for a sung or bowed note that amount is about thirty milliseconds — the size of the whole quantity six essays on microtiming set out to measure.

rhythm · Perceptual-centre Which ensembles have this problem and which do not. The width of the heard-moment spread built into 7 standard instrumentations, before any player does anything. An ensemble drawn from one attack family has a spread of zero — every note is heard the same distance after it is started, so a common onset is a common heard moment, and this is true of a string quartet and of a gamelan for the same reason and in the same amount. A mixed ensemble carries between 11 and 33 milliseconds of it.

The players who have to be early

Ensembles have been measured for fifty years and found to be about forty milliseconds out of alignment, which has always been reported as the limit of human precision. Part of it is not: an ensemble that mixes attack families carries a heard-moment spread of ten to thirty-three milliseconds before anybody plays a note, and an ensemble drawn from one family carries none at all — which is true of a string quartet and of a gamelan for the same reason.

instruments · Perceptual-centre How much earlier an accent is heard, by mechanism. An accented note on an instrument with a 90 millisecond attack, drawn against how many decibels louder it is, with the three ways it can arrive early separated. A criterion tied to the note's own peak on an unchanging envelope gives exactly nothing. The same criterion on the shorter rise a harder-driven instrument has gives 5.3 milliseconds at 12 decibels. A criterion at a fixed level gives 23.0. Both together give 24.0, and the rise at that dynamic is 73 milliseconds rather than 90. The rise-shortening exponent is stipulated at 0.15 rather than measured, and the two upper curves would separate further if it were smaller.

Playing louder is playing earlier

An accent has two effects on when its note is heard and neither is a timing decision. A harder-driven instrument has a shorter attack, and a criterion set by the surrounding music is crossed sooner by a bigger rise — so a twelve-decibel accent on a bowed note is heard twenty-four milliseconds early with no change whatever in when the bow was put down. It is also the measurement that tells the two competing models apart.

perception · Perceptual-centre The heard moment against the pitch, on an instrument whose own attack is 8 ms. A note cannot establish an amplitude in less than 4 of its own cycles, so the attack has a floor of 4 periods — 145 milliseconds at A0 and 1.9 at C7. Below A4 the floor is longer than the instrument's own attack and the pitch decides the heard moment; above it the instrument does. The lag runs from 46.0 milliseconds at the bottom to 2.5 at the top, a spread of 44 milliseconds that no player can play their way out of.

A low note cannot start on time

Three earlier essays have held the pitch at one value. A note cannot establish an amplitude in less than a few of its own cycles, so the attack has a floor that rises as the pitch falls — 146 milliseconds at the bottom of a piano and three at the top. On an instrument whose action takes eight milliseconds everywhere, that is a forty-three millisecond spread across the keyboard from the period alone, and no player can do anything about it.

rhythm · Perceptual-centre Which notes of a scored chord have to be played early. Four parts of one chord, each with its own instrument, its own pitch and its own dynamic, and the perceptual centre that comes out of all three. piano, sforzando on E1: an attack family of 8 milliseconds against a pitch floor of 97, so the pitch is what limits it, shortened by the dynamic to 65, heard 20.5 after it starts and needing to be played 12.0 early; flute, quiet on A5: an attack family of 60 milliseconds against a pitch floor of 5, so the instrument is, shortened by the dynamic to 69, heard 21.8 after it starts and needing to be played 13.2 early; violin, mezzo forte on E4: an attack family of 90 milliseconds against a pitch floor of 12, so the instrument is, shortened by the dynamic to 90, heard 28.5 after it starts and needing to be played 19.9 early; trumpet, forte on A3: an attack family of 30 milliseconds against a pitch floor of 18, so the instrument is, shortened by the dynamic to 27, heard 8.6 after it starts and needing to be played 0.0 early. The spread is 19.9 milliseconds, which is well above the two or three a listener resolves, so a conductor asking for these four to sound together is asking for four different physical onsets.

Which notes have to be played early

There are three separate contributions to one quantity — the instrument's attack family, the dynamic it is played at, and the note's own period — and every figure so far varies one and holds the others. Added together for a real scoring they do not add: a sforzando low piano note is pitch-limited to a hundred-millisecond attack and the sforzando shortens it back to sixty-five, so flattening the dynamics makes the ensemble's spread larger rather than smaller.

rhythm · Perceptual-centre Settling and being heard are not the same quantity. Across, how long the instrument takes to reach its steady amplitude, computed from its own physics — a resonance's Q, a bow's capture, an exciter's contact. Up, how long after its physical onset a listener places the note, computed from the measured shape of its envelope. Five instruments both accounts hold. The diagonal is where they would agree and nothing is on it. The ratio between them runs from 0.10 to 6.6, a factor of 69, and it sorts perfectly by mechanism: about 6.6 for a struck or plucked string, 2.2 for a bowed one, and about 0.15 for a wind. Ordering the five by each measure changes the place of 3 of them, and the one that moves furthest is the violin — third slowest to settle and the last to be heard.

A note starts twice

One account computes how long an instrument takes to settle, from its own physics. Another computes how long after its onset a listener places a note, from the shape of its envelope. Both come out in milliseconds and neither has ever been shown the other. Paired on the five instruments they share, the ratio between them spans a factor of sixty-nine and sorts perfectly by mechanism — and the violin is third slowest to settle and the last to be heard.

rhythm · Onset time The cue that settles it. Every spectrum to hand, arbitrated by the earlier competition and then again with the onset cue added at equal weight. 3 of the 5 change their verdict, and all 3 change the same way — from splitting into two streams to staying as one: a piano string, a bell, a bar. Nothing changes the other way, because the onset cue on a struck source votes for fusion on every partial and can only ever push toward one stream. The bell is the case worth naming: its partials are wildly inharmonic and it is heard as one sound, which is a fact the harmonicity cue alone cannot produce.

The cue that settles it

Arbitrating between two grouping cues meant sweeping an exchange rate nobody could supply. The cue it had no term for at all is the one every account calls strongest, and its strength is computable: a struck string's partials start together to within a tenth of a millisecond against a threshold of twenty. Put that into the competition and three of five verdicts change, all the same way — and a bell becomes one sound.

perception · Auditory scene The passage that separates them, and a listener cannot hear it. A scoring changes at the halfway bar, and the two maps of required leads differ by 18.1 milliseconds at their widest. An ensemble that has internalised the map applies the new one on the first note of it and its spread never leaves zero. An ensemble that is listening to each other has to re-converge: its spread jumps to 11.8 milliseconds and takes 3 beats to get back under 5. The dashed line is twenty milliseconds, which is what a listener notices — and the disagreement never reaches it. So the two accounts are separable on a recording and very nearly not separable by ear, which is why nobody has noticed the distinction and why the measurement is worth making.

The passage that separates two players

An ensemble that has learnt where the asynchronies are applies them; one that is listening discovers them. In steady state the two are identical, which is why nobody has separated them. Change the scoring mid-phrase and they are not: one ensemble is wrong by twelve milliseconds for three beats and the other is not wrong at all — and twelve milliseconds is under what a listener notices and far above what a microphone resolves.

rhythm · Perceptual-centre A clarinet's partials, each on its own resonance. The 8 partials of the clarinet's chalumeau D that ride an impedance peak, each building toward its steady amplitude as 1 − exp(−t/τ) with τ = Q/πf from that peak's own Q. The time constants run from 11.9 milliseconds to 64.5, so the partials do not arrive at different times — they all begin the instant the reed does — and what differs is how fast each approaches its final level. The horizontal bars are how far apart the first and last are at three criteria: 5.5 ms at 10 per cent, 36.4 ms at 50 per cent, 121.0 ms at 90 per cent. A twenty-millisecond asynchrony is the threshold for hearing a partial out of a note, and this note crosses it at 32 per cent of steady amplitude — so whether a blown note's onset cue is unanimous or divided is decided entirely by how far along a partial has to be before it counts as having started.

A blown note does not start late, it starts slowly

Computing the onset cue removed a free parameter and turned out to be unanimous, and it predicted that a wind instrument would put it back, because a blown note's partials arrive over tens of milliseconds. They do — 121 on a clarinet — and it is not an asynchrony: every partial begins the instant the reed does and they differ in rate, not in time. Read at a tenth of the steady amplitude the spread is 5.5 milliseconds against a threshold of twenty, so the cue is still unanimous, and the missing number is no longer the exchange rate but the criterion.

perception · Auditory scene What a slow start costs a trumpet, in its own settling time. The amplitude of a trumpet's A4 resonance — the 4th impedance peak, of Q 37, time constant 27.1 milliseconds — driven from rest by a pressure that rises over 10, 40, 80, 140 milliseconds, against the step every earlier figure has assumed. The step reaches 90 per cent of its final amplitude in 62.5 milliseconds. A ramp of 140 takes 157.8, which is 95.3 more — and that excess is 68 per cent of the ramp's own length. Across the whole range a player works in the excess is a little over half the ramp: 0.52, 0.56, 0.61, 0.68 at 10, 40, 80, 140 milliseconds. So the tongued attack is not something added to the note. It is the step, which is what has been computed all along, and what has a price is its absence.

What the tongue actually removes

The question this essay was written against asked for an impulse: a tongued attack, a martelé stroke and a struck key all deliver one before the steady drive begins. The arithmetic refuses the framing. A tongue release does carry energy at the note's own frequency, and it is worth 0.17 milliseconds on a trumpet against a settling time of 62 — capped at about 1.13 over the resonance's Q. What articulation is worth is the ramp it removes, and that is about half the ramp's own length: 44 milliseconds, and very nearly the same 44 on every wind instrument in the collection.

rhythm · Onset time The census with the criterion moved under it. Every instrument's speaking time in milliseconds, against the fraction of the steady amplitude counted as speaking. The criterion is in the wind instruments alone: a resonance takes −ln(1−p)·Q/(πf) to reach a fraction p, so those lines rise across the whole picture, while a bow's capture and an exciter's contact contain no criterion at all and are flat. Every earlier figure sits at 0.9, where the wind instruments are the slowest things in the collection by a factor of 20.5. At 0.05 they are the fastest: a violin's G3 string is the slowest at 15.5 milliseconds and a trumpet takes 1.4. The three clusters cross at a criterion between 0.18 and 0.39, which is inside the range the perceptual measurements work in — their three named criteria are 15 decibels below peak, 6 decibels below peak, and ninety per cent — and the settling figures have only ever used the third of them.

Read at two different heights

Ten placements of these figures, one value: the settling criterion is nine tenths in every one of them, and nothing is measured behind it. It is a multiplicative constant only inside the mechanism that has it — a bow's capture and an exciter's contact contain no criterion at all — so moving it rescales one of three clusters against two that stand still. The most-quoted number here, a factor of sixty-nine between the instrument's account and the listener's, is 5.9 at the criterion the listener's own measurements use, and the ordering an earlier essay was written about does not exist below a fifth.

perception · Onset time An entering part is worth 0.9 phons, in the middle of its range. A texture of 5 parts at 62 decibels each, with one more part added at the same level, tried at every semitone from C2 to C7. The vertical axis is what the addition is worth in phons, and a phon is a decibel here; the shaded strip is the difference limen for loudness, so an entry inside it is not heard as a change of level. The median entry is 0.89 phons and only 29 of 61 clear the limen — the lowest of them at A♭4, 415 hertz. The best available, at B♭6, is worth 4.2. The two lines are the two loudness models to hand: they agree everywhere above the tenor register and part company below it, where the greedy critical-band grouping reports 24 entries that make the texture quieter and the excitation pattern reports none.

A part entering is not a change of level

Five earlier essays measure a sonority that is already sounding. The one thing an orchestrator actually controls is the entry, and priced at every semitone it comes to 0.89 phons — under the difference limen — with only 29 of 61 available entries clearing it and none below A♭4. What an entry is instead is an object arriving, and the reason is that its own rise time is faster than the listener's.

perception · Loudness 14 players summed, against the one at their average onset. Each thin line is one player's rising envelope, started at its own moment, with a spread of 30 milliseconds about the beat and a 90-millisecond attack. The heavy line is the section: nominally identical sources add incoherently, so their powers add and the sum is the root of the mean of their squares, drawn here as a fraction of the section's own peak. The dashed line is the single player who started at the section's average onset. The section reaches the 6 dB below peak criterion at 18.1 milliseconds and that player at 27.6, a difference of 9.5. The section is early because the players who started first are already sounding while the average one is still building, and nothing a late player does can make the sum quieter.

Twelve violins are more punctual than one

Every essay until now treats a part as one player, and an orchestral part is a dozen. Sectioning does two things at once and only one of them was expected: it pulls the part's heard moment forward, by four milliseconds against a map spanning twenty-six, and it makes the part's arrival more accurate by very nearly the root of the number of players. So the map of required leads applies to an orchestra better than it applies to a quartet, and the case where it fails is three trumpets rather than fourteen violins.

rhythm · Perceptual-centre One attack time, three shapes, 48 ms of disagreement. Three amplitude envelopes with the same 90-millisecond attack time, which is the only quantity the published tables report. a resonator from a step rises as one minus a decaying exponential; an excitation ramping rises in a straight line; a ramp through a resonator is a raised cosine. Each is normalised so that its own 10-to-90 per cent rise takes exactly 90 milliseconds, so all three are the same measurement. The horizontal rules are the three criteria a heard moment is read off. At 6 dB below peak the three shapes put the heard moment at 28.5, 56.4, 76.3 milliseconds — a spread of 48, on one attack time, from a property nothing in the table records.

An attack time is not an attack

Eight earlier essays read a heard moment off an envelope, and every one of them used the same envelope shape without saying so: the source table records one curve for all nine of its families, and the map's own arithmetic does not carry the parameter at all. A published attack time fixes a ten-to-ninety time and nothing else. Under the two other shapes the same measurement admits, every millisecond computed so far doubles — and the constructed passage called inaudible earlier becomes three times a listener's threshold.

perception · Perceptual-centre The attack is the balance dial, turned by the clock. The level of a violin against a clarinet on one note at 392 hertz, moment by moment through the attack, with both players starting together. Two envelopes rising at different rates are a balance, so this axis is the same dial a conductor turns — and its whole travel is 6.02 decibels, which is twenty times the log of the ratio of the two attack times, 45 against 90 milliseconds, and nothing else. The pair does not begin as one player alone: both envelopes leave zero at the same slope ratio, so the dial starts at a finite offset rather than at silence. The dashed line is the balance at which the composite changes owner, -3.48 decibels — inside the travel, so the note belongs to a clarinet for its first 29 milliseconds and to a violin for the rest of its life.

The blend arrives before the note does

Nine essays on spectrum draw a steady state, and the strongest cue that two instruments are two instruments is that they do not start together. Two envelopes rising at different rates turn out to be a balance — the same dial an earlier essay swept — so the attack is that dial moved by the clock, and its whole travel is fixed at twenty times the log of the two attack times. It is six decibels for a clarinet with a violin against a crossing twelve to twenty-two decibels out, so one pair in ten changes hands during its own attack, and which one depends on a convention rather than on the instruments.

timbre · Spectrum

Named alongside it

The objects these essays reach for when they reach for this one.

Attack transientPerceptual-centreEnsemble asynchronyEnvelopeTiming deviationTransientOrchestrationQuality factorDynamicsEnsemble timingFusionHelmholtz motion

All concepts