Perception and the listener

An attack time is not an attack

Eight earlier essays read a heard moment off an envelope, and every one of them used the same envelope shape without saying so: the source table records one curve for all nine of its families, and the map's own arithmetic does not carry the parameter at all. A published attack time fixes a ten-to-ninety time and nothing else. Under the two other shapes the same measurement admits, every millisecond computed so far doubles — and the constructed passage called inaudible earlier becomes three times a listener's threshold.

Assumes: Twelve violins are more punctual than one · A note is heard after it starts

There is a way of finding what a ladder has been assuming, and it is the closure criterion run backwards: look for the parameter every figure on it sets to the same value. On this anchor the answer is not a parameter anybody chose. It is one that was never offered.

Every heard moment on these nine rungs is a level crossing on a rising envelope. The level is discussed at length — three criteria, with three sources, drawn together on every figure so a reader can see how much of any claim survives the choice. The envelope is discussed nowhere. All nine families in the source table record the same curve; the map’s own arithmetic does not take a shape argument at all; and the word appears in exactly one figure call in the collection, where it names the default.

The assumption is that an instrument’s amplitude approaches its peak the way a resonator driven by a step does. That is a real physical model and it is right for some instruments. It is not what a published attack time says.

One attack time, three shapes, 48 ms of disagreement. Three amplitude envelopes with the same 90-millisecond attack time, which is the only quantity the published tables report. a resonator from a step rises as one minus a decaying exponential; an excitation ramping rises in a straight line; a ramp through a resonator is a raised cosine. Each is normalised so that its own 10-to-90 per cent rise takes exactly 90 milliseconds, so all three are the same measurement. The horizontal rules are the three criteria a heard moment is read off. At 6 dB below peak the three shapes put the heard moment at 28.5, 56.4, 76.3 milliseconds — a spread of 48, on one attack time, from a property nothing in the table records.
Fig. 1 Three envelopes with the same ninety-millisecond attack time, which is the only quantity the attack literature reports. Each is normalised so that its own ten-to-ninety per cent rise takes exactly ninety milliseconds, so all three are the same measurement of three different notes. At six decibels below peak — the criterion read at throughout — they put the heard moment at 28.5, 56.4 and 76.3 milliseconds.

What a measured attack time actually fixes

An attack time is a ten-to-ninety per cent rise: the interval between the instant the envelope reaches a tenth of its peak and the instant it reaches nine tenths. That is the convention the measurements are made under and it is the right one, because the two ends are robust to noise and to where a recording is judged to start.

It fixes one duration. It says nothing whatever about the shape of the curve joining those two points, and a great many curves join them.

Three are drawn above and they are not arbitrary. A resonator driven by a step approaches its peak as one minus a decaying exponential, which is what a pipe does when the air is turned on; that is the shape the whole ladder has used. A straight ramp is what an amplitude does when the excitation itself grows at a constant rate. A raised cosine is that ramp seen through a resonator, so it starts slowly, climbs, and eases in — which is what a driven system does when the drive is still increasing.

At the ten and ninety per cent marks the three are identical by construction. Between them they are nothing like each other, and this ladder does all of its work between them.

Which shape is right, and this collection already said

The interesting part is that the answer is not open. It is written down on a neighbouring ladder, in that ladder’s own words, about the very instrument whose lead is the largest in the map.

Read at two different heights is explaining why the two accounts of an onset disagree about the order of the instruments, and its explanation is this:

A bowed string reaches Helmholtz motion early and then keeps growing in level, because the amplitude is set by the bow speed and the bow is still accelerating.

An amplitude set by a quantity that is still increasing is not a resonator settling toward a fixed value. It is a ramp. The same is true of a sung note, where the amplitude follows the breath, and it is why both of those families sit at the slow end of the attack table in the first place — a bowed or sung attack is long because the excitation takes time to arrive, not because a resonance takes time to build.

A blown pipe is the other case and the exponential is right for it: the reed or the lip edge reaches its regime quickly and the standing wave then builds under a drive that is not changing. A struck or plucked string is at its peak before the question arises.

So the honest reading is mixed, and it is the reading the collection’s own accounts of these instruments imply. The families this ladder gives the longest attacks to are exactly the families whose shape the ladder has wrong.

There is a way to falsify that inference and it does not need an instrument at all. A resonator driven by a step has a rise time set by its own decay time, so an exponential attack should scale with the sharpness of the resonance and with nothing else — which is the identity the settling ladder opens with, where the wait in periods is the quality factor and no more. A ramped attack has no such relation: its duration is set by the player, so it varies with the dynamic, the articulation and the individual, and it does not track the instrument’s resonance. The published ranges say which is happening. A bowed violin’s attack runs from forty milliseconds to a hundred and eighty across ordinary playing — a factor of four and a half on an instrument whose resonances do not move — and a marimba’s runs from two to six. A quantity that varies four-fold with how it is played is a property of the excitation, and an excitation with a duration of its own is a ramp rather than a step.

The ordering survives and nothing else does

Before any map, it is worth being clear about what does not change, because it is the claim the anchor has actually leaned on.

Where the shape stops mattering, and it is not where these figures read. The heard moment as a multiple of the attack time, against the fraction of the peak it is read at, for 3 envelope shapes with the same 10-to-90 rise. Every curve is a straight multiple of the attack time, so no choice of shape can reorder the instruments — but the multiple itself differs by 5.3 times at 15 dB below peak, 2.7 at 6 dB below peak, and 1.29 at 90% of peak. The shapes converge only near the top of the envelope and cross at 92 per cent of the peak. So the criterion the settling figures read at is nearly blind to the shape and the one these figures read at doubles with it.
Fig. 2 The heard moment as a multiple of the attack time, against the fraction of the peak it is read at. Every curve is a straight multiple, so no choice of shape can reorder the instruments. The multiple itself differs by 5.3 times at fifteen decibels below peak, by 2.7 at six decibels below, and by 1.29 at ninety per cent — and the three shapes cross at 92 per cent of the peak.

Under every shape, the lag is a fixed multiple of the attack time. That is not obvious and it is checked here rather than assumed: it holds because each shape is a single curve rescaled in time, so reading it at a fixed fraction of its peak returns a fixed fraction of its duration.

The consequence is that an ordering cannot move. If a violin is heard after a trumpet under one shape it is heard after it under every shape, because both lags have been multiplied by the same number. Every claim on this anchor of the form this instrument is heard later than that one is safe, and so is every claim about which part of a scoring needs the largest lead.

What is not safe is any number in milliseconds, and this anchor is made of numbers in milliseconds. The multiple at six decibels below peak is 0.32 under the exponential and 0.63 under a ramp, so a violin’s lag is 28.5 milliseconds or 56.4 depending on a curve nobody recorded.

There is a second thing on that figure worth more than it looks. The three shapes converge near the top of the envelope and cross at 92 per cent of the peak — above the highest of the three criteria this ladder reads at, and essentially at the criterion the settling ladder uses. So the disagreement between the two ladders that the sixth rung of the onset anchor traced to their different reading heights has a second face: the height that ladder reads at is nearly blind to the shape, and the height this one reads at doubles with it. The ladder whose criterion was called arbitrary picked the robust one.

The map, redrawn four ways

The shape each family's excitation implies changes which part is latest. The earlier map of required leads, computed four ways from the same attack times. The open marks are the exponential rise every earlier figure has assumed; the others are a straight ramp and a raised cosine applied to every part; the filled mark is the mixed reading, in which a struck or blown family keeps the exponential and a bowed or sung one takes the raised cosine its own excitation implies. The map spans 31.5 milliseconds under the exponential and 66.8 under the mixed reading. The latest part changes from the piano, quiet to the violin, mezzo forte: one shape applied to everything is a common factor and cannot reorder anything, and giving the bowed family its own shape is not a common factor.
Fig. 3 The earlier four-part map, computed four ways from the same attack times. The open mark is the exponential; the two beside it are a ramp and a raised cosine applied to every part; the filled mark is the mixed reading, in which the struck and blown families keep the exponential and the bowed one takes the cosine its excitation implies. The map spans 31.5 milliseconds under the exponential and 66.9 under the mixed reading, and the latest part changes.

A single shape applied to everything multiplies the whole map by a constant: 31.5 milliseconds becomes 62.3 under a ramp and 84.4 under a cosine, and every part keeps its place. The mixed reading is not a constant, and under it the map changes its shape as well as its size.

The quiet low piano is the latest part under the exponential, at a lead of 31.5 milliseconds — not because a piano is slow but because its E1 has a hundred-millisecond floor put under it by its own period. Under the mixed reading the violin overtakes it, at 66.8 against 31.5, and the headline of that rung — the pitch floor can beat the instrument — is no longer what the four parts show.

That is a real change to a published result and it is worth being exact about its status. The mixed reading is an inference from what excites each family, not a measurement of any envelope. What the figure establishes is not that the violin is latest; it is that which part is latest is decided by a curve nobody has looked at, and that the collection’s own physics points the wrong way for the shape the ladder chose.

What it does to the constructed passage

The seventh rung is where the assumption is actually spent, and it is spent on a comparison with a threshold.

That rung built a passage to distinguish two kinds of ensemble: a scoring changes mid-phrase, and an ensemble that has learnt the new map applies it while an ensemble that is listening has to find it. The whole verdict was that the two sound the same, because the maps differ by less than the twenty milliseconds a listener needs to notice an asynchrony. The measurement is easy and the perception is impossible, it said, and called that an unusual and useful place for a question to sit.

The same experiment is inaudible under one shape and 3.1 times the threshold under another. How far two scorings' maps of required leads differ, computed under each envelope shape from the same attack times. The vertical rule is the twenty milliseconds a listener needs to notice an asynchrony in music, which is the number the earlier verdict turns on. Under the exponential every earlier figure has assumed, the difference is 14.2 milliseconds and is inaudible. Under a straight ramp it is 28.2, under a raised cosine 38.2, and under the mixed reading — the shape each family's own excitation implies — it is 62.1. 3 of the 4 readings put it above the threshold, so whether the constructed passage can be heard at all is a property of a curve nobody measured.
Fig. 4 Two lines handed from a string group to a wind group mid-phrase — the orchestral device asked for earlier — with the map change computed under each shape. Under the exponential it is 14.2 milliseconds and inaudible. Under a ramp it is 28.2, under a cosine 38.2, and under the mixed reading 62.1, which is three times what a listener needs.

The verdict was a property of the curve. Under three of the four readings the constructed passage is audible, and under the one the collection’s own account of a bow implies it is audible by a factor of three.

That changes what the experiment is. The seventh rung asked for a close microphone on every part and a millisecond-accurate onset extraction, because eleven milliseconds is invisible to a listener and easy for a machine. If the honest figure is sixty, then the difference between an ensemble that has learnt the map and one that is finding it is something a person in the hall can hear for three or four beats — and the experiment needs a listener rather than a laboratory.

It also means the two hypotheses are not the quiet distinction that rung described. A feedforward ensemble handed a scoring it has not learnt would be audibly ragged for the first bar of it, which is a thing musicians describe constantly and which nothing in that rung’s arithmetic could account for.

A struck note is safe, and that is the useful half

The size of the exposure is not the same everywhere, and where it is small it is very small.

One attack time, three shapes, 4 ms of disagreement. Three amplitude envelopes with the same 8-millisecond attack time, which is the only quantity the published tables report. a resonator from a step rises as one minus a decaying exponential; an excitation ramping rises in a straight line; a ramp through a resonator is a raised cosine. Each is normalised so that its own 10-to-90 per cent rise takes exactly 8 milliseconds, so all three are the same measurement. The horizontal rules are the three criteria a heard moment is read off. At 6 dB below peak the three shapes put the heard moment at 2.5, 5.0, 6.8 milliseconds — a spread of 4, on one attack time, from a property nothing in the table records.
Fig. 5 The same three shapes at a piano’s eight-millisecond attack. The ratios between them are exactly what they were — 2.0 and 2.7 — and the absolute disagreement is 4.3 milliseconds, a fifth of what a listener notices, where at ninety milliseconds it was 47.9. Everything here scales with the attack time, so the shape is a large uncertainty on a slow instrument and no uncertainty at all on a quick one.

That is worth stating as a rule, because it says which of the anchor’s results are exposed and which are not. The shape enters as a multiple of the attack time, so the milliseconds at stake are proportional to it. On a marimba at three milliseconds the three shapes disagree by under two milliseconds; on a sung vowel at a hundred and ten they disagree by fifty-nine. The same rule sorts the anchor’s own rungs: the ensemble spread of a gamelan, whose parts are all struck, is a number that cannot move, and the spread of a choir with an organ is a number that can double.

Every claim this ladder makes about struck and plucked instruments therefore survives intact, and those include the whole of the argument that a percussionist is the natural timekeeper of an ensemble. Every claim about bowed strings, voices and organ pipes carries a factor of two on it — and those are the claims the map is mostly made of, because a lead is a difference and the differences are dominated by the slow families.

Every criterion makes the lag proportional to the rise. The heard moment against the attack time, for the three criteria the literature supports. All three are straight lines through the origin, because each is a fixed fraction of the same envelope — so the criterion decides the slope and nothing else. At a 180 millisecond attack the three give 16 ms, 57 ms, 189 ms, a spread of a factor of 12. Every claim here is a difference between two instruments, and a difference is the same multiple of the same slope whichever line is taken.
Fig. 6 The other multiplicative constant, established earlier: the heard moment against the attack time, one line per criterion, all straight through the origin. The criterion has been drawn on every figure from the beginning, precisely so that a reader could see how much of a claim survives it. The shape is a second constant of exactly the same kind and it has been drawn on none of them.
The factor of sixty-nine, against the convention it was measured at. An earlier essay set the instrument's own settling time against the listener's placing delay on the five instruments both accounts hold, and reported that the ratio between them spans a factor of sixty-nine. This is that number against the settling criterion. At 0.9 it is 69.0, which is the published figure. At 0.178 — the fraction of the peak the perceptual detection criterion sits at — it is 5.9. At 0.05 it is 3.1. The listener's side of the comparison has a criterion too, and moving it cannot appear on this picture at all: it multiplies every one of the five ratios by one common factor and leaves their spread exactly where it was. The spread is a property of the settling criterion alone, and that criterion has no measurement behind it.
Fig. 7 The neighbouring account’s own criterion sweep, with the crossing points added to it: the factor by which the instrument’s account and the listener’s disagree, against the height the instrument’s side is read at. The two rightmost values are where the envelope shapes agree — 0.92 for a ramp and 0.96 for a cosine. That account reads at 0.9, which is the one place on the axis where the shape assumption costs nothing.

Which computation produced the numbers

Three envelope shapes, each defined by one curve and each normalised so that its ten-to-ninety per cent rise takes exactly the attack time the table reports. That normalisation is the load-bearing step and it is checked on every figure by reading the ten and ninety per cent crossings back off the drawn curve.

The heard moment is the first instant the envelope reaches the criterion, which for the exponential is a logarithm, for the ramp a proportion, and for the cosine an arc cosine. The lag as a multiple of the attack time is that quantity computed at a rise of one.

The map is the fifth rung’s own arithmetic — the larger of the family’s attack and the floor the note’s period imposes, shortened by the dynamic — with the final level crossing read off the stated shape rather than off the exponential. The mixed reading assigns the exponential to the struck and blown families and the raised cosine to the bowed and sung one.

The map change is the seventh rung’s quantity: two scorings, each map referred to its own earliest part, and the largest disagreement between corresponding parts.

Where the model stops

The three shapes are a choice and not a census. An envelope could be anything monotone between the ten and ninety per cent marks, and these are three plausible ones rather than the range of what an instrument does.

No envelope was measured. Every figure here is arithmetic on published attack times. The shapes themselves are inferences from what drives each family, and the whole rung is a request for one measurement rather than a result.

A real attack is not monotone. A bowed onset has slipping and a chiff, a blown one has a transient before the regime settles, and a note starts twice on this site’s own account of what a bowed string does. None of these curves has a bump in it.

The mixed reading assigns one shape per family. Within the bowed family a martelé stroke and a dolce one are different mechanisms, and the second is a ramp where the first is very nearly a step.

And the criterion is still one of three. Everything above is computed at six decibels below peak, which is the middle of the band. At the detection criterion the shapes disagree by a factor of five and at the perceptual attack criterion by a third, so the exposure is a function of both constants at once.

What the picture cannot show

It cannot show a level. Both constants multiply an attack time, so nothing here says anything about how loud a note is when it is first heard — which is what an absolute criterion is about and what the third rung turns on.

Nor can it show a listener. The shapes are physical curves; whether a listener places a note at a fixed fraction of any envelope is the standing assumption of the whole anchor and no figure here tests it.

It cannot show an ensemble. The map change above is a difference between two computed maps and not a spread of recorded onsets.

Nor can it show which instrument was measured. A published attack time is a mean over notes, players and dynamics, and a mean of curves of different shapes is not a curve of any shape.

It cannot show the room. A reverberant hall adds its own rise to every note, and a tail arriving during an attack lengthens it in a way that is neither of these shapes.

And it cannot show what the shapes do to a section. Fourteen players summed cross their own criterion at a moment that depends on the individual curve as well as on the scatter, and that arithmetic has been done for one shape only.

Whose instruments, and when

The attack times are twentieth-century laboratory measurements of orchestral playing, reported as ten-to-ninety per cent rise times because that is the convention for a rise time in every field that has one.

The convention is the point. It was chosen so that a duration could be reported robustly, by people measuring rise times of amplifiers and filters, where the shape is known from the circuit and only the duration is in question. Carried into instrument acoustics it keeps the robustness and loses the guarantee: nobody knows the circuit, and a single number that was designed to be independent of the curve turns out to be all anybody wrote down.

That is not a criticism of the measurements. It is a statement about what a reader of them is entitled to, and this anchor has been claiming more than it was given for nine rungs.

The historical shape of the gap is ordinary and it recurs. The perceptual attack literature and the instrument-acoustics literature grew up separately, and a quantity that is a summary in one is a premise in the other: an attack time is a convenient descriptor of a note to somebody cataloguing timbres, and it is the entire input to a model of when a note is heard. The same thing happened to the criterion, which a neighbouring ladder found carrying an argument after ten placements had left it at one value. Two constants, both inherited, both quietly deciding a result.

Where this ladder goes next

Nine rungs. A note is heard after it starts; an ensemble that mixes attack families carries a spread; the dynamic moves each attack; the pitch puts a floor under all of it; the three added for a scoring, as a map; the map found by an ensemble that was never told it; the passage that would separate a learnt map from a found one; the map scored for sections; and now the curve every one of them read the map off.

What is owed after this is one measurement, and it is smaller than anything the ladder has asked for before. The seventh rung wanted a constructed passage sight-read once by a chamber group with a microphone on every part. This wants the envelopes of ordinary orchestral notes — one bowed, one blown, one struck, at a stated dynamic — plotted rather than reduced to a number. Every study that reported an attack time had those curves on a screen and published the ten-to-ninety time from them. The recordings needed already exist in quantity, the analysis is an amplitude envelope and a curve fit, and the answer decides whether this anchor’s arithmetic is in milliseconds or in factors of two.

Part 9 of 9

One essay in the series on Perceptual-centre. The essays either side of this one:

What links here

Essays that reach for this one mid-argument — the half of a link its own author cannot write down.

The objects named here

The third way in, after the field and the series: the things themselves, and every essay that touches each one.

Attack transientEnsemble asynchronyEnvelopeInferenceOnsetPerceptual-centreTransient