Perception and the listener

A bowed bass line is placed by its entrance; a violin line by every note

A listener whose ears differ slightly places a note by its onset, and a bowed entrance is placed as though it were far quieter than it is. A legato line's later notes do not start from silence. Whether one of them has an onset at all depends on how much of the note before is already in its own auditory filter — and in the bass, where the filters are wide and their lower skirts shallow, a step of a tone or less has none, so the note keeps the entrance's displacement. In the treble nearly every note has its own onset and is placed near its steady position, except where the line leaps down.

Assumes: A bowed note is placed as if it were quieter · One sound hides another, and it hides upward

A bowed note is placed as if it were quieter gave the listener of a quiet bass is further off-centre than a loud violin, whose ears differ by two decibels in sensitivity, and asked where it hears each note, on the understanding that the first wavefront wins: a listener takes a sound’s direction from its onset. The worse ear is later to report a quiet sound than a loud one, by the brainstem latency law, and a delay between the ears is one of the two numbers direction is computed from, so a note’s position is displaced toward the better ear by an amount that depends on how loud it is while its onset is being read. A plucked note reaches its dynamic before that reading is over and is placed almost where a steady tone would be. A bowed note is still near the threshold of hearing throughout it, and a bowed G on the double bass at 60 decibels is displaced 6.2 detectable steps, as far as a steady tone 27 decibels quieter would be.

Every note in that essay started from silence. It ended by pointing out that most notes in music do not. A legato line’s second note begins while the first is still sounding, often at the same dynamic, and whether it is heard to begin at all — whether the rule that places a sound by its onset fires on a change of pitch within a sound, or only on a sound starting from nothing — decides whether a bowed melody keeps its entrance’s displacement or is displaced again at every bow change.

The answer turns on a quantity these essays have already computed for a different purpose, and it divides the orchestra by register. In the bass, a bowed step of about a tone or less has no onset of its own, and the note keeps the position its predecessor had. In the treble nearly every note has an onset and is placed near its steady position, except where the line leaps down.

In the bass a bowed step keeps the entrance's displacement; in the treble every note is placed afreshA listener whose ears differ by 2 dB, with 14 per cent of the brainstem latency difference reaching the delay comparator: how far the second note of a bowed legato pair at 60 dB is displaced, in detectable steps of 15 µs, against the interval it moves by, in three registers. A note with no onset of its own keeps the first note's position, drawn at the entrance's displacement; the dotted lines are each register's entrance from silence and the dashed its steady tone. G2, a double bass (entrance 6.16, steady 4.00): -12 6.19, -7 5.02, -4 4.35, -2 4.06, -1 no onset, +1 no onset, +2 no onset, +4 4.08, +7 4.26, +12 4.53. A4, a violin (entrance 3.73, steady 2.15): -12 3.72, -7 3.56, -4 2.82, -2 2.35, -1 2.19, +1 2.15, +2 2.22, +4 2.39, +7 2.67, +12 3.07. A6, a violin's top (entrance 2.13, steady 1.21): -12 2.13, -7 2.13, -4 1.77, -2 1.40, -1 1.26, +1 1.22, +2 1.29, +4 1.43, +7 1.66, +12 1.93. At the dial's up 2 semitones: G2 no onset, keeps 6.16; A4 2.22; A6 1.29.G2, a double bassA4, a violinA6, a violin's toppale dots: no onset of its owndotted: an entrance from silencedashed: a steady tone-12-10-8-6-4-20+2+4+6+8+10+120.01.02.03.04.05.06.0the second note, semitones from the firstdisplacement, detectable steps
Fig. 1 How far the second note of a bowed legato pair at 60 dB is displaced, in detectable steps, against the interval it moves by, for a listener whose ears differ by 2 dB, on the double bass’s G2, a violin’s A4 and its A6. Pale dots mark notes with no onset of their own, which keep the first note’s position. On G2 an interval from a semitone down to a tone up has no onset; a fifth up is displaced 4.3 steps, near the steady tone’s 4.0; an octave down 6.2, the entrance’s full displacement. On A4 every interval of a semitone or more has an onset. The dial sets the interval.

An onset is a rise in the note’s own filter

The ear does not hear a note’s onset in the pressure wave as a whole. It hears it in the auditory filters that the note’s energy falls in, and a new note at a new pitch is a new event in the filter centred on that pitch. What the filter held before the change is the only baseline it has.

So the question is how much of the first note is already in the second note’s filter. Before the change, that filter carries the first note attenuated by the filter’s skirt at the distance between the two pitches. Over the change the first note fades as the second rises, each over the articulation’s rise time — a tenth of a second for a bow, one of the stated rises that an attack time is not an attack showed is a curve rather than a number — and the filter’s level moves from the first note’s leakage to the second note’s full level. The second note has an onset of its own if that movement is a rise of more than about a decibel, the size of level change a listener can detect. If the leakage is below the threshold of hearing, the rise starts from the threshold, and the second note is exactly the earlier essay’s entrance from silence.

If there is an onset, the note is placed as the earlier essay placed one: the interaural offset the latency law gives at the filter’s level, weighted over the few milliseconds after the onset. If there is not, a listener that takes direction from onsets has nothing new to take it from, and the note stays where the line already was.

The first note’s leakage, above and below

A note below leaks into the next note's filter more than a note above. How loud the first note of a legato pair already is in the auditory filter at the second note's pitch, in decibels relative to the second note's own level of 60 dB, against the interval between them, through the level-dependent roex filter at the double bass's G2 and the violin's A4. The grey band is the decibel the level must rise by for the second note to have an onset of its own. G2, a double bass: -12 -37.4 dB, -7 -15.9 dB, -4 -6.6 dB, -2 -2.2 dB, +2 -0.9 dB, +4 -2.6 dB, +7 -5.2 dB, +12 -9.2 dB. A4, a violin: -12 -91.8 dB, -7 -41.6 dB, -4 -18.9 dB, -2 -7.0 dB, +2 -3.2 dB, +4 -8.0 dB, +7 -15.2 dB, +12 -25.3 dB. At 60 dB the filter's lower skirt is shallower than its upper, so an ascending step — the first note below the second — leaves more of the first note in the second's filter than a descending one.
Fig. 2 How loud the first note of a legato pair already is in the auditory filter at the second note’s pitch, relative to the second note’s own level of 60 dB, against the interval, at G2 and A4. At G2 a first note a tone below is 0.9 dB down in the second’s filter and a tone above 2.2 dB down; an octave below 9.2 dB and an octave above 37.4 dB. At A4 the same figures are 3.2, 7.0, 25.3 and 91.8. The band is the decibel of rise an onset needs.

The leakage has two features, and each does its own work.

The first is register. An auditory filter is roughly a constant number of hertz wide at low frequencies and a constant fraction of its centre at high ones, so measured in semitones it is very wide in the bass and narrow in the treble. At G2, 98 hertz, a note a tone away is within a decibel or two of full strength in the filter; at A4 it is three to seven decibels down; at A6 further again. So a small step in the bass barely changes what the second note’s filter hears, and the same step on the violin changes it by several decibels.

The second is direction. At a moderate or loud level the filter’s lower skirt is shallower than its upper — the arithmetic behind one sound hides another, and it hides upward, and the reason a loud chord is a smaller chord — so a note below leaks into a filter more than a note the same distance above. At G2 an octave below is only 9 decibels down in the second note’s filter; an octave above is 37 down. That asymmetry, which these essays have always met as masking, reappears here as a statement about onsets: a line that steps up leaves more of itself in the next note’s filter than a line that steps down, so ascending notes are less of an event than descending ones.

The first figure shows both. On G2 the intervals with no onset run from a semitone down to a tone up — lopsided toward ascending. Beyond them the curve rises toward the entrance’s displacement much faster on the descending side, because a descending leap leaves the new filter nearly empty: an octave down on the double bass is placed 6.2 steps off, a full entrance, while an octave up is 4.5. On the violin every interval has an onset, and even so the pattern is the same: an octave down is 3.7 steps, the entrance, and an octave up 3.1.

Why a tone is small in the bass and large in the treble

The width that matters can be stated in the units a player uses. An auditory filter’s equivalent rectangular bandwidth is about 35 hertz at G2 and 72 at A4, and 215 at A6. In hertz the bass filter is the narrowest of the three. In semitones it is by far the widest: 35 hertz around 98 spans more than six semitones, 72 around 440 under three, and 215 around 1,760 two. A step of a tone moves a bass note a third of the way across its own filter and a violin’s A4 more than two-thirds of the way.

That is why the pattern is a pattern of register rather than of instrument. A cello playing in its tenor register behaves like the violin here, and a violin’s lowest string behaves more like the viola’s than like its own top. What decides whether a step is an event is how many hertz it moves the note against how many hertz wide the ear’s filter is at that pitch, and below a few hundred hertz the filter’s width stops shrinking as the pitch falls while the step’s width in hertz keeps shrinking.

The consequence for a line is simple to state and a little surprising to hear stated. The lower a legato line lies, the fewer onsets it has, and the fewer chances a listener who places sounds by their onsets has to correct where it hears it.

Two lines, note by note

A bowed bass line carries its entrance through its steps; a violin line is re-placed at every note. Two bowed legato lines at 60 dB, each rising by step, falling by a sixth and an octave's worth and climbing back, heard by a listener whose ears differ by 2 dB: each note's displacement in detectable steps, a pale dot where the note has no onset of its own and keeps the position before it. a double-bass line: G2 6.16, A2 3.81, B2 3.64, C3 3.64 (kept), D3 3.39, G2 5.02, D2 4.94, E2 4.94 (kept), G2 4.03. a violin line: A4 3.73, B4 2.12, C5 2.00, D5 1.98, E5 1.90, A4 3.56, E4 3.34, F4 3.34 (kept), G4 2.32. The bass line's first note is placed as an entrance; its steps up are placed near the steady tone, a semitone step keeps what the note before had, and its leaps down are placed afresh, nearly as far as an entrance. The violin line's notes each have an onset and sit near the violin's steady tone except where it leaps down.
Fig. 3 Two bowed legato lines at 60 dB — each rising by step, falling back and dropping further, then climbing again — each note’s displacement in detectable steps, with pale dots where the note has no onset and keeps the position before it. The bass line enters at 6.2, is re-placed near 3.6–3.8 by its steps up, keeps 3.6 over a semitone step, is displaced to 5.0 by its leap down and keeps 4.9 over a tone up. The violin line enters at 3.7, sits near 2.0 through its steps, and goes back to 3.6 at its leap down.

Put into lines, the pattern becomes something a listener could notice. The double-bass line enters on G2 at 6.2 steps — the bowed entrance of the earlier essay. Its step up to A2 is an onset, from a filter already holding most of the G, so A2 is placed at 3.8, close to the steady tone. B2 is placed at 3.6. The semitone step to C3 has no onset at all, and C3 keeps B2’s 3.6. D3 is 3.4. Then the line leaps down a fifth to G2, which is an entrance in all but name — the D’s energy is far up the new filter’s steep upper skirt — and it is placed at 5.0. D2 below it at 4.9. The tone up to E2 has no onset and E2 keeps D2’s position. The final G2 is placed at 4.0.

The violin line enters at 3.7 on A4, and its steps are placed between 1.9 and 2.1, near the violin’s steady-tone position of 2.1. Its drop of a fifth to A4 goes back to 3.6, nearly the entrance. Then it falls a fourth to E4, placed at 3.3, and steps a semitone up to F4 — the one violin note in either line with no onset, because at 349 hertz a semitone is still inside the filter’s shallow lower skirt — so F4 keeps E4’s 3.3, and the line returns toward 2 only at G4.

So a bowed bass line and a bowed violin line are heard differently in the one respect the earlier essay was about. The violin’s line is placed almost note by note, and a listener with asymmetric ears hears it close to where a steady tone would be, apart from the notes that follow a downward leap. The bass line is placed in stretches, and each stretch is placed by its first note — its entrance or the note after its last leap down. Where that first note was displaced a long way, the stretch after it inherits the displacement for as long as it moves by small steps.

Separate bows put every note back at the entrance

The comparison that makes the inheritance visible is the same line played with separate strokes and a small gap between them. Then every note begins from silence in its own filter, and every note is an entrance: the double-bass line’s notes would be placed between 5.5 and 6.5 steps, averaging 6.0, and the violin line’s between 3.2 and 4.2, averaging 3.7. Played legato, the bass line averages 4.4 steps over its nine notes and the violin line 2.7.

So legato playing, for this listener, pulls a line toward its steady position in both registers, and in the treble it does so at every note. In the bass it does so only at the notes that are onsets, and a note that is not an onset carries whatever the note before it carried — which, straight after the entrance or a leap down, is most of an entrance’s displacement. The same bowing is a correction in the treble and, over the bass’s short steps, a way of preserving an error.

A forte makes the ascending line one stretch

In the bass, whether a step is an onset depends on the dynamic. The second note of a bowed legato pair on the double bass's G2, displaced in detectable steps against the dynamic, for a step and a fifth, up and down; a pale dot where the note has no onset of its own and keeps the entrance's position. up 2 semitones: 40 dB 5.68, 50 dB 4.75, 60 dB kept 6.16, 70 dB kept 5.64, 80 dB kept 5.01, 90 dB kept 4.36. down 2 semitones: 40 dB 5.60, 50 dB 4.77, 60 dB 4.06, 70 dB 3.45, 80 dB 2.94, 90 dB 2.50. up 7 semitones: 40 dB 6.72, 50 dB 5.37, 60 dB 4.26, 70 dB 3.41, 80 dB kept 5.01, 90 dB kept 4.36. down 7 semitones: 40 dB 6.72, 50 dB 5.89, 60 dB 5.02, 70 dB 4.27, 80 dB 3.64, 90 dB 3.10.
Fig. 4 The second note of a bowed pair on G2, displaced in detectable steps against the dynamic, for a tone and a fifth, up and down; pale dots where the note has no onset and keeps the entrance’s position. A tone up has an onset at 40 and 50 dB and none from 60; a fifth up has an onset to 70 dB and none at 80 or 90. Descending intervals have an onset at every dynamic.

The lower skirt’s shallowness grows with level, so the dynamic moves the boundary. At 40 and 50 decibels even a tone up in the bass has an onset of its own, placed at 5.7 and 4.8 steps. From 60 decibels it has none. At 80 and 90 decibels, a fifth up has none either: the first note fills the fifth above it within a decibel. Descending intervals keep their onsets at every dynamic, because the upper skirt does not shallow.

So at a forte an ascending bowed bass line is, as far as its onsets go, one note. A rising line from the bottom of the double bass to a fifth above it gives a listener who places sounds by their onsets exactly one onset to place it by, the first, and every note after it is heard where the first was heard. A falling line at the same dynamic gives an onset at every note. A listener with slightly asymmetric ears would hear a rising bass line at forte as fixed at the displacement of its entrance, and a falling one as drifting toward the steady position note by note.

What counts as an onset

The one number in the argument that is chosen rather than computed is the rise that counts as an onset. A decibel is about the smallest change in level a listener detects in a steady sound, and it has been used throughout. It is not known that the mechanism that places sounds by their onsets uses the same criterion.

How much of a line has no onsets depends on what counts as one. The largest interval, up and down, by which the second note of a bowed legato pair at 60 dB can move and still have no onset of its own, in three registers, for four sizes of the level increment that counts as an onset. 0.5 dB: G2 up 1, down 0.5; A4 up 0.5, down 0; A6 up 0, down 0. 1 dB: G2 up 2, down 1; A4 up 0.5, down 0.5; A6 up 0.5, down 0. 2 dB: G2 up 3, down 1.5; A4 up 1, down 0.5; A6 up 1, down 0.5. 3 dB: G2 up 4.5, down 2; A4 up 1.5, down 1; A6 up 1, down 0.5. A step of nought means every interval of a semitone or more has an onset.
Fig. 5 The widest interval up and down by which the second note of a bowed pair at 60 dB can move and still have no onset of its own, in three registers, for rises of half a decibel to three decibels counting as an onset. At G2: half a decibel gives a semitone up and a quarter-tone down; one decibel a tone up and a semitone down; three decibels four and a half semitones up and a tone down. At A4 the widest is a tone and a half up at three decibels; at A6, a tone.

The criterion moves the boundary but not the pattern. With half a decibel counting as an onset, the double bass has no onset only for a semitone up or a quarter-tone down. With three decibels it has none up to four and a half semitones up and two down. On the violin, even three decibels leaves only a tone and a half up and a semitone down without an onset, and at A6 a tone. Every value of the criterion leaves the same two statements true: the bass has a band of intervals without onsets several times as wide as the treble’s, and that band is wider upward than downward.

A slower bow matters only for a leap down

A slower rise displaces a leap further and leaves a step where it was. The second note of a legato pair on the double bass's G2 at 60 dB, displaced in detectable steps against the interval, for three rises: tongued, 25 ms; bowed, 100 ms; a soft bowed entrance, 250 ms. tongued: -12 5.54, -7 4.85, -4 4.29, +4 4.04, +7 4.20, +12 4.45; entrance 5.52. bowed: -12 6.19, -7 5.02, -4 4.35, +4 4.08, +7 4.26, +12 4.53; entrance 6.16. a soft bowed entrance: -12 6.48, -7 5.06, -4 4.37, +4 4.09, +7 4.27, +12 4.55; entrance 6.46.
Fig. 6 The second note of a legato pair on G2 at 60 dB against the interval, for a tongued rise of 25 ms, a bowed rise of 100 ms and a soft bowed entrance of 250 ms. An octave down is displaced 5.5, 6.2 and 6.5 steps, each within a hair of its own entrance; a fifth up 4.2, 4.3 and 4.3. The rise matters where the new note’s filter was empty and hardly anywhere else.

The earlier essay found that the slower a note rises the further it is displaced, because a slow note is quiet for longer while its onset is read. For the second note of a legato pair that holds only when the new note’s filter was nearly empty. An octave down on the double bass is displaced 5.5 steps tongued, 6.2 bowed and 6.5 with a soft bowed entrance, each within a fraction of its own entrance from silence. A fifth up is displaced 4.2, 4.3 and 4.3: the filter already held most of a note, and the rise starts from there, so how slowly it rises barely changes the level at which the onset is read.

That makes the articulation matter less inside a line than at its start. Whether a line is tongued, bowed or bowed softly changes its entrance a great deal and its steps almost not at all; only its downward leaps take on the articulation’s character, because only they begin from something like silence.

Whose ears, whose lines

The listener is the one the earlier essays built: ears that differ by two decibels in threshold, which is well within what audiometry calls normal, and a seventh of the brainstem latency difference reaching the comparator that reads direction. The claim is about that listener and bowed string lines played legato in an orchestra, where the double basses and cellos routinely play long stepwise lines under a melody. It is not a claim about notes that are re-articulated — a bow change with a clear stop between the notes, or a line played détaché, begins every note from something closer to silence and is placed note by note in every register.

The arithmetic makes a prediction that could be tested with such a listener. A rising legato bass line at a forte should be heard at the position of its first note for as long as it rises, and a falling one should move toward its steady position note by note; played détaché, both should behave like the falling one. A listener with symmetric ears hears no displacement to inherit, so the difference is invisible to exactly the listeners most often asked — the same blind spot the error that moves straight ahead found in a listener whose head is the wrong size.

What the picture cannot show

Whether direction is re-read on a change within a sound. The model re-reads position only at an onset, and gives a note with no onset the position it inherits. A listener could also track a sound’s direction continuously, at a slower rate, in which case a note with no onset would drift toward its steady position over the course of its length rather than keeping its predecessor’s. The inherited displacements drawn here are an upper bound on how long a displacement persists.

Partials. Each note is treated as its fundamental in one filter. A bowed note has many partials, and a step changes every one of them; whether the note has an onset may be decided in the filters where its upper partials land, which are narrower in semitones than the fundamental’s. The bass’s wide band of intervals without onsets is the fundamental’s band and would narrow if the upper partials dominate.

The crossfade’s shape. The first note fades and the second rises over the same time and in straight lines of amplitude. A slurred string crossing, a finger change and a bow change each have their own shape, and a bow change in particular has a dip between the notes, which could itself be read as an onset.

Still open: the upper partials’ onsets

The second of those caveats is the one that could reverse the result. A bowed bass note’s fundamental sits in a wide filter, but its fourth and eighth partials sit in filters a quarter and an eighth as wide in semitones, where a step of a tone moves a partial right out of its filter. If the rule that places a sound by its onset listens to all the filters a note excites and fires on the first that sees a rise, then every step in the bass is an onset in its upper partials, and the bass line is re-placed note by note after all — though from filters at higher frequencies, where the latency difference is smaller and, above about a kilohertz in a room, where the two ears stop agreeing. Forward masking would pull the other way: a sound hides what came before it, and hides what follows it for longer, so the first note’s tail may bury part of the second note’s rise in exactly the filters where it would be an onset. The computation is the same leakage, summed over each note’s partials and filter by filter, with the note’s onset taken as the earliest rise in any filter above threshold, and it would say whether a legato bass line’s inherited displacement survives its own harmonics.

Part 15 of 16

One essay in the series on localisation. The essays either side of this one:

The objects named here

The third way in, after the field and the series: the things themselves, and every essay that touches each one.

Auditory filterDynamicsHearing thresholdInteraural time differenceLocalisationMasking