Acoustics & Music Theory
why it sounds like that
Concept

Novelty — where it appears

A measure of how much the music just before a moment differs from the music just after it, computed by a local operator. Its peaks are where a listener would put a boundary, which makes segmentation a quantity rather than a judgement.

Named by 6 essays across one field — each of them below, with the objects they name alongside it.

Boundaries found by a local operator, at three kernel widths. Foote's checkerboard novelty computed on the self-similarity matrix of thirty-two-bar AABA, at kernel widths of 2, 4, 8 bars. The dashed verticals are where the encoding's sections actually change; nothing about them enters the computation. A peak is a place where the bars before resemble each other, the bars after resemble each other, and the two groups do not resemble each other.

The boundary is where the neighbourhood changes

A section boundary can be found by an operator that never sees a section. It walks the diagonal of a similarity matrix asking one local question — do the bars behind me resemble each other, do the bars ahead resemble each other, and do the two groups resemble each other — and where the answer is yes, yes, no, there is an edge. What it cannot find turns out to say more than what it can.

form · Repetition A cycle has no ending to compute, so it uses density instead. 5 layers over 32 cycles of a 12-step pattern, with each layer's entry and exit marked, and the onsets per step summed underneath. No chord changes and no cadence occurs; the closure vector is zero throughout, and every change a listener hears is a change in how many things are playing.

A cycle cannot cadence

Every component of closure is defined by a first time and a last time. Music built on a repeating cycle has neither, so the whole apparatus returns zero on it — not a small value, zero, at every setting. What such music uses instead is how many things are playing, and that is a curve which can be computed from the onsets and nothing else.

form · Cyclic rhythm The period, as the piece goes by. The strongest lag of thirty-two-bar AABA computed on only the bars heard so far, against how many bars that is. The final answer is 4 bars; it is revised 6 times on the way, and is not reached for the last time until bar 29 of 32, which is 91 per cent of the way through and 64 seconds at 108 beats a minute. Nothing about the boundary operator is involved: this is the global statistic, and it is the half of the form that a first hearing cannot have.

The form a first hearing cannot have

Every figure so far was computed with the whole piece in hand. Run the same methods over only the bars already heard and one of the two methods survives intact — the boundary operator turns out to be causal at a fixed delay of a few bars — while the other collapses. The period of a piece is not knowable until the piece is nearly over, and in two of the six schemes here not until its last bar.

form · Repetition The boundary operator run over only what has been heard. Foote's checkerboard novelty on thirty-two-bar AABA at a kernel width of 4 bars, computed twice: once with the whole piece available, and once using only the bars heard up to and including each bar. The kernel reaches 4 bars forward, so every cell it needs has been heard 3 bars after its centre — the retrospective curve replotted 3 bars to the right lands on the causal one, and the operator turns out to be causal at a fixed delay rather than blind. The dashed verticals are the encoding's real section boundaries and are not an input.

An ending that can be heard coming

Two measurements are both called hearing an ending coming and they point in opposite directions. By the halfway mark of an ordinary form almost nothing new arrives — and the cost of coding each bar has not fallen at all. Neither statistic says anything is about to stop, because no statistic over content can: predicting the next event well is not predicting that there will not be one.

form · Closure Where the page ends a phrase, and where the ear does. Twinkle, twinkle with two sets of phrase boundaries on it. The lower curve is a local boundary detector — a peak in how much the interval and the note length change from one to the next, with nothing in it about bar lines or harmony — and the marks above it are where the notation puts the phrase ends. It finds 100 per cent of them and 2 boundaries the page does not have. Where the two agree it is because a long note is sitting at the join; where they disagree the page is marking a grammatical unit and the detector is finding a perceptual one.

Where a phrase ends

Run a boundary detector over the three tunes used throughout and it agrees with the notated phrasing on one of them perfectly and on another almost not at all. The reason is which cue each tune uses: Twinkle's phrases all end on a long note, so a duration-weighted detector finds five of five with no false alarms; Ode to Joy's run on in crotchets and its phrasing is in the intervals, where a duration detector finds one of three and a pitch detector finds all three and eight others. No fixed weighting serves both, and the published one is worse on each tune than the single cue that tune uses.

form · Phrase What survives a change of encoding: verse and chorus. The same 32 bars of verse and chorus under five encodings, scored on the three things measured here measures. Mean off-diagonal similarity says how alike the piece looks to the arithmetic. Recall and precision are the novelty operator's boundaries against the 3 the section plan has, at a kernel of four bars. The period is the strongest peak of the lag profile, in bars. Under the bag of pitch classes every other figure uses, the piece is 90 per cent self-similar and the operator finds 0 per cent of the boundaries; under how far the root moved it finds 100 per cent. The period is the quantity that does not move.

The repeat that is not in the notes

Eight earlier essays compare bars by writing each one as a bag of pitch classes and taking a cosine. Nothing chose that encoding — the first used it and the other seven inherited it. Encode the same six schemes four other ways and one of the three findings survives untouched, one survives with different numbers, and one turns out to have been a statement about the encoding all along: the boundary operator finds none of the section edges in three schemes as a bag of pitch classes and every one of them as tonic, subdominant and dominant.

form · Repetition

Named alongside it

The objects these essays reach for when they reach for this one.

SegmentationRepetitionSection boundarySelf-similarityClosureDescription lengthExpectationRedundancyBoundary conditionCadenceCycleEntrainment

All concepts