media analysis at FXPAL

 
interactive media / media analysis / structural characterization of popular music / additional results
 
 

segment-based music summarization via structural similarity analysis

   
Disclaimer This page contains audio data for the related paper "Summarizing Popular Music via Structural Similarity Analysis."  This music is reproduced here under the "Fair Use" clause of the 1976 Copyright Act (17 USCS §107).  
Introduction In this paper we use similarity analysis of digital audio to select excerpts as summaries of a larger work.  The excerpts are selected to maximize average similarity to the entire piece.  A more detailed description of the approach is here

In the results below, the automatic segmentation results are reported in the segment start times.  The manual label for the given segment in the manual column is a manual labeling of  the automatically detected segment boundaries.  Generally, the manual and automatic segmentations are in good agreement.   The links in the automatic column link to the audio excerpts automatically selected as the best representatives of the verse and chorus clusters within the songs.



Results

Table 1: Summary times for Wild Honey, by U2

SEGMENT LABEL START MANUAL AUTOMATIC
Segment 1 Class 5  0.05    
Segment 2 Class 1  8.80 Verse Verse
Segment 3 Class 2 40.30 Chorus Chorus
Segment 4 Class 3 54.85    
Segment 5 Class 1  62.30 Verse Verse
Segment 6 Class 2 94.75 Chorus Chorus
Segment 7 Class 3 124.10    
Segment 8 Class 1 131.55 Verse Verse
Segment 9 Class 4 167.30    
Segment 10 Class 2 174.45 Chorus Chorus
Segment 11 Class 3 208.40    
Segment 12 Class 5 221.60    

Table 2: Summary times for The Magical Mystery Tour, by the Beatles

SEGMENT LABEL START MANUAL AUTOMATIC
Segment 1 Class 3 0.05    
Segment 2 Class 1 10.25 Verse Verse
Segment 3 Class 2 32.65 Chorus Chorus
Segment 4 Class 1 42.40 Verse Verse
Segment 5 Class 2 64.45 Chorus Chorus
Segment 6 Class 3 72.80    
Segment 7 Class 1  87.65 Verse Verse
Segment 8 Class 2  116.75 Chorus Chorus
Segment 9 Class 4 140.65    
Segment 10 Class 5 146.00    

Table 3: Summary times for Tahitian Moon, by Porno for Pyros

SEGMENT LABEL START MANUAL AUTOMATIC
Segment 1 Class 4 0.05    
Segment 2 Class 1 7.55 Verse Verse
Segment 3 Class 2 36.00 Chorus Chorus
Segment 4 Class 1 49.55 Verse Verse
Segment 5 Class 2 71.15 Chorus Chorus
Segment 6 Class 3 92.35    
Segment 7 Class 3 98.85    
Segment 8 Class 3 113.05    
Segment 9 Class 1 140.65 Verse Verse
Segment 10 Class 2 165.80 Chorus Chorus
Segment 11 Class 5 214.35    

Table 4: Summary times for Lucy in the Sky with Diamonds, By The Beatles.

SEGMENT LABEL START MANUAL AUTOMATIC
Segment 1 Class 2  0.05 Verse  Verse
Segment 2 Class 4 26.75 Verse   
Segment 3 Class 3 32.50 Inter  
Segment 4 Class 1 51.00 Chorus Chorus
Segment 5 Class 2 69.00 Verse  Verse
Segment 6 Class 3 93.60 Inter  
Segment 7 Class 1 111.25 Chorus Chorus
Segment 8 Class 2 130.25 Verse  Verse
Segment 9 Class 1 148.75 Chorus Chorus

Table 5: Summary times for The Zephyr Song, By The Red Hot Chili Peppers.

SEGMENT LABEL START MANUAL AUTOMATIC
Segment 1 Class 4 0.05 Verse  
Segment 2 Class 2 32.55 Verse Verse
Segment 3 Class 1 50.95 Chorus Chorus
Segment 4 Class 3  69.45    
Segment 5 Class 2 75.95 Verse Verse
Segment 6 Class 1 92.60 Chorus Chorus
Segment 7 Class 4  128.20    
Segment 8 Class 3  143.70    
Segment 9 Class 1  160.45 Chorus Chorus
Segment 10 Class 3  193.70    

Table 6: Summary times for Hash Pipe, By Weezer.

SEGMENT LABEL START MANUAL AUTOMATIC
Segment 1 Class 2 Start  0.05 Verse Verse
Segment 2 Class 1 Start 23.90 Chorus Chorus
Segment 3 Class 2 Start 54.75 Verse Verse
Segment 4 Class 1 Start 77.25 Chorus Chorus
Segment 5 Class 3 Start 112.15 Guitar solo  
Segment 6 Class 1 Start 134.30 Chorus Chorus
Segment 7 Class 3 Start 169.55 Outro  

Table 7: Summary times for Optimistic, By Radiohead (truncated at 4 minutes to limit computation).

SEGMENT LABEL START MANUAL AUTOMATIC
Segment 1 Class 4 Start  0.05    
Segment 2 Class 2 Start 43.10 Verse Verse
Segment 3 Class 1 Start 66.80 Chorus Chorus
Segment 4 Class 5 Start 91.60    
Segment 5 Class 2 Start 103.50 Verse Verse
Segment 6 Class 1 Start 127.70 Chorus Chorus
Segment 7 Class 3 Start 148.75    
Segment 8 Class 3 Start 176.90    
Segment 9 Class 3 Start 189.15    
Segment 10 Class 5 Start 195.20    
Segment 11 Class 1 Start 200.85 Chorus Chorus
Segment 12 Class 3 Start 220.85