Jouni Paulus Audio Research Group Department of Signal Processing Tampere University of Technology Visit address: Korkeakoulunkatu 1, room TC318 Postal address: PO Box 553, FI-33101 Tampere, Finland Phone: +358 (0)3 3115 4798 E-mail: jouni <dot> paulus <at> tut <dot> fi Currently I am working as a researcher in ARG and doing post-graduate studies, which hopefully will result to a PhD in near future.

Research

Wider goal is to be able to transcribe the drum tracks of normal polyphonic music automatically, and to be able to analyse the sectional form of musical pieces.

• Low-level analysis signal analysis. Naturally, the transcription starts by analysing the acoustic signal and creating some sort of a mid-level representation of it. Both supervised and unsupervised methods can be utilised depending on the input signal and desired result.
• Musicological modelling. Speech recognition has gained considerably from the use of language models. Still, majority of the automatic music transcription systems try to cope only with low-level recognition. It would seem reasonable that the modelling of even simple musicological "rules" would benefit the whole transcription task. Analysis of musical metrical structure is helpful here.
• Parametric representation and sub-band coding of tonal signals. Tonal signals contain quite much redundant information from the coding point of view.
• Music structure analysis. Especially popular music pieces have a distinct structure defined by repetitions of different parts (e.g., verse and chorus). Being able to infer the structure from the audio enables several applications, such as easier navigation within the piece, music thumbnailing, and mash-ups.
• Music and audio applications. Music information retrieval (also other aspects than just transcription), algorithm and system implementation (something running only in Matlab has very little value for normal people), systems design (combining existing analysis components, sometimes 1+1>2)

Journal articles

• Paulus, J., Klapuri, A., "Drum sound detection in polyphonic music with hidden Markov models", EURASIP Journal on Audio, Speech, and Music Processing. To appear.
• Paulus, J., Klapuri, A., "Music Structure Analysis Using a Probabilistic Fitness Measure and a Greedy Search Algorithm", IEEE Transactions on Audio, Speech, and Language Processing, vol. 17, no. 6, August 2009, pp. 1159-1170. (pdf@IEEE), (full info), (pdf). DOI:10.1109/TASL.2009.2020533
  • Note: equation (25) should have |F_A| in the denominator, so that the equation is:
  • Copyright 2009 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

Book chapters

• FitzGerald, D., Paulus, J. "Unpitched Percussion Transcription", in "Signal Processing Methods for Music Transcription", eds. Klapuri, A., Davy, M., Springer-Verlag, pp. 131-162, 2006. (pdf). DOI:10.1007/0-387-32845-9_5
• Paulus, J., Klapuri, A. "Labelling the structural parts of a music piece with Markov models", in Computer Music Modeling and Retrieval: Genesis of Meaning in Sound and Music - 5th International Symposium, CMMR 2008 Copenhagen, Denmark, May 19-23, 2008, Revised Papers, Lecture Notes in Computer Science 5493, eds. Ystad, S., Kronland-Martinet, R., and Jensen, K., Springer Berlin / Heidelberg, 2009, pp. 166-176. (pdf @ Springer) (pdf). DOI:10.1007/978-3-642-02518-1_11

Conference publications

• Alves, D., Paulus, J., Fonseca, J., "Drum transcription from multichannel recordings with non-negative matrix factorization", in Proc. of the 17th European Signal Processing Conference (EUSIPCO2009), Glasgow, Scotland, UK, August 24-28, 2009, pp. 894-898, (pdf), (poster).
  • © 2009 European Association for Signal Processing.First published in the Proceedings of the 17th European Signal Processing Conference (EUSIPCO-2009) in 2009, published by EURASIP.
• Paulus, J., Klapuri, A., "Music Structure Analysis Using a Probabilistic Fitness Measure And an Integrated Musicological Model", in Proc. of the 9th International Conference on Music Information Retrieval (ISMIR 2008), Philadelphia, Pennsylvania, USA, September 14-18, 2008, pp. 369-374, (full proceedings), (pdf), (pdf@ismir.net), (poster).
• Paulus, J., Klapuri, A., "Acoustic Features for Music Piece Structure Analysis", in Proc. of the 11th International Conference on Digital Audio Effects (DAFx-08), Espoo, Finland, September 1-4, 2008, pp. 309-312, (pdf), (pdf@conference page), (poster).
• Ryynänen, M., Virtanen, T., Paulus, J., Klapuri, A., "Accompaniment separation and karaoke application based on automatic melody transcription",, in Proc. of the IEEE International Conference on Multimedia & Expo (ICME), Hannover, Germany, June 23-26, 2008, pp. 1417-1420, (pdf). DOI:10.1109/ICME.2008.4607710
  • Demos
  • Copyright 2008 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
• Paulus, J., Klapuri, A., "Labelling the Structural Parts of a Music Piece with Markov Models", in Proc. of the 2008 Computers in Music Modeling and Retrieval Conference (CMMR 2008), Copenhagen, Denmark, May 19-23, 2008, pp. 137-147, (pdf), (presentation).
  • Confusion matrices
  • List of TUTstructure07files
  • Local copy of the UPF Beatles annotations including the small corrections. Please note the license.
• Paulus, J., Klapuri, A., "Combining temporal and spectral features in HMM-based drum transcription", in Proc. of the 8th International Conference on Music Information Retrieval (ISMIR 2007), Vienna, Austria, September 23-27, 2007, pp. 225-228, (pdf), (pdf @ismir.net), (presentation).
  • Demos
• Paulus, J., Klapuri, A., "Music Structure Analysis by Finding Repeated Parts", in Proc. of the 1st Audio and Music Computing for Multimedia Workshop (AMCMM2006), Santa Barbara, California, USA, October 27, 2006, pp. 59-68, (pdf), (ACM portal), (presentation). © Copyright 2006 by ACM, Inc. DOI:10.1145/1178723.1178733
  • Dataset used in the evaluations
  • A screenshot of an example analysis program.
• Paulus, J., "Acoustic Modelling of Drum Sounds With Hidden Markov Models for Music Transcription",in Proc. of 2006 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP2006), Toulouse, France, May 14-19, 2006, (IEEXplore), (pdf), (poster). DOI:10.1109/ICASSP.2006.1661257
  • Copyright 2006 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
• Paulus, J., Virtanen, T., "Drum Transcription with Non-negative Spectrogram Factorisation", in Proc. of 13th European Signal Processing Conference (EUSIPCO2005) Antalya, Turkey, September 4-8, 2005, (pdf), (poster)
  • Demos
• Paulus J., Klapuri A., "Model-based Event Labeling in the Transcription of Percussive Audio Signals", in Proc. of 6th International Conference on Digital Audio Effects (DAFx-03), London, UK, September 8-11, 2003, pp. 73-77, (pdf), (pdf@DAFx.de), (presentation).
  • Demos
• Paulus, J., Klapuri, A., "Conventional and Periodic N-grams in the Transcription of Drum Sequences", in Proc. of IEEE International Conference on Multimedia and Expo (ICME03), Baltimore, USA, July 6-9 2003, pp. 737-740. (IEEEXplore), (pdf), (poster), (errata). DOI:10.1109/ICME.2003.1221722
  • Copyright 2003 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works, must be obtained from the IEEE.
• Paulus, J., Klapuri A. "Measuring the Similarity of Rhythmic Patterns", in Proc. of Third International Conference on Music Information Retrieval (ISMIR2002), Paris, France, October 13-17, 2002, pp. 150-156, (pdf), (pdf@ismir.net), (presentation).

Other

• Paulus, J., "Signal Processing Methods for Drum Transcription and Music Structure Analysis". D.Sc. thesis, Tampere University of Technology, Tampere, Finland. In review.
• Paulus, J., Klapuri, A., "Music structure analysis with a probabilistic fitness function in MIREX2009", extended abstract describing the method submitted for the Structural segmentation task at the Fifth Music Information Retrieval Evaluation eXchange (MIREX2009), Kobe, Japan, October 26-30, 2009. (pdf), (poster).
• Ryynänen M., Virtanen, T., Paulus, J., Klapuri, A., "Method for processing melody", Finnish patent application no. 20075737, filed October 2007.
• Paulus, J., "Automatic recognition and transcription of unpitched percussive sounds", presentation at GETA Boatseminar 2006, January 2006.
• Paulus, J., "Drum Transcription from Polyphonic Music with Instrument-wise Hidden Markov Models", extended abstract describing the algorithm submitted to the contest, in online Proc. of 1st Annual Music Information Retrieval Evaluation eXchange (MIREX'05), London, UK, September 11-15, 2005 (pdf)
• Paulus, J., "Sähkömittarin kulutustietojen välittäminen Bluetooth-tekniikan avulla", M.Sc. thesis, Tampere University of Technology, Tampere, Finland, November 2001

Forthcoming conferences.

Note regarding the IEEE copyrighted material on this page:

• This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Teaching

• 8003203 Digitaalinen audio, weekly exercises and project work (springs 2003-2005).

Education

• Matriculation, Väinö Linnan lukio, Urjala (1997).
• Master of Science (Engineering), with distinction, Department of Information Technology, TUT. Major subject Digital and Computer Engineering, minor subject Software Systems (long) (9/1997-2/2002).
• Post-graduate student, signal processing, TUT (3/2002-), The Graduate School in Electronics, Telecommunications and Automation, GETA (9/2005-8/2009).

Something else

• I spent the summer '06 at LabROSA, Columbia University, New York, USA.
• More personal page(s).