Research
The research focus of my post-graduate studies was transcribing the drum tracks of normal polyphonic music automatically, and analysing the sectional form of musical pieces. On a more general level I am interested in audio content analysis with signal processing methods (computer audition) including modelling of the auditory process, feature extraction, supervised and unsupervised classification, higher-level modelling, and more complex analysis algorithm design. Currently I am interested in applying all the methods learned so far in some new problems, so if you have an interesting problem, maybe we could collaborate to solve it.
-
Low-level analysis signal analysis. Naturally, the transcription starts by analysing the acoustic signal and creating some sort of a mid-level representation of it. Both supervised and unsupervised methods can be utilised depending on the input signal and desired result.
-
Musicological modelling. Speech recognition has gained considerably from the use of language models. Still, majority of the automatic music transcription systems try to cope only with low-level recognition. It would seem reasonable that the modelling of even simple musicological "rules" would benefit the whole transcription task. Analysis of musical metrical structure is helpful here.
-
Parametric representation and sub-band coding of tonal signals. Tonal signals contain quite much redundant information from the coding point of view. This topic is related to a project from which I could not publish anything, but the AM/FM properties of tonal signals became very familiar.
-
Music structure analysis. Especially popular music pieces have a distinct structure defined by repetitions of different parts (e.g., verse and chorus). Being able to infer the structure from the audio enables several applications, such as easier navigation within the piece, music thumbnailing, and mash-ups.
-
Music and audio applications. Music information retrieval (also other aspects than just transcription), algorithm and system implementation (something running only in Matlab has very little value for normal people), systems design (combining existing analysis components, sometimes 1+1>2).
Journal articles
-
Paulus, J., Klapuri, A., "Drum sound detection in polyphonic music with hidden Markov models", EURASIP Journal on Audio, Speech, and Music Processing. Volume 2009 (2009), Article ID 497292, 9 pages. (pdf). DOI:10.1155/2009/497292
-
Paulus, J., Klapuri, A., "Music Structure Analysis Using a Probabilistic Fitness Measure and a Greedy Search Algorithm", IEEE Transactions on Audio, Speech, and Language Processing, vol. 17, no. 6, August 2009, pp. 1159-1170. (pdf@IEEE), (full info), (pdf). DOI:10.1109/TASL.2009.2020533
-
Note: equation (25) should have |F_A| in the denominator, so that the equation is:
![R_R = \frac{|\mathbb{F_A} \cap \mathbb{F_E}|}{|\mathbb{F_A}]}](taslp09_eq25.png)
- Copyright 2009 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Book chapters
-
FitzGerald, D., Paulus, J. "Unpitched Percussion Transcription", in "Signal Processing Methods for Music Transcription", eds. Klapuri, A., Davy, M., Springer-Verlag, pp. 131-162, 2006. (pdf). DOI:10.1007/0-387-32845-9_5
-
Paulus, J., Klapuri, A. "Labelling the structural parts of a music piece with Markov models", in Computer Music Modeling and Retrieval: Genesis of Meaning in Sound and Music - 5th International Symposium, CMMR 2008 Copenhagen, Denmark, May 19-23, 2008, Revised Papers, Lecture Notes in Computer Science 5493, eds. Ystad, S., Kronland-Martinet, R., and Jensen, K., Springer Berlin / Heidelberg, 2009, pp. 166-176. (pdf @ Springer) (pdf). DOI:10.1007/978-3-642-02518-1_11
Theses
-
Paulus, J., "Signal Processing Methods for Drum Transcription and Music Structure Analysis". D.Sc. thesis, Tampere University of Technology, Tampere, Finland, December 2009. (pdf) (pdf @ TUT library). Lectio praecursoria slides and text (in Finnish).
-
Paulus, J., "Sähkömittarin kulutustietojen välittäminen Bluetooth-tekniikan avulla (Relaying Electricity Consumption Information Using Bluetooth-Technology)", M.Sc. thesis, Tampere University of Technology, Tampere, Finland, November 2001. In Finnish.
Conference publications
-
Paulus, J., Müller, M., Klapuri, A., "Audio-based music structure analysis", in Proc. of the 11th International Society for Music Information Retrieval Conference (ISMIR 2010), Utrecht, The Netherlands, August 8-13, 2010, pp. 625-636, (pdf), (pdf), (presentation).
-
Paulus, J., "Improving Markov model-based music piece structure labelling with acoustic information", in Proc. of the 11th International Society for Music Music Information Retrieval Conference (ISMIR 2010), Utrecht, The Netherlands, August 8-13, 2010, pp. 303-308, (pdf), (pdf), (poster).
-
Alves, D., Paulus, J., Fonseca, J., "Drum transcription from multichannel recordings with non-negative matrix factorization", in Proc. of the 17th European Signal Processing Conference (EUSIPCO2009), Glasgow, Scotland, UK, August 24-28, 2009, pp. 894-898, (pdf), (poster).
- © 2009 European Association for Signal Processing. First published in the Proceedings of the 17th European Signal Processing Conference (EUSIPCO-2009) in 2009, published by EURASIP.
-
Paulus, J., Klapuri, A., "Music Structure Analysis Using a Probabilistic Fitness Measure And an Integrated Musicological Model", in Proc. of the 9th International Conference on Music Information Retrieval (ISMIR 2008), Philadelphia, Pennsylvania, USA, September 14-18, 2008, pp. 369-374, (full proceedings), (pdf), (pdf@ismir.net), (poster).
-
Paulus, J., Klapuri, A., "Acoustic Features for Music Piece Structure Analysis", in Proc. of the 11th International Conference on Digital Audio Effects (DAFx-08), Espoo, Finland, September 1-4, 2008, pp. 309-312, (pdf), (pdf@conference page), (poster).
-
Ryynänen, M., Virtanen, T., Paulus, J., Klapuri, A., "Accompaniment separation and karaoke application based on automatic melody transcription",, in Proc. of the IEEE International Conference on Multimedia & Expo (ICME), Hannover, Germany, June 23-26, 2008, pp. 1417-1420, (pdf). DOI:10.1109/ICME.2008.4607710
- Demos
- Copyright 2008 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
-
Paulus, J., Klapuri, A., "Labelling the Structural Parts of a Music Piece with Markov Models", in Proc. of the 2008 Computers in Music Modeling and Retrieval Conference (CMMR 2008), Copenhagen, Denmark, May 19-23, 2008, pp. 137-147, (pdf), (presentation).
-
Paulus, J., Klapuri, A., "Combining temporal and spectral features in HMM-based drum transcription", in Proc. of the 8th International Conference on Music Information Retrieval (ISMIR 2007), Vienna, Austria, September 23-27, 2007, pp. 225-228, (pdf), (pdf @ismir.net), (presentation).
-
Paulus, J., Klapuri, A., "Music Structure Analysis by Finding Repeated Parts", in Proc. of the 1st Audio and Music Computing for Multimedia Workshop (AMCMM2006), Santa Barbara, California, USA, October 27, 2006, pp. 59-68, (pdf), (ACM portal), (presentation). © Copyright 2006 by ACM, Inc. DOI:10.1145/1178723.1178733
-
Paulus, J., "Acoustic Modelling of Drum Sounds With Hidden Markov Models for Music Transcription",in Proc. of 2006 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP2006), Toulouse, France, May 14-19, 2006, (IEEXplore), (pdf), (poster). DOI:10.1109/ICASSP.2006.1661257
- Copyright 2006 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
-
Paulus, J., Virtanen, T., "Drum Transcription with Non-negative Spectrogram Factorisation", in Proc. of 13th European Signal Processing Conference (EUSIPCO2005) Antalya, Turkey, September 4-8, 2005, (pdf), (poster)
- Demos
- © 2005 European Association for Signal Processing. First published in the Proceedings of the 13th European Signal Processing Conference (EUSIPCO-2005) in 2005, published by EURASIP.
-
Paulus J., Klapuri A., "Model-based Event Labeling in the Transcription of Percussive Audio Signals", in Proc. of 6th International Conference on Digital Audio Effects (DAFx-03), London, UK, September 8-11, 2003, pp. 73-77, (pdf), (pdf@DAFx.de), (presentation).
-
Paulus, J., Klapuri, A., "Conventional and Periodic N-grams in the Transcription of Drum Sequences", in Proc. of IEEE International Conference on Multimedia and Expo (ICME03), Baltimore, USA, July 6-9 2003, pp. 737-740. (IEEEXplore), (pdf), (poster), (errata). DOI:10.1109/ICME.2003.1221722
- Copyright 2003 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works, must be obtained from the IEEE.
-
Paulus, J., Klapuri A. "Measuring the Similarity of Rhythmic Patterns", in Proc. of Third International Conference on Music Information Retrieval (ISMIR2002), Paris, France, October 13-17, 2002, pp. 150-156, (pdf), (pdf@ismir.net), (presentation).
Other
-
Paulus, J., Klapuri, A., "Music structure analysis with a probabilistic fitness function in MIREX2009", extended abstract describing the method submitted for the Structural segmentation task at the Fifth Music Information Retrieval Evaluation eXchange (MIREX2009), Kobe, Japan, October 26-30, 2009. (pdf), (poster).
-
Ryynänen M., Virtanen, T., Paulus, J., Klapuri, A., "Method for processing melody", Finnish patent application no. 20075737, filed October 2007.
-
Paulus, J., "Drum Transcription from Polyphonic Music with Instrument-wise Hidden Markov Models", extended abstract describing the algorithm submitted to the contest, in online Proc. of 1st Annual Music Information Retrieval Evaluation eXchange (MIREX'05), London, UK, September 11-15, 2005 (pdf)
BibTeX of my publications.
A demo page with audio examples of the results obtained with some of the proposed drum transcription methods. Not all of the publications are present, but still the examples should provide an overview of the performance of all the main approaches proposed.
Note regarding the IEEE copyrighted material on this page:
- This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.
Teaching
- 8003203 Digitaalinen audio, weekly exercises and project work (springs 2003-2005).
- Teaching related to the Bluetooth technology at Edutech, The Centre for Continuing Education, Tampere University of Technology (2001).
Education
-
Doctor of Science in Technology, Signal Processing, TUT (3/2002-1/2010), The Graduate School in Electronics, Telecommunications and Automation, GETA (9/2005-8/2009).
-
Master of Science (Engineering), with distinction, Department of Information Technology, TUT. Major subject Digital and Computer Engineering, minor subject Software Engineering (long) (9/1997-2/2002).
-
Matriculation, Väinö Linnan lukio, Urjala (1997).
Something else
-- paulus - 26.2.2010
