Erik Marchi, M.Sc.

Technische Universität München

Lehrstuhl für Mensch - Maschine - Kommunikation (Prof. Rigoll)

zur Zeit an der Uni Passau tätig

Email: erik.marchi@tum.de

Short Curriculum Vitae (IEEE style)

Erik Marchi received his M.Sc. degree (cum laude) in electronic engineering in 2011 from Università Politecnica delle Marche. He is currently working towards his PhD degree as a researcher in the Machine Intelligence and Signal Processing Group at the Institute for Human-Machine Communication of Technische Universtität München, one of Germany's Excellence Universities. His research focuses on affective computing, speech recognition and music information retrieval. His further area of involvement is the EU-FP7 project ASC-Inclusion that aims to build a internet-based platform that teaches children with autism how to recognise and express emotion. In the scope of this project, he leads the development of an on-line speech feature extractor with visual output that functions as vocal expression evaluation system providing corrective feedback. Mr. Marchi is a member of IEEE and ACM and serves as a reviewer for several IEEE journals, as well as other leading international journals and conferences in the field.

Research Areas

  • Noise robust acoustic modelling for Conversational Agents
  • Keyword Detection in Conversational and Emotional Speech
  • Affective computing
  • Speech Analysis and Feedback for Voice Coaching
  • Music Information Retrieval

Publications

  • E. Marchi, F. Vesperini, S. Squartini, and B. Schuller, “Deep Recurrent Neural Network-based Autoencoders for Acoustic Novelty Detection,” Computational Intelligence and Neuroscience, 2016. 18 pages. 

  • S. Frühholz, E. Marchi, and B. Schuller, “The Effect of Narrow-band Transmission on Recognition of Paralinguistic Information from Human Vocalizations,” IEEE Access, 2016. 13 pages.

  • E. Marchi, D. Tonelli, X. Xu, F. Ringeval, J. Deng, S. Squartini, and B. Schuller, “Pairwise Decomposition with Deep Neural Networks and Multiscale Kernel Subspace Learning for Acoustic Scene Classification,” in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2016 IEEE AASP Challenge Workshop (DCASE 2016), satellite to EUSIPCO 2016, (Budapest, Hungary), EUSIPCO, IEEE, September 2016. 5 pages.

  • E. Marchi, D. Tonelli, X. Xu, F. Ringeval, J. Deng, S. Squartini, and B. Schuller, "The Up System for The 2016 {DCASE} Challenge Using Deep Recurrent Neural Network and Multiscale Kernel Subspace Learning", Technical report, DCASE 2016 Challenge, satellite to EUSIPCO 2016, (Budapest, Hungary), EUSIPCO, IEEE, September 2016. 1 page.

  • M. Schmitt, E. Marchi, F. Ringeval, and B. Schuller, “Towards Cross-lingual Automatic Diagnosis of Autism Spectrum Condition in Children’s Voices,” in Proceedings 14th ITG Conference on Speech Communication, (Paderborn, Germany), pp. 1–5, ITG/VDE, IEEE, October 2016. 5 pages. to appear.

  • F. Weninger, F. Ringeval, E. Marchi, and B. Schuller, “Discriminatively Trained Recurrent Neural Networks for Continuous Dimensional Emotion Recognition from Audio (Extended Abstract),” in Proceedings 39th German  Conference on Artificial Intelligence, KI 2016 ÖGAI Tagung 2016, (Klagenfurt, Austria), GfI / ÖGAI, Springer, September 2016. 6 pages, to appear.

  • I. Abdić, L. Fridman, D. McDuff, E. Marchi, B. Reimer, and B. Schuller, “Driver Frustration Detection From Audio and Video (Extended Abstract),” in Proceedings 39th German Conference on Artificial Intelligence, KI 2016 / ÖGAI Tagung 2016, (Klagenfurt, Austria), GfI / ÖGAI, Springer, September 2016. 6 pages, to appear.

  • Erik Marchi, Florian Eyben, Gerhard Hagerer, and Björn W. Schuller. "Real-time Tracking of Speakers’ Emotions, States, and Traits on Mobile Platforms". In Proceedings INTERSPEECH 2016, 17th Annual Conference of the International Speech Communication Association, San Francsico, CA, September 2016. ISCA, ISCA. 2 pages, Show & Tell demonstration, to appear. 

  • Shahin Amiriparian, Jouni Pohjalainen, Erik Marchi, Sergey Pugachevskiy, and Björn Schuller. "Is deception emotional? An emotion-driven predictive approach". In Proceedings INTERSPEECH 2016, 17th Annual Conference of the International Speech Communication Association, San Francsico, CA, September 2016. ISCA, ISCA. 5 pages, to appear.
     
  • Fabien Ringeval, Erik Marchi, Charline Grossard, Jean Xavier, Mohamed Chetouani, David Cohen, and Björn Schuller. "Automatic Analysis of Typical and Atypical Encoding of Spontaneous Emotion in the Voice of Children". In Proceedings INTERSPEECH 2016, 17th Annual Conference of the International Speech Communication Association, San Francsico, CA, September 2016. ISCA, ISCA. 5 pages, to appear.  

  • Hesam Sagha, Pavel Matejka, Maryna Gavryukova, Filip Povolny, Erik Marchi, and Björn Schuller. "Enhancing multilingual recognition of emotion in speech by language identification". In Proceedings INTERSPEECH 2016, 17th Annual Conference of the International Speech Communication Association, San Francsico, CA, September 2016. ISCA, ISCA. 5 pages, to appear.  

  • Zixing Zhang, Fabien Ringeval, Jing Han, Jun Deng, Erik Marchi, and Björn Schuller. "Facing Realism in Spontaneous Emotion Recognition from Speech: Feature Enhancement by Autoencoder with LSTM Neural Networks". In Proceedings INTERSPEECH 2016, 17th Annual Conference of the International Speech Communication Association, San Francsico, CA, September 2016. ISCA, ISCA. 5 pages, to appear.

  • Irman Abdic, Lex Fridman, Daniel McDuff, Erik Marchi, Bryan Reimer, and Björn Schuller. "Driver Frustration Detection From Audio and Video". In Proceedings of the 25th International Joint Conference on Artificial Intelligence, IJCAI 2016, NewYork City, NY, July 2016. IJCAI/AAAI. 8 pages.

  • Felix Weninger, Fabien Ringeval, Erik Marchi, and Björn Schuller. "Discriminatively trained recurrent neural networks for continuous dimensional emotion recognition from audio". In Proceedings of the 25th International Joint Conference on Artificial Intelligence, IJCAI 2016, New York City, NY, July2016. IJCAI/AAAI. 7 pages.

  • Agnes Rynkiewicz, Björn Schuller, Erik Marchi, Stefano Piana, Antonio Camurri, Amadine Lassalle, and Simon Baron-Cohen. "An Investigation of the Female Camouflage Effect’ in Autism Using a New Computerized Test Showing Sex/Gender Differences during ADOS-2". In Proceedings 15th Annual International Meeting For Autism Research (IMFAR 2016), Baltimore, MD, May 2016. International Society for Autism Research (INSAR), INSAR. 1 page.

  • Simone Hantke, Erik Marchi and Björn Schuller: "Introducing the Weighted Trustability Evaluator for Crowdsourcing Exemplified by Speaker Likability Classification. In Proceedings 10th Language Resources and Evaluation Conference, LREC 2016, Portoroz, Slovenia, May 2016. ELRA, ELRA.to appear.
  • Agnieszka Rynkiewicz, Björn Schuller, Erik Marchi, Stefano Piana, Antonio Camurri, Amandine Lassalle, and Simon Baron-Cohen. "An investigation of the ‘female camouflage effect’ in autism using a computerized ADOS-2, and a test of sex/gender differences". Molecular Autism, 2016. 10 pages, to appear (IF: 5.413 (2014))
  • George Trigeorgis, Fabien Ringeval, Raymond Bruckner, Erik Marchi, Mihalis Nicolaou, Bjorn Schuller, and Stefanos Zafeiriou. "Adieu Features? End-to-End Speech Emotion Recognition using a Deep Convolutional Recurrent Network". In Proceedings 41st IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2016, Shanghai, P. R. China, March 2016. IEEE, IEEE. 5 pages, to appear.
  • Zixing Zhang, Fabien Ringeval, Bin Dong, Eduardo Coutinho, Erik Marchi, and Bjorn Schuller. "Enhanced Semi-Supervised Learning for Multimodal Emotion Recognition". In Proceedings 41st IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2016, Shanghai, P. R. China, March 2016. IEEE, IEEE. 5 pages, to appear.
  • Florian Eyben, Erik Marchi, and Björn Schuller. "Mobile Real-time Tracking of Speakers’ Emotions, States, and Traits". In Proceedings 41st IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2016, Shanghai, P. R. China, March 2016. IEEE, IEEE. to appear.
  • Irman Abdic, Lex Fridman, Erik Marchi, Daniel E. Brown, William Angell, Bryan Reimer, and Bjorn Schuller. "Detecting Road Surface Wetness from Audio: A Deep Learning Approach". arxiv.org, (1511.07035), December 2015. 5 pages.
  • G. Trigeorgis, E. Coutinho, F. Ringeval, E. Marchi, S. Zafeiriou, and B. Schuller, “The ICL-TUM-PASSAU approach for the MediaEval 2015 “Affective Impact of Movies” Task,” in Proceedings of the MediaEval 2015 Multimedia Benchmark Workshop, satellite of Interspeech 2015, (Wurzen, Germany), September 2015. 3 pages
  • Nicolas Sabouret, Björn Schuller, Lucas Paletta, Erik Marchi, Hazaël Jones, and Atef Ben Youssef. "Intelligent User Interfaces in Digital Games for Empowerment and Inclusion". In Proc. Twelfth International Conference on Advances in Computer Entertainment Technology (ACE 2015), 16-19 Nov, Iskandar, Malaysia.
  • Amr El-Desoky Mousa, Erik Marchi, and Björn Schuller, “The ICSTM+TUM+UP Approach to the 3rd CHIME Challenge: Single-Channel LSTM Speech Enhancement with Multi-Channel Correlation Shaping Dereverberation and LSTM Language Models,” ArXiv e-prints, Oct. 2015.
  • F. Eyben, B. Huber, E. Marchi, D. Schuller, and B. Schuller, “Robust Real-time Affect Analysis and Speaker Characterisation on Mobile Devices,” in Proc. 6th biannual Conference on Affective Computing and Intelligent Interaction (ACII 2015), (Xi’an, P. R. China), AAAC, IEEE, September 2015. 3 pages.
  • Erik Marchi, Björn Schuller, Simon Baron-Cohen, Ofer Golan, Sven Bolte, Prerna Arora, and Reinhold Häb-Umbach. "Typicality and Emotion in the Voice of Children with Autism Spectrum Condition: Evidence Across Three Languages". In Proceedings INTERSPEECH 2015, 16th Annual Conference of the International Speech Communication Association, Dresden, Germany, September 2015. ISCA, ISCA. 5 pages.
  • Fabien Ringeval, Erik Marchi, Marc Mehu, Klaus Scherer, and Björn Schuller. "Face Reading from Speech - Predicting Facial Action Units from Audio Cues". In Proceedings INTERSPEECH 2015, 16th Annual Conference of the International Speech Communication Association, Dresden, Germany, September 2015. ISCA, ISCA. 5 pages.
  • Erik Marchi, Fabio Vesperini, Felix Weninger, Florian Eyben, Stefano Squartini,and Björn Schuller: "Non-Linear Prediction with LSTM Recurrent Neural Networks for Acoustic Novelty Detection", Proc. 2015 International Joint Conference on Neural Networks (IJCNN) IEEE, Killarney, Ireland, 12-17.07.2015.
  • A. Rynkiewicz, A. Baranger, B. Schuller, P. Robinson, A. Camurri, M. Sezgin, N. Meir-Goren, S. Tal, S. Fridenson-Hayo, A. Lassalle, S. Berggren, N. Sullings, D. Pigat, K. Ptaszek, E. Marchi, S. Piana, and T. Baltrusaitis, “ASC-Inclusion - a Virtual World Teaching Children with ASC about Emotions,” in Proceedings 14th Annual International Meeting For Autism Research (IMFAR 2015), (Salt Lake City, UT), International Society for Autism Research (INSAR), INSAR, May 2015.

  • Björn Schuller, Erik Marchi, Simon Baron-Cohen, Amandine Lassalle, Helen O'Reilly, Delia Pigat, Peter Robinson, Ian Davies, Tadas Baltrusaitis, Marwa Mahmoud, Ofer Golan, Shimrit Fridenson, Shahar Tal, Shai Newman, Noga Meir, Roi Shillo, Antonio Camurri, Stefano Piana, Alessandra Staglianò, Sven Bölte, Daniel Lundqvist, Steve Berggren, Aurelie Baranger, Nikki Sullings, Metin Sezgin, Nese Alyuz, Agnieszka Rynkiewicz, Kacper Ptaszek, Karol Ligmann: "Recent developments and results of ASC-Inclusion: An Integrated Internet-Based Environment for Social Inclusion of Children with Autism Spectrum Conditions, Proc. 3rd International Workshop on Digital Games for Empowerment and Inclusion (IDGEI 2015) held in conjunction with the 20th International Conference on Intelligent User Interfaces (IUI 2015), ACM, Atlanta, US, 29.03-01.04.2015.
  • Erik Marchi, Björn Schuller, Simon Baron-Cohen, Amandine Lassalle, Helen O'Reilly, Delia Pigat, Ofer Golan, Shimrit Fridenson-Hayo, Shahar Tal, Sven Bölte, Daniel Lundqvist, Steve Berggren and Sigrid Elfstroem: "Voice Emotion Games: Language and Emotion in the Voice of Children with Autism Spectrum Condition", Proc. 3rd International Workshop on Digital Games for Empowerment and Inclusion (IDGEI 2015) held in conjunction with the 20th International Conference on Intelligent User Interfaces (IUI 2015), ACM, Atlanta, US, 29.03-01.04.2015.
  • Erik Marchi, Fabio Vesperini, Florian Eyben, Stefano Squartini, and Björn Schuller, “A Novel Approach for Automatic Acoustic Novelty Detection Using a Denoising Autoencoder with Bidirectional LSTM Neural Networks,” in Proceedings 40th IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2015, (Brisbane, Australia), IEEE, IEEE, April 2015. 5 pages.
  • Jürgen T. Geiger, Erik Marchi, Björn Schuller, Gerhard Rigoll: "The TUM System for the REVERB Challenge: Recognition of Reverberated Speech Using Multi-Channel Correlation Shaping Dereverberation and BLSTM Recurrent Neural Networks", in Proc. REVERB Workshop 2014 (REVERB 2014), satellite of IEEE ICASSP 2014 and HSCMA 2014 and part of the IEEE SPS AASP challenge series, Florence, Italy, 10.05.2014
  • Erik Marchi, Giacomo Ferroni, Florian Eyben, Stefano Squartini, Björn Schuller: "Audio Onset Detection: A Wavelet Packet Based Approach with Recurrent Neural Networks", in Proc. 2014 International Joint Conference on Neural Networks (IJCNN) as part of the IEEE World Congress on Computational Intelligence (IEEE WCCI), IEEE, Beijing, China, 06.-11.07.2014.
  • Erik Marchi, Giacomo Ferroni, Florian Eyben, Leonardo Gabrielli, Stefano Squartini, Björn Schuller: "Multi-resolution Linear Prediction Based Features for Audio Onset Detection with Bidirectional LSTM Neural Networks", in Proc. 39th International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE, Florence, Italy, 04.-09.05.2014.
  • Björn Schuller, Stefan Steidl, Anton Batliner, Julien Epps, Florian Eyben, Fabien Ringeval, Erik Marchi, Yue Zhang: "The INTERSPEECH 2014 Computational Paralinguistics Challenge: Cognitive & Physical Load", in Proc. INTERSPEECH 2014, ISCA, Singapore, Singapore, 14.-18.09.2014.
  • Björn Schuller, Erik Marchi, Simon Baron-Cohen, Helen O'Reilly, Delia Pigat, Peter Robinson, Ian Davies, Ofer Golan, Shimrit Fridenson, Shahar Tal, Shai Newman, Noga Meir, Roi Shillo, Antonio Camurri, Stefano Piana, Alessandra Staglianò, Sven Bölte, Daniel Lundqvist, Steve Berggren, Aurelie Baranger and Nikki Sullings: "The state of play of ASC-Inclusion: Integrated Internet-Based Environment for Social Inclusion of Children with Autism Spectrum Conditions, in Proc. 2nd International Workshop on Digital Games for Empowerment and Inclusion (IDGEI 2014) held in conjunction with the 19th International Conference on Intelligent User Interfaces (IUI 2014), ACM, Haifa, Israel, 24.02.2014.
  • Erik Marchi, Yue Zhang, Florian Eyben, Fabien Ringeval, and Bjorn Schuller. Autism and Speech, Language, and Emotion - a Survey. In Hemant Patil and Manisha Kulshreshtha, editors, Evaluating the Role of Speech Technology in Medical Case Management. De Gruyter, Berlin, 2015. invited contribution, to appear.
  • Erik Marchi, Fabien Ringeval, Björn Schuller: "Voice-enabled Assistive Robots for Handling Autism Spectrum Conditions: an Examination of the Role of Prosody", invited for Speech and Automata in the Healthcare, Amy Neustein (eds.), De Gruyter, 2014.
  • Giacomo Ferroni, Erik Marchi, Florian Eyben, Stefano Squartini, Björn Schuller: "Onset Detection Exploiting Wavelet Transform with Bidirectional Long Short-Term Memory Neural Networks", Proc. Annual Meeting of the MIREX 2013 community as part of the 14th International Conference on Music Information Retrieval, ISMIR, Curitiba, Brazil, 04.-08.11.2013.
  • Giacomo Ferroni, Erik Marchi, Florian Eyben, Leonardo Gabrielli, Stefano Squartini, Björn Schuller: "Onset Detection Exploiting Adaptive Linear Prediction Filtering in DWT Domain with Bidirectional Long Short-Term Memory Neural Networks", Proc. Annual Meeting of the MIREX 2013 community as part of the 14th International Conference on Music Information Retrieval, ISMIR, Curitiba, Brazil, 04.-08.11.2013.
  • Jun Deng, Zixing Zhang, Erik Marchi, Björn Schuller: "Sparse Autoencoder-based Feature Transfer Learning for Speech Emotion Recognition", in Proc. 5th biannual Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII 2013), IEEE, Geneva, Switzerland, 02.-05.09.2013.
  • Zixing Zhang, Jun Deng, Erik Marchi, Björn Schuller: "Active Learning by Label Uncertainty for Acoustic Emotion Recognition", in Proc. INTERSPEECH 2013, ISCA, Lyon, France, 2013.
  • Florian Eyben, Felix Weninger, Erik Marchi, Björn Schuller: "Likability of human voices: A feature analysis and a neural network regression approach to automatic likability estimation", in Proc. 14th International Workshop on Image and Audio Analysis for Multimedia Interactive Services (WIA²MIS 2013), Special Session on "Social Stance Analysis", IEEE, Paris, France, 4 pages, 03.-05.07.2013.
  • Björn Schuller, Erik Marchi, Simon Baron-Cohen, Helen O'Reilly, Peter Robinson, Ian Davies, Ofer Golan, Shimrit Friedenson, Shahar Tal, Shai Newman, Noga Meir, Roi Shillo, Antonio Camurri, Stefano Piana, Sven Bölte, Daniel Lundqvist, Steve Berggren, Aurélie Baranger, Nikki Sullings: "ASC-Inclusion: Interactive Emotion Games for Social Inclusion of Children with Autism Spectrum Conditions", in Proc. 1st International Workshop on Intelligent Digital Games for Empowerment and Inclusion (IDGEI 2013) held in conjunction with the 8th Foundations of Digital Games 2013 (FDG), ACM, SASDG Digital Library, Chania, Crete, Greece, 14.05.2013.
  • Björn Schuller, Stefan Steidl, Anton Batliner, Alessandro Vinciarelli, Klaus Scherer, Fabien Ringeval, Mohamed Chetouani, Felix Weninger, Florian Eyben, Erik Marchi, Hugues Salamin, Anna Polychroniou, Fabio Valente, Samuel Kim: "The INTERSPEECH 2013 Computational Paralinguistics Challenge: Social Signals, Conflict, Emotion, Autism, Proc. INTERSPEECH 2013, ISCA, Lyon, France, 2013.
  • S. Newman, O. Golan, S. Baron-Cohen, S. Bölte, A. Baranger, B. Schuller, P. Robinson, A. Camurri, N. Meir, C. Rotman, S. Tal, S. Fridenson, H. O'Reilly, D. Lundqvist, S. Berggren, N. Sullings, E. Marchi, A. Batliner, I. Davies and S. Piana: "ASC-Inclusion – Interactive Software to Help Children with ASC Understand and Express Emotions", in Proc. 12th Annual International Meeting For Autism Research (IMFAR 2013), International Society for Autism Research (INSAR), San Sebastián, Spain, 02.-04.05.2013.
  • Erik Marchi, Björn Schuller, Anton Batliner, Shimrit Fridenzon, Shahar Tal, Ofer Golan: "Emotion in the Speech of Children with Autism Spectrum Conditions: Prosody and Everything Else", in Proc. 3rd Workshop on Child, Computer and Interaction (WOCCI 2012), Satellite Event of INTERSPEECH 2012, Portland, OR, USA, 14.09.2012.
  • Felix Weninger, Erik Marchi, Björn Schuller: "Improving Recognition of Speaker States and Traits by Cumulative Evidence: Intoxication, Sleepiness, Age and Gender", in Proc. INTERSPEECH 2012, ISCA, Portland, OR, USA, 09.-13.09.2012.
  • Erik Marchi, Anton Batliner, Björn Schuller, Shimrit Fridenzon, Shahar Tal, Ofer Golan: "Speech, Emotion, Age, Language, Task, and Typicality: Trying to Disentangle Performance and Feature Relevance", in Proc. First International Workshop on Wide Spectrum Social Signal Processing (WS³P 2012), held in conjunction with the ASE/IEEE International Conference on Social Computing (SocialCom 2012), Mohamed Chetouani, Björn Schuller, Peter Robinson, IEEE, Amsterdam, The Netherlands, 03.-06.09.2012.
  • Björn Schuller, Shimrit Fridenzon, Shahar Tal, Erik Marchi, Anton Batliner, Ofer Golan: "Learning the Acoustics of Autism-Spectrum Emotional Expressions - A Children’s Game?", in Proc. Social Signal Processing IACAPAP 2012 Workshop (SSP IACAPAP 2012), held in conjunction with the 20th World Congress on Brain, Mind and Development (Cerveau, Psyché et Développement), International Association for Child and Adolescent Psychiatry and Allied Professions (IACAPAP), Paris, France, 1 page, 21.-25.07.2012.
  • Martin Wöllmer, Erik Marchi, Stefano Squartini, Björn Schuller: "Multi-Stream LSTM-HMM Decoding and Histogram Equalization for Noise Robust Keyword Spotting", in Cognitive Neurodynamics (CODY), Springer, 2011.
  • Martin Wöllmer, Erik Marchi, Stefano Squartini, Björn Schuller: "Robust Multi-Stream Keyword and Non-Linguistic Vocalization Detection for Computationally Intelligent Virtual Agents", in Proc. of 8th International Symposium on Neural Networks (ISNN 2011), Special Session "Computational Intelligence Algorithms for Advanced Human-Machine Interaction", IEEE Computational Intelligence Society, D. Liu et al. (Eds.): ISNN 2011 Part II, LNCS 6676, Springer Heidelberg, pp. 496-505, Guilin, China, 2011.

Technical Demonstrations:

  • Erik Marchi, Florian Eyben, Gerhard Hagerer, and Björn Schuller. "Real-time Tracking of Speakers’ Emotions, States, and Traits on Mobile Platforms". In Proceedings INTERSPEECH 2016, 17th Annual Conference of the International Speech Communication Association, San Francsico, CA, September 2016. ISCA, ISCA. 2 pages, Show & Tell demonstration, to appear.

  • Florian Eyben, Bernd Huber, Erik Marchi, Dagmar Schuller, and Björn Schuller, "Robust Real-time Affect Analysis and Speaker Characterisation on Mobile Devices", 6th biannual Conference on Affective Computing and Intelligent Interaction (ACII 2015), Xi’an, P. R. China, AAAC, IEEE, September 2015.
  • Florian Eyben, Erik Marchi, and Björn Schuller. "Mobile Real-time Tracking of Speakers’ Emotions, States, and Traits". Show & Tell at 41st IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2016, Shanghai, P. R. China, March 2016. IEEE, to appear.
  • Erik Marchi, Björn Schuller: "ASC-INCLUSION project", 2nd International Workshop on Digital Games for Empowerment and Inclusion (IDGEI 2014) held in conjunction with the 19th International Conference on Intelligent User Interfaces (IUI 2014), ACM, Haifa, Israel, 24.02.2014.
  • Erik Marchi, Shai Newman, Stefano Piana, Alessandra Stagliano, Nikki Sullings: "ASC-Inclusion: Integrated Internet-Based Environment for Social Inclusion of Children with Autism Spectrum Conditions (ASC)", European Commission ICT 2013 - Vilnius, Lithunia, 06-09.11.2013.
  • Erik Marchi, Björn Schuller: "ASC-Inclusion: Interactive multimedia software to help children with Autism understand and express emotions through tone-of-voice", Festival della Scienza, Genoa, Italy, 25.10.2013.
  • Erik Marchi, Björn Schuller: "ASC-Inclusion: Vocal Emotion Games", Proc. 1st International Workshop on Intelligent Digital Games for Empowerment and Inclusion (IDGEI 2013) held in conjunction with the 8th Foundations of Digital Games 2013 (FDG), ACM, SASDG Digital Library, Chania, Crete, Greece, 14.05.2013.

Invited talks:

  • Erik Marchi: "Emotion and Speech of Children with Autism Spectrum Conditions: Performances and Feature Relevance", Turkish German Multimodal Interaction Summit (TGMIS), Istanbul, Turkey, 11.11.2014.
  • Erik Marchi: "Recognition of Reverberated Speech Using Multi-Channel Correlation Shaping Dereverberation and BLSTM Recurrent Neural Networks", 1st European Doctoral Workshop on Speech Technology, Google, London, UK, 29.-30.04.2014.

  • Erik Marchi: "Autism and Emotion: Zero-Resource Cooperative Emotion Gaming", London-Munich Affective & Behavioural Computing Student and Post-doc Summit, Imperial College London, London, UK, 01.05.2014.

  • Erik Marchi: "Memory‐Enhanced Neural Networks and Exemplar‐Based Speech Enhancement for Robust Speech Recognition", CoC NeuroEngineering Networking Session, Technische Universität München, Munich, Germany, 13.01.2015.

hoch

Supervision

Thesis

  • Dario Tonelli (Master Thesis): End-to-End Sound Event Recognition using Deep Convolutional Recurrent Networks
  • Prerna Arora (Master Thesis): Approaching Multi-Language Emotion Recognition from Speech of Children with Autism Spectrum Conditions
  • Fabio Vesperini (Master Thesis): Automatic Novelty Detection with Neural Networks
  • Giacomo Ferroni (Master Thesis): Exploiting Wavelet Transform for Audio Onset Detection with Bidirectional Long Short-Term Memory Neural Networks
  • Duc Hanh Bui Tran (Diploma Thesis): Robustness of Interest and Intoxication Recognition in Prototype Systems

Interdisciplinary Projects

  • Irman Abdić (Interdisciplinary Project with Institute for Informatics, TUM): Automatic Bird Song Detection: New Approaches and Audio Features

International Student Projects

  • Duc Hanh Bui Tran (International Student project with Department of Vehicle Engineering (FTM), TUM - globalDrive 2011/2012): Application of speech and emotion recognition for the automotive HMI. Industry partner: Continental Automotive GmbH

Research assistants

  • Ramón Reyes Robles (Visiting student): Refinement and usability testing of a GUI for vocal coaching

hoch

Program Committee Memberships

  • Program Committee (PC) member, 3rd International Workshop on Intelligent Digital Games for Empowerment and Inclusion (IDGEI 2015) as part of ACM Conference on Intelligent User Interfaces (IUI'15), Atalanta, GA, USA, 29.03.2015
  • Technical Program Committee (TPC) member, 16th ACM International Conference on Multimodal Interaction (ICMI 2014), Istanbul, Turkey, 12-16.11.2014

hoch

Awards

  • Winner of the IEEE Spoken Language Processing Student Travel Grant: George Trigeorgis, Erik Marchi "Adieu Features? End-to-End Speech Emotion Recognition using a Deep Convolutional Recurrent Network" with Fabien Ringeval, Raymond Brueckner, Mihalis Nicolaou, Björn Schuller, Stefanos Zafeiriou. In Proceedings 41st IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2016, Shanghai, P. R. China, March 2016. IEEE.
  • Gold Paper Award: Nicolas Sabouret, Björn Schuller, Lucas Paletta, Erik Marchi, Hazaël Jones, and Atef Ben Youssef. Intelligent User Interfaces in Digital Games for Empowerment and Inclusion. In Proc. Twelfth International Conference on Advances in Computer Entertainment Technology (ACE 2015), 16-19 Nov, Iskandar, Malaysia.
  • Best result MediaEval 2015 Benchmark Affective Impact of Movies Task: George Trigoergis, Eduardo Coutinho, Fabien Ringeval, Erik Marchi, Stefanos Zafeiriou, Björn Schuller: "The ICL-TUM-Passau Approach for the MediaEval 2015 “Affective Impact of Movies” Task", Proc. of the MediaEval 2015 Multimedia Benchmark Workshop, satellite of Interspeech 2015, ISCA, Wurzen, Germany, 03.09.2015.
  • Best Paper Prize 3rd International Workshop on Digital Games for Empowerment and Inclusion (IDGEI 2015) held in conjunction with the 20th International Conference on Intelligent User Interfaces (IUI 2015): Björn Schuller, Erik Marchi, Simon Baron-Cohen, Amandine Lassalle, Helen O’Reilly, Delia Pigat, Peter Robinson, Ian Davies, Tadas Baltrusaitis, Marwa Mahmoud, Ofer Golan, Shimrit Friedenson, Shahar Tal, Shai Newman, Noga Meir, Roi Shillo, Antonio Camurri, Stefano Piana, Alessandra Stagliano, Sven Bölte, Daniel Lundqvist, Steve Berggren, Aurelie Baranger, Nikki Sullings, Metin Sezgin, Nese Alyuz, ´ Agnieszka Rynkiewicz, Kacper Ptaszek, and Karol Ligmann: "Recent developments and results of ASC-Inclusion: An Integrated Internet-Based Environment for Social Inclusion of Children with Autism Spectrum Conditions", Proc. 3rd International Workshop on Intelligent Digital Games for Empowerment and Inclusion (IDGEI 2015) as part of the 20th ACM International Conference on Intelligent User Interfaces, IUI 2015, ACM, Atlanta, GA, 29.03.2015.

hoch

Reviewing

  • International Journal of Computes & Education, Elsevier, since 2016
  • Journal Reviewer, IEEE Transactions on Audio Speech and Language Processing, since 2015
  • Journal Reviewer, IEEE Transactions on Neural Networks and Learning Systems, since 2012
  • Journal Reviewer, IEEE Intelligent Systems, since 2012
  • Journal Reviewer, IEEE Transactions on Affective Computing, since 2012
  • Journal Reviewer, IEEE Signal Processing Letters, since 2014
  • Journal Reviewer, Computer Speech and Language (Elsevier), since 2012
  • Journal Reviewer, Speech Communication (Elsevier), since 2012
  • Journal Reviewer, EURASIP Journal on Audio, Speech, and Music Processing, since 2014
  • Journal Reviewer, IEEE Transactions on Knowledge and Data Engineering, since 2015
  • Reviewer, 17th annual Conference of the International Speech Communication Association (INTERSPEECH 2016), ISCA, San Fransico, USA, 08-12.09.2016.
  • Reviewer, 3rd CHiME Speech Separation and Recognition Challenge, IEEE ASRU 2015, Scottsdale, Arizona, USA, 13-17.12.2015
  • Reviewer, 5th Audio/Visual+ Emotion Challenge and Wrokshop, ACM Multimedia 2015, Brisbane, Australia, 26.10.2015
  • Reviewer, 2015 International Joint Conference on Neural Networks (IJCNN 2015), IEEE, Killarney, Ireland, 12-17.07.2015 .
  • Reviewer, 10th International Conference on Intelligent Computing (ICIC2014), Springer LNCS/LNAI, Taiyuan, China, 3-6.08.2014.
  • Reviewer, ACM 15th International Conference on Multimodal Interfaces (ICMI 2013), ACM, Sydney, Australia, 9-13.12.2013.
  • Reviewer, 4th International Conference on Intelligent Control and Information Processing (ICICIP 2013), ICICIP, Beijing, China, 9-11.06.2013.
  • Reviewer, 1st International Workshop on Intelligent Digital Games for Empowerment and Inclusion (IDGEI 2013) held in conjunction with the 8th Foundations of Digital Games 2013 (FDG), ACM, Chania, Crete, Greece, 14.-17.05.2013.
  • Reviewer, 2nd International Audio/Visual Emotion Challenge and Workshop (AVEC 2012), Grand Challenge and Satellite of ACM ICMI 2012, ACM, Santa Monica, CA, 22.-26.10.2012.
  • Reviewer, 3rd International Conference on Computer & Communication Technology (ICCCT 2012), IEEE, Allahabad, India, 16.-18.11.2012.
  • Reviewer, Workshop on Innovation in Border Control (WIBC 2012), Co-located with the European Intelligence and Security Informatics Conference (EISIC 2012), Odense, Denmark, 22-23.08.2012.

hoch

Projects

DE-ENIGMA: "Multi-Modal Human-Robot Interaction for Teaching and Expanding Social Imagination in Autistic Children" - EU Horizon 2020 Research & Innovation Action (RIA)

ASC-Inclusion: " Integrated Internet-Based Environment for Social Inclusion of Children with Autism Spectrum Conditions (ASC) " - EU FP7- Technical Reports

hoch