Web pages of interest
for
emotion in speech

(link page)

Topics:
Spammers die! Humans please remove _ANTISPAM_ from all email addresses.

Recognition of emotion


Heinrich Niemann, Elmar Nöth, Anton Batliner, Richard Huber
University of Erlangen-Nuremberg, Germany

Recognition of emotion / prosody
http://www5.informatik.uni-erlangen.de
http://www5.informatik.uni-erlangen.de/HTML/English/Research/Speech/Speech.html


R.Picard
MIT

Emotion Recognition in an Actor:
This project on emotion recognition is studying the physiological changes that occurred in an actor as she intentionally induced eight different emotional states over a period of several days.
http://www.media.mit.edu/affect/AC_research/projects/emotion_recognition.html


Noam Amir; noamoto@wine.cteh.ac.il_ANTISPAM_
Center for technological education Holon, Israel

automated detection of emotion in speech

http://www.cteh.ac.il
http://www.cteh.ac.il/staff/noama

Any additional information:
i am responsible for an emotion and speech mailing list


Ingo Hertrich; ingo.hertrich@uni-tuebingen.de_ANTISPAM_
Univ. of Tuebingen, Germany

Speech production and perception


Joy Nicholson; jjnichol@mic.atr.co.jp_ANTISPAM_
Advanced Telecommunications Research (ATR)
Media Integration & Technology Reasearch Labs (MIC), Japan

Emotion recognition in Voice

http://www.mic.atr.co.jp/~jjnichol


Malcolm Slaney and Gerald McRoberts
Interval Research Corporation
Palo Alto, CA 94304, USA

Baby ears: a recognition system for affective vocalizations
http://web.interval.com/papers/1997-063/index.html


John H.L. Hansen; jhlh@cslu.colorado.edu_ANTISPAM_
Center for Spoken Language Understanding
Robust Speech Processing Laboratory
University of Colorado Boulder, USA

His research interests span the areas of digital speech processing, analysis and modeling of speech and speaker traits, speech pathology and voice assessment, speech enhancement and feature estimation in noise, robust speech recognition with current emphasis on robust recognition and training methods for topic spotting in accent, noise, stress, and Lombard effect, and speech feature enhancement in hands-free environments for human-computer interaction.
http://cslu.colorado.edu/rspl/
http://cslu.Colorado.EDU/people/jhlh/


James Kaiser
Goujun Zhou, gzhou@ee.duke.edu_ANTISPAM_
Robust Speech Processing Laboratory
Department of Electrical and Computer Engineering
Duke University

improve the robustness of speech recognition systems under stressful conditions
http://www.ee.duke.edu/people/gzhou.html


Holger Quast
Machine Perception Lab and Institute for Neural Computation
University of California, San Diego
and Drittes Physikalisches Institut, Universität Göttingen
holcus@ucsd.edu_ANTISPAM_

I am conducting research on nonverbal speech machine perception with a focus on efficient data representation to facilitate pattern recognition on the para- and extralinguistic content of speech.

The goal is to model the impressions of listeners according to a semantic differential including emotions, confidence, perceived leadership ability, pleasance etc. An application currently under development is a speech interface for Sony's pet robot dog Aibo.

http://mplab.ucsd.edu/~holcus/Speech.html

Other work at the Machine Perception Lab is geared towards motion and emotion detection in facial images, face tracking, audiovisual speech recognition, and the development of new pattern recognition schemes for machine perception tasks.

http://mplab.ucsd.edu/


Psychology


Prof. Klaus Scherer; scherer@uni2a.unige.ch_ANTISPAM_
Tom Johnstone, Rainer Banse
FACULTE de PSYCHOLOGIE et des SCIENCES de l'EDUCATION. Geneva Emotion Research Group

We conduct research into many aspects of emotions, including experimental studies on emotion-antecedent appraisal, emotion induction, physiological reactions and expression of emotion (facial and vocal) and emotional behaviour in autonomous agents.

A number of applied projects involve the role of emotionality in business and public organisations (e.g. research on emotional climate, human resources, marketing) and in clinical settings (e.g. research on depression, neurological disorders).

http://www.unige.ch/fapse/emotion/

Remark:
The link given above shows many thematically structured links to other research institutes:

Acoustic profiles in prototypical vocal expressions of emotion
http://www.unige.ch/fapse/emotion/members/johnston/profiles.html


Ellen Douglas-Cowie and Roddy Cowie
School of English/School of Psychology
Queen's University Belfast
Northern Ireland

Work emails: e.douglas-cowie@qub.ac.uk_ANTISPAM_ OR r.cowie@qub.ac.uk_ANTISPAM_
Home email: e.cowie@clara.net_ANTISPAM_

http://www.ling.ed.ac.uk/~dabling/belfast/research.html

Abnormal speech, especially post-lingually acquired deafened speech; cochlear implants and their effect on speech; prosody.


Mehrabian
professor emeritus in psychology at UCLA

Emotion and temperament. A study in "Believability" in which he found that the three elements were Verbal, Vocal, Visual. http://www.ablecom.net/users/kaaj/psych/home.html

A summary of a talk using the reference to Mehrabian and Believability/Verbal/Vocal/Visual can be found at http://www.xensei.com/gbsigchi/mtgrpts/rpt_feb99.html.


Prof. Dr. H.-P. Krüger
Psychologisches Institut der Universitä,t Würzburg, Germany

(Web pages only in German)
"Spracherkennung" - temporal structure of speech - und Lidschlagerkennung.
Intention: sehr KFZ-spezifisch
http://www.psychologie.uni-wuerzburg.de/methoden/methff.html


Health Emotion Institute
http://www.healthemotions.org/


Branca Zei PhD; branka.zei@hcuge.ch_ANTISPAM_
Universital Hospital of Geneva
Department of Liason Psychiatry
Behavior and communication Unit

measurement of vocal aspects of emotional expression in patients with specific somatic and/or neurological pathologies.

also at:
Vox Institute - Communication Centre
vox-institute@swissonline.ch

measurement of vocal aspects of emotional expression in healthy subjects; training in delivery skills based on computerised assessment of the subject's speaking style. Special attention is given to prosodic features (intonation, timing, pitch, energy)


Dr. Leon James (Since 1996 he is also known as DrDriving)
TRAFFIC PSYCHOLOGY
at the University of Hawaii

The Nine Zones of Your Driving Personality
http://www.aloha.net/~dyc/authors.html
http://www.soc.hawaii.edu/leonj/leon.html
http://www.aloha.net/~dyc/oldch6.html


Linguistics


Kerstin Fischer; fischer@nats.informatik.uni-hamburg.de_ANTISPAM_
AB NatS, Fachbereich Informatik, Uni Hamburg

linguistic properties of emotionality in human-computer interaction

http://nats-www.informatik.uni-hamburg.de/~fischer/


Cathy Berthouzoz; Catherine.Berthouzoz@lettres.unige.ch_ANTISPAM_
Department of Linguistics
University of Geneva, Switzerland

Machine Translation, Discourse Interpretation

http://latl.unige.ch/


Rob Pensalfini
Lecturer in Linguistics, Department of English
The University of Queensland, Brisbane, Australia

r.pensalfini@mailbox.uq.edu.au_ANTISPAM_


Karen Steffen Chung; karchung@ccms.ntu.edu.tw_ANTISPAM_
Department of Foreign Languages and Literatures
National Taiwan University, Taiwan

Linguistics, phonetics, morphology, ESL

Interested in expression of emotion via intonation for research and teaching in phonetics, ESL, and drama


Margaret Dunham ; madunham@club-internet.fr_ANTISPAM_
Université de Paris 3, France

African linguistics.
Ph.D. in progress : Description ethno-linguistique des Valangi de Tanzanie.

I am not working directly on anything to do with emotions, but as a linguist and a phonetician I am interested in what is going on! Thank you for the opportunity.


Sylvie Mozziconacci
Département de Linguistique
Université de Genève, Switzerland

Emotion and Intonation
http://fonsg3.hum.uva.nl/mozzic/


Philip Lieberman, Lieberman@cogvax.cog.brown.edu_ANTISPAM_

expression of affect and emotion in the vocalizations of human beings and other animals
http://www.cog.brown.edu/~plieber/


Norbert Fries, norbert.fries@rz.hu-berlin.de_ANTISPAM_
Humboldt University of Berlin, Germany

online-lectures
http://www2.rz.hu-berlin.de/inside/linguistik/institut/syntax/mind/
http://www2.rz.hu-berlin.de/inside/linguistik/institut/syntax/lectures.htm
http://www2.rz.hu-berlin.de/inside/linguistik/institut/syntax/fries1.htm#Veroeffentlichungen
Homepage
http://www2.rz.hu-berlin.de/inside/linguistik/institut/syntax/fries.htm


Phonetics


Janet Beck; j.beck@sls.qmced.ac.uk_ANTISPAM_
Queen Margaret University College, Edinburgh, GB

Non verbal communication (especially voice quality) in communication disorder

http://sls.qmced.ac.uk/


Doug Honorof ; honorof@earthlink.net_ANTISPAM_
Haskins Laboratories

I am working in phonetics and phonology

http://www.haskins.yale.edu


Gerrit Bloothooft ; gerrit.bloothooft@let.uu.nl_ANTISPAM_
Utrecht University, The Netherlands

voice quality measurement, singing, pathological voices


Hartmut Traunmüller; hartmut@ling.su.se_ANTISPAM_
The Phonetics Laboratory
Department of Linguistics
Stockholm University, Sweden

Speech perception, paralinguistic phonetics, interlinguistics
http://www.ling.su.se/staff/hartmut/parafone.htm
http://www.ling.su.se/staff/hartmut/
http://www.ling.su.se/fon/


Walter Sendlmeier, Axel Roebel, Astrid Paeschke, Gudrun Klasmeyer, Miriam Kienast, Felix Burkhardt
Institut für Kommunikationswissenschaft
Technische Universität Berlin, Germany

(only in German)

Akustische Parameter des stimmlichen Ausdrucks von Emotionen
http://www.kgw.tu-berlin.de/~gudrun/

Reduktion und Elaboration bei emotionaler Sprechweise
F0-Contours in emotional speech
http://www.kgw.tu-berlin.de/~paeschke/

demonstration of synthesized emotional speech on the web
http://www.kgw.tu-berlin.de/~felixbur/speechEmotions.html


Synthesis


Granström Björn, Carlson Rolf
Department of Speech, Music and Hearing (KTH), Sweden

http://www.speech.kth.se/

This is a demonstration of experiments done at our lab to create synthetic speech with emotions.

http://www.speech.kth.se/info/emot8.html

Project VAESS
http://www.shef.ac.uk/uni/projects/vaess/
http://www.shef.ac.uk/uni/projects/vaess/documents/reference.html


Brigitte Zellner Keller; brigitte.zellner-keller@pop.bluewin.ch_ANTISPAM_
The Computer Speech Analysis Laboratory Lausanne, Switzerland

http://www.unil.ch/imm/docs/LAIP/Zellnerdoc.html


Janet Cahn
Research at the MIT Media Laboratory

Emotional & Expressive Synthesized Speech
http://cahn.www.media.mit.edu/people/cahn/emot-speech.html

Research Areas in Affective Computing
http://cahn.www.media.mit.edu/affect/

Research Areas in Affective Computing:

Research on Human Emotions
http://cahn.www.media.mit.edu/affect/AC_research/emotions.html
14 different Projects, including "Driver's affect"


Speech Research Laboratory
duPont Hospital for Children and the University of Delaware

Applied Science and Engineering Laboratories website
http://www.asel.udel.edu/speech

The ASEL ModelTalker TTS system converts plain English text to speech. Speechsynthesis with emotions (examples) http://www.asel.udel.edu/speech/ModelTalker.html Prosody and Emotions in Speech (Link list): http://www.asel.udel.edu/~yarringt/work.html#Emotions

They also have useful free software, which can be downloaded.


Dr. Ian Murray
University of Dundee

how emotion and other stressing factors are conveyed in human speech? how to simulate vocal emotion in synthetic speech?
http://www.mic.dundee.ac.uk/acsd/research/chat.html
http://alpha.mic.dundee.ac.uk/~irmurray/index.html
http://alpha.mic.dundee.ac.uk/~irmurray/dectalkf.html (wav-demos)
http://alpha.mic.dundee.ac.uk/~irmurray/speelist.html (Link page)

Project: HAMLET
Adding emotion to synthetic speech


Jun Sato. Morishima-lab.,
Seikei University

Emotion Modeling in Speech Production using Emotion Space

http://www.ee.seikei.ac.jp/user/junsato/research/emotionspace.html
http://www.ee.seikei.ac.jp/user/junsato/research/publications.html


Rosalind. W. Picard, Jenniger Healey
MIT

http://vismod.www.media.mit.edu/people/picard/

Affective Computing: A listing of research projects
http://www.media.mit.edu/affect/AC_listings.html
lots of links, try it

http://www.media.mit.edu/affect/AC_research/emotions.html

Synthesizing Emotions in Machines
http://www.media.mit.edu/affect/AC_research/synthesizing.html

Jennifer Healey: I am studying acoustic correlates of emotion
http://fenn.www.media.mit.edu/people/fenn/
(Quantifying Driver Stress)


Felix Burkhardt; felixbur@kgw.tu-berlin.de_ANTISPAM_
Inst. f. Komm.Wiss
TU-Berlin, Germany

simulation of emotion with speech-synthesis

http://www.kgw.tu-berlin.de/~felixbur

I maintain a collection of demonstrations of synthesized emotional speech on the web on and am very interested to hear from other examples.


Marc Schröder; marc@coli.uni-sb.de_ANTISPAM_
Institute of Phonetics, University of the Saarland, Germany

Speech Synthesis, Vocal Emotions, Vocal Emotions for Speech Synthesis

http://www.coli.uni-sb.de/~marc


Véronique Aubergé (and others); auberge@icp.inpg.fr_ANTISPAM_
Institut de la Communication Parlée, ESA CNRS 5009
INPG/Université Stendhal, France

http://www.icp.inpg.fr


Erhard Rank, Erich Prem, Paulo Petta
Hannes Pirker; hannes@ai.univie.ac.at_ANTISPAM_
Austrian Research Institute for Artificial Intelligence

working on prosody in speech synthesis
http://www.ai.univie.ac.at/oefai/oefai.html


Expression of Emotion


Jonathan Klein (MIT mit R. Picard)

Human-computer interaction and its applications in Affective Computing, human emotions, user-centered design, building interactive characters, visual and audio interaction design, educational technology, collaborative learning, social issues in technology research, machine learning, usability engineering, digital music creation, computer game design and graphic design.

What is it like to work with a computer that is aware of its user's emotional state? Or rather, how can we design computers so that they are sensitive to the broad range of our humanity, instead of simply relating to us as if we, too, were computer-like? My research focuses on interaction design issues at the applications side of Affective Computing, a project that aims to bring human emotional awareness and abilities to machines.

Experiments and pictures, Try it.
http://vismod.www.media.mit.edu/people/phaedra/profile.html


Loredana Cerrato; cerrato@poliba.it_ANTISPAM_
University of Bari, Italy

Multimodal speech transmission and perception http://www.uniba.it/


Dan Moonhawk Alford; dalford@haywire.csuhayward.edu_ANTISPAM_
California State University Hayward
California Institute of Integral Studies
John F Kennedy University, USA

Teacher/Linguist, founder of Quantum Linguistics, interested in issues of language & cognition, culture, consciousness, quantum physics and the still little understood insights Native America is willing to share. Of particular relevance to this list is my radical inside-out evolutionary model of language, inspired by Native America and congenial to both Piaget and modern physics, in which emotions play a crucial role: they are seen as a discrete language with its own grammar, thinking, and consciousness, which we share with other life forms.

http://sunflower.com/~dewatson/alford.htm

I warmly invite to my webpage everyone with an interest in language origins, the writings of Benjamin Whorf, consciousness issues, relativity, etc., and those with a curiosity about Quantum Linguistics, launched this summer at a quantum physics conference with comments from physics Nobel Laureate Brian Josephson and others.


Olle Kjellin ; olle.kjellin@hum.vxu.se_ANTISPAM_
Moheda, Sweden Also: Vaxjo University, Sweden

MD & PhD; Speech and hearing science; particularly prosody, pronunciation, pronunciation teaching and learning techniques, 1st and 2nd language acquisition. Also radiological assessment of swallowing disorders.

http://members.xoom.com/SpeechDoctor/

Private enterprise, "Speech Doctor"

Claim to have methods that elicit native or near-native pronunciation in the classroom setting within about 10 minutes of practice (in a language class for non-native speakers). Methods based on hearing physiology and on assumption that prosody has basic importance to language acquisition. Inspiration based on children's 1st language acquisition - which is always successful.


Intelligent agents / systems


Aaron Sloman
The university of Birmingham
School of computer science

http://www.cs.bham.ac.uk/~axs/research.html

THE COGNITION AND AFFECT PROJECT
http://www.cs.bham.ac.uk/~axs/cog_affect/COGAFF-PROJECT.html


Nigel Ward; nigel@sanpo.t.u-tokyo.ac.jp_ANTISPAM_
University of Tokyo, Japan

ephemeral communicative emotions in spoken dialog

http://www.sanpo.t.u-tokyo.ac.jp/~nigel/


Rodney A. Brooks, Cynthia Breazeal (formerly Cynthia Ferrell)
MIT

http://www.ai.mit.edu/people/brooks/brooks.html

My dissertation topic involves building a synthetic creature that learns in a social context. The social learning scenario is akin to a mother-infant pair, where a more capable and socially sophisticated human acts as the caregiver for a robotic "infant"
http://www.ai.mit.edu/projects/
http://www.ai.mit.edu/people/cynthia/cynthia.html


Sony

Aibo, the robot dog
http://www.world.sony.com/robot/


Omron Corporation

Tama, the robot cat
http://www.petrobo.com/english/e-index.html


Fujitsu

FinFin, the multimedia edutainment
http://www.fujitsu.com/


Data bases


The Emotion in Speech Project

http://midwich.reading.ac.uk/research/speechlab/emotion/

The Emotion project was a joint research project between The Speech Laboratory at the University of Reading and The Department of Psychology at the University of Leeds. The project is now complete and copies of the corpus have been deposited with the ESRC Data Archive


Speech Under Simulated and Actual Stress (SUSAS)

http://www.ldc.upenn.edu/ldc/news/release/SUSAS.html


Others


ftp://svr-ftp.eng.cam.ac.uk/pub/comp.speech/archive/

FTP-Server with all earticles from comp.speech.research. This has not especially to do with emotions, but it should be easy to write a program to search this archive.
Alternative: www.deja.com


Emotion and Speech mailing list

Please contact Noam Amir; noamoto@wine.cteh.ac.il_ANTISPAM_ to subscribe


Peter Roach P.J.Roach@reading.ac.uk_ANTISPAM and Mitch Waterman MitchW@psychology.leeds.ac.uk_ANTISPAM et al.

The Emotion in Speech Project
http://www.linguistics.rdg.ac.uk/research/speechlab/emotion/

Abstracts from our papers:
http://midwich.reading.ac.uk/research/speechlab/emotion/papers.html

Leeds University Cognitive Psychology Research Group:
http://www.psyc.leeds.ac.uk/research/cogn/speech/

Reading speech research lab.
http://midwich.reading.ac.uk/research/speechlab/


Speech reading / Lip reading (link page)

http://mambo.ucsc.edu/psl/lipr.html


Emotion Home Page by Jean-Marc Fellous and Eva Hudlicka

http://emotion.salk.edu/emotion.html


Cognition and Emotion

The aim of the Cognition & Emotion programme is to develop a theoretical understanding of the nature of emotion, and of the cognitive (e.g. attention, interpretation, memory) and brain processes that support normal emotional behaviour and experience, as well as emotional disorders.
http://www.mrc-cbu.cam.ac.uk/Research/Cognition_and_Emotion.html


Some stolen examples of emotional speech


This information was collected by Matthias Nutt in Oct. 1999
Please contact me, if you know interesting things, which are not listed above.