Job Overview
Doctoral student in multimodal machine learning for human-robot interaction.
School of Electrical Engineering and Computer Science at KTH
KTH is one of Europe’s leading technical universities and an important arena for knowledge development. As Sweden’s largest university for technical research and education, we bring together students, researchers and faculty from all over the world. Our research and education covers both natural sciences and all branches of technology as well as architecture, industrial economics, urban planning, history and philosophy.
Project description
Doctoral education subject: Computer science
In this project, the student will design, develop, evaluate and optimize a telepresence platform that is specially developed to collect multimodal data for training machine learning models. Unattended and monitored multimodal machine learning models together with multimodal fusion technologies will be investigated to evaluate the quality of the telepresence platform. Mixed reality technology will also be explored as part of the telepresence platform as it offers an excellent opportunity for data collection (and thus learning multimodal models of social behavior). Users’ mixed reality headsets make it possible to extract several different data streams, such as real-time head position, eye direction, pupil size and high frame rate video stream from the user’s perspective.
This service is partly funded by the Digital Futures project on “Using neuroimaging data to explore conversational engagement in human-robot interaction”. This project will be conducted within an interdisciplinary research collaboration with Julia Uddén from the Linguistics Department at SU, where the goal is to study social robotics by observing the underlying neural processes in humans that observe, interact with and control robots. Understanding these neural processes and how they integrate with other modalities contributes to the research areas Human-Robot Interaction, Artificial Intelligence, Psycho- and Neurolinguistics and Neurobiology of Language.
The student will be supervised by André Pereira, researcher on artificial intelligence and interaction between humans and robots at KTH within the Division of Speech, Music and Hearing (TMH). The start date is open for discussion, although we would like that service to start in early 2022.
We offer
- The opportunity to do a PhD in a dynamic, international research environment in collaboration with industry and prominent universities around the world Read more
- A workplace with many employment benefits and monthly salary according to KTH’s agreement for doctoral salaries.
- Doctoral education at a higher education institution that is active and supportive on issues such as working conditions, gender equality and diversity, and the study environment.
- Work and studies in Stockholm with proximity to nature and the sea.
Admission eligibility
To be admitted to doctoral education (Chapter 7 39 of the Higher Education Ordinance), the applicant must have basic eligibility:
- completed a degree at second-cycle level;
- completed course requirements of at least 240 credits, of which at least 60 credits at second-cycle level;
- acquired essentially equivalent knowledge within or outside the country.
In addition to the above, there is also a mandatory requirement in English equivalent to English B/6.
Job Detail
- Offered SalaryNot Specified
- Career LevelNot Specified
- ExperienceNot Specified
- GenderBoth
- INDUSTRYEducation
- QualificationBachelor's Degree