{"id":5121,"date":"2021-06-10T22:31:41","date_gmt":"2021-06-10T22:31:41","guid":{"rendered":"https:\/\/www.digitalfutures.kth.se\/?page_id=5121"},"modified":"2024-05-24T14:42:31","modified_gmt":"2024-05-24T12:42:31","slug":"using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction","status":"publish","type":"page","link":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/research-pairs\/completed-research-pairs-projects\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\/","title":{"rendered":"Using Neuroimaging Data for Exploring Conversational Engagement in Human-Robot Interaction"},"content":{"rendered":"<p><em>Objective<br \/>\n<\/em>This project will address interactions with novel conversational systems, such as social robots and digital assistants. These technologies can assist people in societal situations such as health care, elderly care, education, public spaces and homes.<\/p>\n<p><img decoding=\"async\" class=\"alignnone wp-image-5125 size-thumbnail\" src=\"\/wp-content\/uploads\/sites\/7\/2021\/06\/1-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction--e1623363855503-150x150.png\" alt=\"\" width=\"150\" height=\"150\" srcset=\"\/wp-content\/uploads\/sites\/7\/2021\/06\/1-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction--e1623363855503-150x150.png 150w, \/wp-content\/uploads\/sites\/7\/2021\/06\/1-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction--e1623363855503-200x200.png 200w, \/wp-content\/uploads\/sites\/7\/2021\/06\/1-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction--e1623363855503.png 213w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/> <img decoding=\"async\" class=\"alignnone wp-image-5124 size-thumbnail\" src=\"\/wp-content\/uploads\/sites\/7\/2021\/06\/2-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction-e1623363827914-150x150.png\" alt=\"\" width=\"150\" height=\"150\" srcset=\"\/wp-content\/uploads\/sites\/7\/2021\/06\/2-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction-e1623363827914-150x150.png 150w, \/wp-content\/uploads\/sites\/7\/2021\/06\/2-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction-e1623363827914-200x200.png 200w, \/wp-content\/uploads\/sites\/7\/2021\/06\/2-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction-e1623363827914.png 209w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/> <img decoding=\"async\" class=\"alignnone wp-image-5123 size-thumbnail\" src=\"\/wp-content\/uploads\/sites\/7\/2021\/06\/3-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction-e1623363791865-150x150.png\" alt=\"\" width=\"150\" height=\"150\" srcset=\"\/wp-content\/uploads\/sites\/7\/2021\/06\/3-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction-e1623363791865-150x150.png 150w, \/wp-content\/uploads\/sites\/7\/2021\/06\/3-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction-e1623363791865-200x200.png 200w, \/wp-content\/uploads\/sites\/7\/2021\/06\/3-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction-e1623363791865.png 210w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/><\/p>\n<p>A telepresence system for human-robot interaction will be developed, allowing participants to situate themselves in natural conversations while physically in a functional magnetic resonance imaging scanner. Each participant will interact directly with a human-like robot and other human actors while lying in the scanner.<\/p>\n<p>This neuroimaging experiment will allow us to understand cognitive processes underlying engagement. It will also enable an unheard-of in-depth evaluation and perception of conversational engagement as a user state.<\/p>\n<p><em>Background<br \/>\n<\/em>In everyday conversations, a speaker and a listener are involved in a common project that relies on close coordination, requiring each participant&#8217;s continuous attention and related engagement. At the same time, additional bystanders might show less engagement in the conversation.<\/p>\n<p>Previous research in human-human and human-robot interaction has identified four types of events establishing engagement involving gesture and speech: (1) joint directed gaze at objects, (2) mutual facial gaze, (3) back-and-forth conversation, (4) short feedback such as nods while the speaker is talking. We will study the underlying neural signatures of conversational engagement.<\/p>\n<p><em>Crossdisciplinary collaboration<br \/>\n<\/em>The researchers in the team represent the Department of Intelligent Systems at KTH EECS, the Psychology Department and the Linguistics Department at Stockholm University.<\/p>\n<p><strong>Watch the recorded presentation at the Digitalize in Stockholm 2023 event:<\/strong><\/p>\n<div class=\"embed-wrapper\"><iframe title=\"BREAKOUT 4 - Social AI: Using Neuroimaging Data for Exploring Conversational Engagement in Human\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/yaFsplHwpyo?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/div>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Address interactions with novel conversational systems, such as social\u00a0robots, and digital assistants&#8230;<\/p>\n","protected":false},"author":46,"featured_media":5122,"parent":13610,"menu_order":187,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-5121","page","type-page","status-publish","has-post-thumbnail","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.1 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Using Neuroimaging Data for Exploring Conversational Engagement in Human-Robot Interaction &#8212; Digital Futures<\/title>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Using Neuroimaging Data for Exploring Conversational Engagement in Human-Robot Interaction &#8212; Digital Futures\" \/>\n<meta property=\"og:description\" content=\"Address interactions with novel conversational systems, such as social\u00a0robots, and digital assistants...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/research-pairs\/completed-research-pairs-projects\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital Futures\" \/>\n<meta property=\"article:modified_time\" content=\"2024-05-24T12:42:31+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/wpmu-tris.sys.kth.se\/wp-content\/uploads\/sites\/7\/2021\/06\/4-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction.png\" \/>\n\t<meta property=\"og:image:width\" content=\"920\" \/>\n\t<meta property=\"og:image:height\" content=\"452\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/research-pairs\\\/completed-research-pairs-projects\\\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\\\/\",\"url\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/research-pairs\\\/completed-research-pairs-projects\\\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\\\/\",\"name\":\"Using Neuroimaging Data for Exploring Conversational Engagement in Human-Robot Interaction &#8212; Digital Futures\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/research-pairs\\\/completed-research-pairs-projects\\\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/research-pairs\\\/completed-research-pairs-projects\\\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\\\/#primaryimage\"},\"thumbnailUrl\":\"\\\/wp-content\\\/uploads\\\/sites\\\/7\\\/2021\\\/06\\\/4-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction.png\",\"datePublished\":\"2021-06-10T22:31:41+00:00\",\"dateModified\":\"2024-05-24T12:42:31+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/research-pairs\\\/completed-research-pairs-projects\\\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/research-pairs\\\/completed-research-pairs-projects\\\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/research-pairs\\\/completed-research-pairs-projects\\\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\\\/#primaryimage\",\"url\":\"\\\/wp-content\\\/uploads\\\/sites\\\/7\\\/2021\\\/06\\\/4-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction.png\",\"contentUrl\":\"\\\/wp-content\\\/uploads\\\/sites\\\/7\\\/2021\\\/06\\\/4-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction.png\",\"width\":920,\"height\":452},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/research-pairs\\\/completed-research-pairs-projects\\\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Research\",\"item\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Research pairs\",\"item\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/research-pairs\\\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Completed Research pairs projects\",\"item\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/research-pairs\\\/completed-research-pairs-projects\\\/\"},{\"@type\":\"ListItem\",\"position\":5,\"name\":\"Using Neuroimaging Data for Exploring Conversational Engagement in Human-Robot Interaction\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#website\",\"url\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/\",\"name\":\"Digital Futures\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#organization\",\"name\":\"Digital Futures\",\"url\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"\\\/wp-content\\\/uploads\\\/sites\\\/7\\\/2020\\\/11\\\/df_black_hires.png\",\"contentUrl\":\"\\\/wp-content\\\/uploads\\\/sites\\\/7\\\/2020\\\/11\\\/df_black_hires.png\",\"width\":5870,\"height\":856,\"caption\":\"Digital Futures\"},\"image\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Using Neuroimaging Data for Exploring Conversational Engagement in Human-Robot Interaction &#8212; Digital Futures","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_GB","og_type":"article","og_title":"Using Neuroimaging Data for Exploring Conversational Engagement in Human-Robot Interaction &#8212; Digital Futures","og_description":"Address interactions with novel conversational systems, such as social\u00a0robots, and digital assistants...","og_url":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/research-pairs\/completed-research-pairs-projects\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\/","og_site_name":"Digital Futures","article_modified_time":"2024-05-24T12:42:31+00:00","og_image":[{"width":920,"height":452,"url":"https:\/\/wpmu-tris.sys.kth.se\/wp-content\/uploads\/sites\/7\/2021\/06\/4-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/research-pairs\/completed-research-pairs-projects\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\/","url":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/research-pairs\/completed-research-pairs-projects\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\/","name":"Using Neuroimaging Data for Exploring Conversational Engagement in Human-Robot Interaction &#8212; Digital Futures","isPartOf":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#website"},"primaryImageOfPage":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/research-pairs\/completed-research-pairs-projects\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\/#primaryimage"},"image":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/research-pairs\/completed-research-pairs-projects\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\/#primaryimage"},"thumbnailUrl":"\/wp-content\/uploads\/sites\/7\/2021\/06\/4-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction.png","datePublished":"2021-06-10T22:31:41+00:00","dateModified":"2024-05-24T12:42:31+00:00","breadcrumb":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/research-pairs\/completed-research-pairs-projects\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/research-pairs\/completed-research-pairs-projects\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/research-pairs\/completed-research-pairs-projects\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\/#primaryimage","url":"\/wp-content\/uploads\/sites\/7\/2021\/06\/4-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction.png","contentUrl":"\/wp-content\/uploads\/sites\/7\/2021\/06\/4-using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction.png","width":920,"height":452},{"@type":"BreadcrumbList","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/research-pairs\/completed-research-pairs-projects\/using-neuroimaging-data-for-exploring-conversational-engagement-in-human-robot-interaction\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/"},{"@type":"ListItem","position":2,"name":"Research","item":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/"},{"@type":"ListItem","position":3,"name":"Research pairs","item":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/research-pairs\/"},{"@type":"ListItem","position":4,"name":"Completed Research pairs projects","item":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/research-pairs\/completed-research-pairs-projects\/"},{"@type":"ListItem","position":5,"name":"Using Neuroimaging Data for Exploring Conversational Engagement in Human-Robot Interaction"}]},{"@type":"WebSite","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#website","url":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/","name":"Digital Futures","description":"","publisher":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#organization","name":"Digital Futures","url":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#\/schema\/logo\/image\/","url":"\/wp-content\/uploads\/sites\/7\/2020\/11\/df_black_hires.png","contentUrl":"\/wp-content\/uploads\/sites\/7\/2020\/11\/df_black_hires.png","width":5870,"height":856,"caption":"Digital Futures"},"image":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages\/5121","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/users\/46"}],"replies":[{"embeddable":true,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/comments?post=5121"}],"version-history":[{"count":16,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages\/5121\/revisions"}],"predecessor-version":[{"id":14824,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages\/5121\/revisions\/14824"}],"up":[{"embeddable":true,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages\/13610"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/media\/5122"}],"wp:attachment":[{"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/media?parent=5121"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}