{"id":10478,"date":"2022-11-16T17:24:41","date_gmt":"2022-11-16T16:24:41","guid":{"rendered":"https:\/\/www.digitalfutures.kth.se\/?page_id=10478"},"modified":"2022-11-16T17:28:14","modified_gmt":"2022-11-16T16:28:14","slug":"activities-results","status":"publish","type":"page","link":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/collaborative-projects\/completed-collaborative-projects\/advanced-adaptive-intelligent-systems-aais\/activities-results\/","title":{"rendered":"Activities & Results"},"content":{"rendered":"

Find out what\u2019s going on!<\/strong><\/p>\n

Results<\/strong><\/p>\n

\n
\n
\n
\n

The main results achieved in the first half of the project towards the 3 main objectives enumerated in the proposal:<\/p>\n

1. Understanding and Design for the Smart Kitchen<\/strong><\/p>\n

Deeper understanding of the cooking process (Kuoppama\u0308ki et al, 2021) led to a number of studies on interaction in and around cooking, including list advancement (Jaber & McMillan, 2022), content navigation (Zhao et al., 2022), designing conversational interaction (Kuoppama\u0308ki et al., 2023), the impact of contextual awareness on command construction and delivery (Jaber et al., in submission) and an ongoing study comparing proactive organisational support between young adults and those over 65 (Kuoppama\u0308ki et al.).<\/p>\n

2. Perception and Representation of Long Term Human Action<\/strong><\/p>\n

Research showing that thermal imaging is a modality relevant for detecting frustration in human-robot interaction (Mohamed et al., 2022). The models to predict frustration based on a dataset of 18 participants interacting with a Nao social robot in our lab were tested using features from several modalities: thermal, RGB, Electrodermal Activity (EDA), and all three combined. The models reached an accuracy of 89% with just RGB features, 87% using only thermal features, 84% using EDA, and 86% when using all modalities. We are also investigating the accuracy of frutration prediction models using data collected at the KTH Library where students ask directions to a Furhat robot.<\/p>\n

3. Input, Output, and Interaction for Smart Assistive Technologies<\/strong><\/p>\n

In order to fulfil the goal of adaptation of virtual agent and robot behaviour to different contexts, we have researched interlocutor-aware facial expressions in dyadic interaction (Jonell et al, 2020) as well as adaptive facial expressions in controllable generation of speech and gesture: we have developed techniques to generate conversational speech, with control over speaking style to signal e.g. certainty or uncertainty (Wang et al, 2022, Kirkland et al 2022) as well as models that are able to generate coherent speech and gesture from a common representation (Wang et al 2021). Another direction concerns adaptation to spatial contexts and environments, where we have used imitation learning and physical simulation to produce referential gestures (Deichler et al, 2022).<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Find out what’s going on…<\/p>\n","protected":false},"author":46,"featured_media":0,"parent":674,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-10478","page","type-page","status-publish","hentry"],"yoast_head":"\nActivities & Results — Digital Futures<\/title>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Activities & Results — Digital Futures\" \/>\n<meta property=\"og:description\" content=\"Find out what's going on...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/collaborative-projects\/completed-collaborative-projects\/advanced-adaptive-intelligent-systems-aais\/activities-results\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital Futures\" \/>\n<meta property=\"article:modified_time\" content=\"2022-11-16T16:28:14+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/collaborative-projects\\\/completed-collaborative-projects\\\/advanced-adaptive-intelligent-systems-aais\\\/activities-results\\\/\",\"url\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/collaborative-projects\\\/completed-collaborative-projects\\\/advanced-adaptive-intelligent-systems-aais\\\/activities-results\\\/\",\"name\":\"Activities & Results — Digital Futures\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#website\"},\"datePublished\":\"2022-11-16T16:24:41+00:00\",\"dateModified\":\"2022-11-16T16:28:14+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/collaborative-projects\\\/completed-collaborative-projects\\\/advanced-adaptive-intelligent-systems-aais\\\/activities-results\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/collaborative-projects\\\/completed-collaborative-projects\\\/advanced-adaptive-intelligent-systems-aais\\\/activities-results\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/collaborative-projects\\\/completed-collaborative-projects\\\/advanced-adaptive-intelligent-systems-aais\\\/activities-results\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Research\",\"item\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Collaborative projects\",\"item\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/collaborative-projects\\\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Completed Collaborative projects\",\"item\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/collaborative-projects\\\/completed-collaborative-projects\\\/\"},{\"@type\":\"ListItem\",\"position\":5,\"name\":\"Advanced Adaptive Intelligent Systems\",\"item\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/collaborative-projects\\\/completed-collaborative-projects\\\/advanced-adaptive-intelligent-systems-aais\\\/\"},{\"@type\":\"ListItem\",\"position\":6,\"name\":\"Activities & Results\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#website\",\"url\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/\",\"name\":\"Digital Futures\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#organization\",\"name\":\"Digital Futures\",\"url\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"\\\/wp-content\\\/uploads\\\/sites\\\/7\\\/2020\\\/11\\\/df_black_hires.png\",\"contentUrl\":\"\\\/wp-content\\\/uploads\\\/sites\\\/7\\\/2020\\\/11\\\/df_black_hires.png\",\"width\":5870,\"height\":856,\"caption\":\"Digital Futures\"},\"image\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Activities & Results — Digital Futures","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_GB","og_type":"article","og_title":"Activities & Results — Digital Futures","og_description":"Find out what's going on...","og_url":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/collaborative-projects\/completed-collaborative-projects\/advanced-adaptive-intelligent-systems-aais\/activities-results\/","og_site_name":"Digital Futures","article_modified_time":"2022-11-16T16:28:14+00:00","twitter_card":"summary_large_image","twitter_misc":{"Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/collaborative-projects\/completed-collaborative-projects\/advanced-adaptive-intelligent-systems-aais\/activities-results\/","url":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/collaborative-projects\/completed-collaborative-projects\/advanced-adaptive-intelligent-systems-aais\/activities-results\/","name":"Activities & Results — Digital Futures","isPartOf":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#website"},"datePublished":"2022-11-16T16:24:41+00:00","dateModified":"2022-11-16T16:28:14+00:00","breadcrumb":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/collaborative-projects\/completed-collaborative-projects\/advanced-adaptive-intelligent-systems-aais\/activities-results\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/collaborative-projects\/completed-collaborative-projects\/advanced-adaptive-intelligent-systems-aais\/activities-results\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/collaborative-projects\/completed-collaborative-projects\/advanced-adaptive-intelligent-systems-aais\/activities-results\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/"},{"@type":"ListItem","position":2,"name":"Research","item":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/"},{"@type":"ListItem","position":3,"name":"Collaborative projects","item":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/collaborative-projects\/"},{"@type":"ListItem","position":4,"name":"Completed Collaborative projects","item":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/collaborative-projects\/completed-collaborative-projects\/"},{"@type":"ListItem","position":5,"name":"Advanced Adaptive Intelligent Systems","item":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/collaborative-projects\/completed-collaborative-projects\/advanced-adaptive-intelligent-systems-aais\/"},{"@type":"ListItem","position":6,"name":"Activities & Results"}]},{"@type":"WebSite","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#website","url":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/","name":"Digital Futures","description":"","publisher":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#organization","name":"Digital Futures","url":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#\/schema\/logo\/image\/","url":"\/wp-content\/uploads\/sites\/7\/2020\/11\/df_black_hires.png","contentUrl":"\/wp-content\/uploads\/sites\/7\/2020\/11\/df_black_hires.png","width":5870,"height":856,"caption":"Digital Futures"},"image":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages\/10478","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/users\/46"}],"replies":[{"embeddable":true,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/comments?post=10478"}],"version-history":[{"count":3,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages\/10478\/revisions"}],"predecessor-version":[{"id":10483,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages\/10478\/revisions\/10483"}],"up":[{"embeddable":true,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages\/674"}],"wp:attachment":[{"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/media?parent=10478"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}