{"id":3396,"date":"2021-02-12T16:43:16","date_gmt":"2021-02-12T16:43:16","guid":{"rendered":"https:\/\/www.digitalfutures.kth.se\/?page_id=3396"},"modified":"2024-02-06T14:22:59","modified_gmt":"2024-02-06T13:22:59","slug":"deep-learning-approaches-for-long-term-future-forecasting","status":"publish","type":"page","link":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/postdoc-fellowships\/completed-postdoc-fellowships\/deep-learning-approaches-for-long-term-future-forecasting\/","title":{"rendered":"Deep Learning Approaches for Long-term Future Forecasting"},"content":{"rendered":"

September 2020 – August 2022<\/p>\n

Objective<\/em>
\nThis project aims to develop a deep learning-based methodology to enhance the ability to model complicated dynamics for sequential data. With a special focus on the recent progress of transformer-based models, which have shown great potential in modelling very long sequences, we are inspired to integrate them with other state-of-the-art techniques, such as learning dynamic structures and self-supervised learning. By exploring such directions, we expect our results to be applicable to the sequence modelling research and provide good insights for\u00a0other fundamental deep learning research areas.<\/p>\n

Background<\/em>
\nSequence modelling is the fundamental problem of other time series related tasks, including future forecasting. Since being proposed in 2018, transformers have become the de facto choice for most sequence modelling tasks due to their superior performance over traditional RNN-based approaches. However, it appears that transformers usually need a significant amount of training data to achieve their full potential, making them an expensive and impractical option for many real-world scenarios. Thus, it becomes increasingly imperative to develop methods to effectively train transformers with limited labelled data, which is quite common for sequence modelling.<\/p>\n

About the Digital Futures Postdoc Fellow<\/em>
\nHao Hu<\/strong> is a postdoc researcher at KTH RPL working with Hossein Azizpour. Before joining KTH, he worked as a research scientist in FX Palo Alto Laboratory (FXPAL), California, United States. Hao got his PhD in Computer Science from the University of Central Florida (UCF) in 2019. His research interests include various topics in machine learning and computer vision, with a special focus on temporal modelling and deep learning.<\/p>\n

Main supervisor<\/em>
\nHossein Azizpour<\/strong>, Assistant Professor, Robotics, Perception and Learning at KTH<\/p>\n

Co-supervisor<\/em>
\nArne Elofsson<\/strong>, Professor in Bioinformatics at Stockholm University<\/p>\n","protected":false},"excerpt":{"rendered":"

September 2020 – August 2022: Hao Hu is a postdoc researcher at KTH RPL working with Hossein Azizpour. Before joining KTH, he worked as a research scientist in FX Palo Alto Laboratory (FXPAL), California, United States.<\/p>\n","protected":false},"author":46,"featured_media":0,"parent":13342,"menu_order":185,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-3396","page","type-page","status-publish","hentry"],"yoast_head":"\nDeep Learning Approaches for Long-term Future Forecasting — Digital Futures<\/title>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Deep Learning Approaches for Long-term Future Forecasting — Digital Futures\" \/>\n<meta property=\"og:description\" content=\"September 2020 - August 2022: Hao Hu is a postdoc researcher at KTH RPL working with Hossein Azizpour. Before joining KTH, he worked as a research scientist in FX Palo Alto Laboratory (FXPAL), California, United States.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/postdoc-fellowships\/completed-postdoc-fellowships\/deep-learning-approaches-for-long-term-future-forecasting\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital Futures\" \/>\n<meta property=\"article:modified_time\" content=\"2024-02-06T13:22:59+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/postdoc-fellowships\\\/completed-postdoc-fellowships\\\/deep-learning-approaches-for-long-term-future-forecasting\\\/\",\"url\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/postdoc-fellowships\\\/completed-postdoc-fellowships\\\/deep-learning-approaches-for-long-term-future-forecasting\\\/\",\"name\":\"Deep Learning Approaches for Long-term Future Forecasting — Digital Futures\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#website\"},\"datePublished\":\"2021-02-12T16:43:16+00:00\",\"dateModified\":\"2024-02-06T13:22:59+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/postdoc-fellowships\\\/completed-postdoc-fellowships\\\/deep-learning-approaches-for-long-term-future-forecasting\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/postdoc-fellowships\\\/completed-postdoc-fellowships\\\/deep-learning-approaches-for-long-term-future-forecasting\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/postdoc-fellowships\\\/completed-postdoc-fellowships\\\/deep-learning-approaches-for-long-term-future-forecasting\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Research\",\"item\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Postdoc fellowships\",\"item\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/postdoc-fellowships\\\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Completed Postdoc fellowships\",\"item\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/research\\\/postdoc-fellowships\\\/completed-postdoc-fellowships\\\/\"},{\"@type\":\"ListItem\",\"position\":5,\"name\":\"Deep Learning Approaches for Long-term Future Forecasting\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#website\",\"url\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/\",\"name\":\"Digital Futures\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#organization\",\"name\":\"Digital Futures\",\"url\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"\\\/wp-content\\\/uploads\\\/sites\\\/7\\\/2020\\\/11\\\/df_black_hires.png\",\"contentUrl\":\"\\\/wp-content\\\/uploads\\\/sites\\\/7\\\/2020\\\/11\\\/df_black_hires.png\",\"width\":5870,\"height\":856,\"caption\":\"Digital Futures\"},\"image\":{\"@id\":\"https:\\\/\\\/wpmu-tris.sys.kth.se\\\/digitalfutures\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Deep Learning Approaches for Long-term Future Forecasting — Digital Futures","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_GB","og_type":"article","og_title":"Deep Learning Approaches for Long-term Future Forecasting — Digital Futures","og_description":"September 2020 - August 2022: Hao Hu is a postdoc researcher at KTH RPL working with Hossein Azizpour. Before joining KTH, he worked as a research scientist in FX Palo Alto Laboratory (FXPAL), California, United States.","og_url":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/postdoc-fellowships\/completed-postdoc-fellowships\/deep-learning-approaches-for-long-term-future-forecasting\/","og_site_name":"Digital Futures","article_modified_time":"2024-02-06T13:22:59+00:00","twitter_card":"summary_large_image","twitter_misc":{"Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/postdoc-fellowships\/completed-postdoc-fellowships\/deep-learning-approaches-for-long-term-future-forecasting\/","url":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/postdoc-fellowships\/completed-postdoc-fellowships\/deep-learning-approaches-for-long-term-future-forecasting\/","name":"Deep Learning Approaches for Long-term Future Forecasting — Digital Futures","isPartOf":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#website"},"datePublished":"2021-02-12T16:43:16+00:00","dateModified":"2024-02-06T13:22:59+00:00","breadcrumb":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/postdoc-fellowships\/completed-postdoc-fellowships\/deep-learning-approaches-for-long-term-future-forecasting\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/postdoc-fellowships\/completed-postdoc-fellowships\/deep-learning-approaches-for-long-term-future-forecasting\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/postdoc-fellowships\/completed-postdoc-fellowships\/deep-learning-approaches-for-long-term-future-forecasting\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/"},{"@type":"ListItem","position":2,"name":"Research","item":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/"},{"@type":"ListItem","position":3,"name":"Postdoc fellowships","item":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/postdoc-fellowships\/"},{"@type":"ListItem","position":4,"name":"Completed Postdoc fellowships","item":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/research\/postdoc-fellowships\/completed-postdoc-fellowships\/"},{"@type":"ListItem","position":5,"name":"Deep Learning Approaches for Long-term Future Forecasting"}]},{"@type":"WebSite","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#website","url":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/","name":"Digital Futures","description":"","publisher":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#organization","name":"Digital Futures","url":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#\/schema\/logo\/image\/","url":"\/wp-content\/uploads\/sites\/7\/2020\/11\/df_black_hires.png","contentUrl":"\/wp-content\/uploads\/sites\/7\/2020\/11\/df_black_hires.png","width":5870,"height":856,"caption":"Digital Futures"},"image":{"@id":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages\/3396","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/users\/46"}],"replies":[{"embeddable":true,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/comments?post=3396"}],"version-history":[{"count":28,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages\/3396\/revisions"}],"predecessor-version":[{"id":14119,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages\/3396\/revisions\/14119"}],"up":[{"embeddable":true,"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/pages\/13342"}],"wp:attachment":[{"href":"https:\/\/wpmu-tris.sys.kth.se\/digitalfutures\/wp-json\/wp\/v2\/media?parent=3396"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}