{"id":86714,"date":"2024-04-30T15:09:17","date_gmt":"2024-04-30T13:09:17","guid":{"rendered":"https:\/\/www.ae-expo.be\/?p=86714"},"modified":"2025-05-07T11:12:15","modified_gmt":"2025-05-07T09:12:15","slug":"co-designing-hardware-and-software-for-a-sustainable-future-of-ai","status":"publish","type":"post","link":"https:\/\/www.ae-expo.be\/nl\/co-designing-hardware-and-software-for-a-sustainable-future-of-ai\/","title":{"rendered":"Co-designing hardware and software for a sustainable future of AI"},"content":{"rendered":"\t\t
\n\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Adoption of AI models is taking off at an unprecedented scale. However, even more widespread AI use in its current technological state could lead to an environmental disaster due to its substantial energy consumption. At the Advanced Engineering expo, on 15 and 16 May in Antwerp, Ben Stoffelen, Department Manager of AI at Imec, discusses how a co-design approach for hardware and software could address AI\u2019s sustainability issues.<\/strong><\/p>

Auteur:\u00a0Koen Vervloesem<\/b><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t

\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

In its annual Digimeter, research institute Imec surveys a representative portion of the Flemish population regarding their views on technological developments. The 2023 edition included some questions about artificial intelligence, and the responses were in line with expectations, shares Ben Stoffelen, the Department Manager of AI at Imec: \u201cAI has made significant inroads into the general population: surveyed individuals replied that they understand it, use it, and believe that it makes them more efficient. This is primarily due to ChatGPT, which reached a high adoption rate in an incredibly short timeframe.\u201d<\/p>\n

Another domain where AI is gaining adoption is within autonomous driving, where vehicles use AI on the edge to process data from an array of sensors. \u201cIn both the Generative Pre-trained Transformer (GPT) instance and in the case of edge AI, the ongoing advances have been enabled by the introduction of high-powered GPU chips,\u201d Stoffelen elaborates. \u201cYet, both training and inference of these AI models consumes copious amounts of energy, resulting in substantial environmental impact. As an illustration, researchers have estimated that training OpenAI\u2019s GPT-3 large language model emits as much CO2 as driving a car to the Moon and back. If GPT models become mainstream and if autonomous driving achieves a breakthrough, we\u2019ll have a huge sustainability problem.\u201d<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t

\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t
Autonomous vehicles use AI on the edge to process data from an array of sensors.<\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Co-designing hardware and software<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

It would be unfortunate if our society were unable to reap the benefits of these powerful AI models. Hence, researchers at Imec\u2019s AI department are looking for methods to keep developing better AI models in a manner that is environmentally friendly. Stoffelen continues: \u201cOne method is using computational devices that are less generic. Given that a GPU and CPU are general compute solutions, they aren\u2019t particularly energy-efficient: they are designed to execute a diverse set of generic processor instructions. But what if we designed a chip specifically tailored for an application, like a heart rate sensor, or a sensor in an autonomous vehicle?\u201d<\/p>

According to Stoffelen, achieving the significant improvements in energy efficiency that we need to keep improving AI applications necessitates a co-design approach for hardware and software: \u201cAI application developers shouldn\u2019t wait until Nvidia releases their next accelerator chip. And chip manufacturers shouldn\u2019t solely aim to create more powerful AI chips. If we want to reach our sustainability goals and create better AI applications, we need to address these issues from the root. This means developing purpose-built hardware for the application. This will permit us to incorporate AI within all types of smart sensors.\u201d Imec regards accelerating this co-design approach as part of its mission.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

Breaking away from von Neumann<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Furthermore, Stoffelen posits that to develop these application-specific, energy-efficient designs, we must break away from the conventional von Neumann architecture that we\u2019ve been accustomed to since the 1940s. \u201cThere exist numerous alternative computer architectures, providing us more flexibility to engineer efficient chips. We\u2019re examining neuromorphic chips, which closely mimic how the human brain works. Another promising approach involves analog processors: using physical characteristics of analog devices for computation. One of our ongoing research programs aims to build AI accelerators based on an analog computer architecture. By embracing new architectures, we\u2019ll potentially reduce an AI model\u2019s energy consumption down to nanojoules or picojoules per inference.\u201d<\/p>

If we manage to address this sustainability issue in AI, Stoffelen predicts the emergence of numerous new applications and breakthroughs in stagnant domains. \u201cProgress in autonomous driving is currently slowing down. Although we have robotaxis, they only fare well because they are restricted to a geofenced and relatively controlled environment. For ordinary cars, the technology plateaued at adaptive cruise control, lane following, and similar features. However, cars eventually encounter unpredictable scenarios, such as harsh weather conditions or pedestrians dressed in dark clothing, leading to detection problems. Manufacturers are attempting to overcome this by adding more and more sensors, but this strategy isn\u2019t feasible. Thus, we require energy-efficient AI to better use existing and novel sensor data.\u201d<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t

\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t
Ben Stoffelen, Department Manager of AI at Imec: \u201cBy embracing new architectures, we\u2019ll potentially reduce an AI model\u2019s energy consumption down to nanojoules or picojoules per inference.\u201d<\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

Adoption of AI models is taking off at an unprecedented scale. However, even more widespread AI use in its current technological state could lead to an environmental disaster due to its substantial energy consumption. At the Advanced Engineering expo, on 15 and 16 May in Antwerp, Ben Stoffelen, Department Manager of AI at Imec, discusses […]<\/p>\n","protected":false},"author":949,"featured_media":86747,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_seopress_robots_primary_cat":"none","_seopress_titles_title":"Advanced Engineering | Inspiration Corner | Product design at DAF gets a digital boost during COVID","_seopress_titles_desc":"Product design at DAF gets a digital boost during COVID.","_seopress_robots_index":"","footnotes":""},"categories":[346],"tags":[],"edition":[],"class_list":["post-86714","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-inspiration-corner"],"_links":{"self":[{"href":"https:\/\/www.ae-expo.be\/nl\/wp-json\/wp\/v2\/posts\/86714","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ae-expo.be\/nl\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ae-expo.be\/nl\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ae-expo.be\/nl\/wp-json\/wp\/v2\/users\/949"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ae-expo.be\/nl\/wp-json\/wp\/v2\/comments?post=86714"}],"version-history":[{"count":5,"href":"https:\/\/www.ae-expo.be\/nl\/wp-json\/wp\/v2\/posts\/86714\/revisions"}],"predecessor-version":[{"id":106362,"href":"https:\/\/www.ae-expo.be\/nl\/wp-json\/wp\/v2\/posts\/86714\/revisions\/106362"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.ae-expo.be\/nl\/wp-json\/wp\/v2\/media\/86747"}],"wp:attachment":[{"href":"https:\/\/www.ae-expo.be\/nl\/wp-json\/wp\/v2\/media?parent=86714"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ae-expo.be\/nl\/wp-json\/wp\/v2\/categories?post=86714"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ae-expo.be\/nl\/wp-json\/wp\/v2\/tags?post=86714"},{"taxonomy":"edition","embeddable":true,"href":"https:\/\/www.ae-expo.be\/nl\/wp-json\/wp\/v2\/edition?post=86714"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}