Topic:

Toward Scalable Generative AI via Mixture of Experts in Mobile Edge Networks

Date & Time:

23 Sepetember 2024 (Monday) 14.00 p.m. - 17.00 p.m.

Venue:

Online (via Tecent Meeting ID: 392-461-785)

Speaker:

Dusit Niyato, Ph.D.

President's Chair Professor in Computer Science and Engineering

Nanyang Technological University, Singapore

Editor-in-Chief, IEEE Communications Surveys and Tutorials

Moderator：

Hongliang ZHANG, Assiatant Professor

Institute of Information and Communication Technology

School of Electronics, Peking University

Abstract:

The evolution of generative artificial intelligence (GAI) has driven revolutionary applications like ChatGPT. The proliferation of these applications is underpinned by the mixture of experts (MoE), which contains multiple experts and selectively engages them for each task to lower operation costs while maintaining performance. Despite MoE's efficiencies, GAI still faces challenges in resource utilization when deployed on local user devices. Therefore, we first propose mobile edge networks supported MoE-based GAI. Rigorously, we review the MoE from traditional AI and GAI perspectives, scrutinizing its structure, principles, and applications. Next, we present a new framework for using MoE for GAI services in Metaverse. Moreover, we propose a framework that transfers subtasks to devices in mobile edge networks, aiding GAI model operation on user devices. Moreover, we introduce a novel approach utilizing MoE, augmented with Large Language Models (LLMs), to analyze user objectives and constraints of optimization problems based on deep reinforcement learning (DRL) effectively. This approach selects specialized DRL experts, and weights each decision from the participating experts. In this process, the LLM acts as the gate network to oversee the expert models, facilitating a collective of experts to tackle a wide range of new tasks. Furthermore, it can also leverage LLM's advanced reasoning capabilities to manage the output of experts for joint decisions. Lastly, we insightfully identify research opportunities of MoE and mobile edge networks.

Brief-Bio:

Dusit Niyato is currently the President’s Chair professor in Computer Science and Engineering, Nanyang Technological University, Singapore. Dusit’s research interests are in the areas of generative AI, Internet of Things (IoT), edge intelligent metaverse, mobile and distributed computing, and wireless networks. Dusit won the Best Young Researcher Award of ComSoc Asia Pacific, The 2011 IEEE Comsoc Fred W. Ellersick Prize Paper Award, the IEEE Computer Society Middle Career Researcher Award for Excellence in Scalable Computing in 2021, and Distinguished Technical Achievement Recognition Award of IEEE ComSoc Technical Committee on Green Communications and Computing 2022. Currently, Dusit is serving as Editor-in-Chief of IEEE Communications Surveys and Tutorials, an area editor of IEEE Transactions on Vehicular Technology, editor of IEEE Transactions on Wireless Communications, associate editor of IEEE Internet of Things Journal, IEEE Transactions on Mobile Computing, IEEE Wireless Communications, IEEE Network, and ACM Computing Surveys. He was named the 2017-2021 highly cited researcher in computer science. He is a Fellow of IEEE and a Fellow of IET.