Skip to main content
SpringerLink
Log in

Restless Multi-Armed Bandit in Opportunistic Scheduling

  • Book
  • © 2021

Overview

Authors:
  1. Kehao Wang

    1. Wuhan University of Technology, Wuhan, China

    View author publications

    You can also search for this author in PubMed   Google Scholar

  2. Lin Chen

    1. Sun Yat-sen University, Guangzhou, China

    View author publications

    You can also search for this author in PubMed   Google Scholar

  • Introduces Restless Multi-Armed Bandit (RMAB) and presents its relevant tools involved in machine learning and how to adapt them for application
  • Elaborates on research bringing the conventional decision theory and stochastic optimal technology into wireless communication applications involving machine learning
  • Delivers a comprehensive treatment on problems ranging from theoretical modeling and analysis, to practical algorithm design and optimization

This is a preview of subscription content, log in via an institution to check access.

Access this book

Log in via an institution
eBook USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

Licence this eBook for your library

Institutional subscriptions

Table of contents (6 chapters)

  1. Front Matter

    Pages i-xii
    Download chapter PDF

  2. RMAB in Opportunistic Scheduling

    • Kehao Wang, Lin Chen
    Pages 1-7

  3. Myopic Policy for Opportunistic Scheduling: Homogeneous Two-State Channels

    • Kehao Wang, Lin Chen
    Pages 9-36

  4. Whittle Index Policy for Opportunistic Scheduling: Heterogeneous Two-State Channels

    • Kehao Wang, Lin Chen
    Pages 37-77

  5. Myopic Policy for Opportunistic Scheduling: Homogeneous Multistate Channels

    • Kehao Wang, Lin Chen
    Pages 79-107

  6. Whittle Index Policy for Opportunistic Scheduling: Heterogeneous Multistate Channels

    • Kehao Wang, Lin Chen
    Pages 109-141

  7. Conclusion and Perspective

    • Kehao Wang, Lin Chen
    Pages 143-146

  8. Back Matter

    Pages 147-151
    Download chapter PDF
Back to top

Keywords

About this book

This book provides foundations for the understanding and design of computation-efficient algorithms and protocols for those interactions with environment, i.e., wireless communication systems. The book provides a systematic treatment of the theoretical foundation and algorithmic tools necessarily in the design of computation-efficient algorithms and protocols in stochastic scheduling. The problems addressed in the book are of both fundamental and practical importance. Target readers of the book are researchers and advanced-level engineering students interested in acquiring in-depth knowledge on the topic and on stochastic scheduling and their applications, both from theoretical and engineering perspective.

Authors and Affiliations

  • Wuhan University of Technology, Wuhan, China

    Kehao Wang

  • Sun Yat-sen University, Guangzhou, China

    Lin Chen

About the authors

Kehao Wang received the B.S degree in Electrical Engineering, M.S. degree in Communication and Information System from Wuhan University of Technology, Wuhan, China, in 2003 and 2006, respectively, and Ph.D in the Department of Computer Science, the University of Paris-Sud XI, Orsay, France, in 2012. From Feb. 2013 to Aug. 2013, he was a postdoc with the HongKong Polytechnic University. In 2013, he joined the School of Information Engineering at the Wuhan University of Technology. From 2015 to 2018, he had been a visiting scholar in the Laboratory for Information and Decision Systems, Massachusetts Institute of Technology, Cambridge, MA. USA. His research interests are stochastic optimization, operation research, scheduling, wireless network communications, and embedded operating system.


Lin Chen is a professor in the School of Data and Computer Science at Sun Yat-sen University, which he joined in 2019. He received his B. Sc. degree in Electrical Engineering in 2002 from Southeast University, his M. Sc. in Networking in 2005 from University of Paris 6, and his Engineer Diploma and Ph. D. in Computer Science and Networking in 2005 and 2008 from Telecom ParisTech (ENST). He received his Habilitation thesis at University of Paris-Sud in 2017. He was an associate professor at the Department of Computer Science at University of Paris-Sud from 2009 to 2019. His research is focused on distributed algorithms and protocols in emerging networked systems, with particular emphasis on energy efficiency, resilience, and security.

Bibliographic Information

  • Book Title: Restless Multi-Armed Bandit in Opportunistic Scheduling

  • Authors: Kehao Wang, Lin Chen

  • DOI: https://doi.org/10.1007/978-3-030-69959-8

  • Publisher: Springer Cham

  • eBook Packages: Engineering, Engineering (R0)

  • Copyright Information: The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG 2021

  • Hardcover ISBN: 978-3-030-69958-1Published: 20 May 2021

  • Softcover ISBN: 978-3-030-69961-1Published: 21 May 2022

  • eBook ISBN: 978-3-030-69959-8Published: 19 May 2021

  • Edition Number: 1

  • Number of Pages: XII, 151

  • Number of Illustrations: 12 illustrations in colour

  • Topics: Communications Engineering, Networks, Computational Intelligence, Machine Learning

Publish with us

Policies and ethics

Back to top

Search

Navigation