Numerical Methods for Structured Markov Chains

Numerical Methods for Structured Markov Chains PDF

Author: Dario A. Bini

Publisher: Oxford University Press on Demand

Published: 2005-02-03

Total Pages: 340

ISBN-13: 0198527683

DOWNLOAD EBOOK →

Intersecting two large research areas - numerical analysis and applied probability/queuing theory - this book is a self-contained introduction to the numerical solution of structured Markov chains, which have a wide applicability in queuing theory and stochastic modeling and include M/G/1 and GI/M/1-type Markov chain, quasi-birth-death processes, non-skip free queues and tree-like stochastic processes. Written for applied probabilists and numerical analysts, but accessible toengineers and scientists working on telecommunications and evaluation of computer systems performances, it provides a systematic treatment of the theory and algorithms for important families of structured Markov chains and a thorough overview of the current literature.The book, consisting of nine Chapters, is presented in three parts. Part 1 covers a basic description of the fundamental concepts related to Markov chains, a systematic treatment of the structure matrix tools, including finite Toeplitz matrices, displacement operators, FFT, and the infinite block Toeplitz matrices, their relationship with matrix power series and the fundamental problems of solving matrix equations and computing canonical factorizations. Part 2 deals with the description andanalysis of structure Markov chains and includes M/G/1, quasi-birth-death processes, non-skip-free queues and tree-like processes. Part 3 covers solution algorithms where new convergence and applicability results are proved. Each chapter ends with bibliographic notes for further reading, and the bookends with an appendix collecting the main general concepts and results used in the book, a list of the main annotations and algorithms used in the book, and an extensive index.

Numerical Solution of Markov Chains

Numerical Solution of Markov Chains PDF

Author: William J. Stewart

Publisher: CRC Press

Published: 1991-05-23

Total Pages: 738

ISBN-13: 9780824784058

DOWNLOAD EBOOK →

Papers presented at a workshop held January 1990 (location unspecified) cover just about all aspects of solving Markov models numerically. There are papers on matrix generation techniques and generalized stochastic Petri nets; the computation of stationary distributions, including aggregation/disagg

Computations with Markov Chains

Computations with Markov Chains PDF

Author: William J. Stewart

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 605

ISBN-13: 1461522412

DOWNLOAD EBOOK →

Computations with Markov Chains presents the edited and reviewed proceedings of the Second International Workshop on the Numerical Solution of Markov Chains, held January 16--18, 1995, in Raleigh, North Carolina. New developments of particular interest include recent work on stability and conditioning, Krylov subspace-based methods for transient solutions, quadratic convergent procedures for matrix geometric problems, further analysis of the GTH algorithm, the arrival of stochastic automata networks at the forefront of modelling stratagems, and more. An authoritative overview of the field for applied probabilists, numerical analysts and systems modelers, including computer scientists and engineers.

Numerical Methods for Stochastic Control Problems in Continuous Time

Numerical Methods for Stochastic Control Problems in Continuous Time PDF

Author: Harold Kushner

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 436

ISBN-13: 1468404415

DOWNLOAD EBOOK →

This book is concerned with numerical methods for stochastic control and optimal stochastic control problems. The random process models of the controlled or uncontrolled stochastic systems are either diffusions or jump diffusions. Stochastic control is a very active area of research and new prob lem formulations and sometimes surprising applications appear regularly. We have chosen forms of the models which cover the great bulk of the for mulations of the continuous time stochastic control problems which have appeared to date. The standard formats are covered, but much emphasis is given to the newer and less well known formulations. The controlled process might be either stopped or absorbed on leaving a constraint set or upon first hitting a target set, or it might be reflected or "projected" from the boundary of a constraining set. In some of the more recent applications of the reflecting boundary problem, for example the so-called heavy traffic approximation problems, the directions of reflection are actually discontin uous. In general, the control might be representable as a bounded function or it might be of the so-called impulsive or singular control types. Both the "drift" and the "variance" might be controlled. The cost functions might be any of the standard types: Discounted, stopped on first exit from a set, finite time, optimal stopping, average cost per unit time over the infinite time interval, and so forth.

Advances in Queueing Theory, Methods, and Open Problems

Advances in Queueing Theory, Methods, and Open Problems PDF

Author: Jewgeni H. Dshalalow

Publisher: CRC Press

Published: 2023-07-21

Total Pages: 530

ISBN-13: 1000949931

DOWNLOAD EBOOK →

The progress of science and technology has placed Queueing Theory among the most popular disciplines in applied mathematics, operations research, and engineering. Although queueing has been on the scientific market since the beginning of this century, it is still rapidly expanding by capturing new areas in technology. Advances in Queueing provides a comprehensive overview of problems in this enormous area of science and focuses on the most significant methods recently developed. Written by a team of 24 eminent scientists, the book examines stochastic, analytic, and generic methods such as approximations, estimates and bounds, and simulation. The first chapter presents an overview of classical queueing methods from the birth of queues to the seventies. It also contains the most comprehensive bibliography of books on queueing and telecommunications to date. Each of the following chapters surveys recent methods applied to classes of queueing systems and networks followed by a discussion of open problems and future research directions. Advances in Queueing is a practical reference that allows the reader quick access to the latest methods.

Multiaccess, Reservations & Queues

Multiaccess, Reservations & Queues PDF

Author: Dee Denteneer

Publisher: Springer Science & Business Media

Published: 2008-10-20

Total Pages: 253

ISBN-13: 3540693173

DOWNLOAD EBOOK →

Reservation procedures constitute the core of many popular data transmission protocols. They consist of two steps: A request phase in which a station reserves the communication channel and a transmission phase in which the actual data transmission takes place. Such procedures are often applied in communication networks that are characterised by a shared communication channel with large round-trip times. In this book, we propose queuing models for situations that require a reservation procedure and validate their applicability in the context of cable networks. We offer various mathematical models to better understand the performance of these reservation procedures. The book covers four key performance models, and modifications to these: Contention trees, the repairman model, the bulk service queue, and tandem queues. The relevance of this book is not limited to reservation procedures and cable networks, and performance analysts from a variety of areas may benefit, as all models have found application in other fields as well.

Structured Stochastic Matrices of M/G/1 Type and Their Applications

Structured Stochastic Matrices of M/G/1 Type and Their Applications PDF

Author: Marcel F. Neuts

Publisher: CRC Press

Published: 2021-12-17

Total Pages: 536

ISBN-13: 1000147576

DOWNLOAD EBOOK →

This book deals with Markov chains and Markov renewal processes (M/G/1 type). It discusses numerical difficulties which are apparently inherent in the classical analysis of a variety of stochastic models by methods of complex analysis.

Mathematical Methods in Queueing Theory

Mathematical Methods in Queueing Theory PDF

Author: A. B. Clarke

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 371

ISBN-13: 3642808387

DOWNLOAD EBOOK →

On May 10-12, 1973 a Conference on Mathematical Methods in Graph Theory was held at Western Michigan University in Kalamazoo. The theme of this Conference was recent advances in the application of analytic and algebraic methods to the analysis of queues and queueing networks. In addition some discussion was given to statistical analy ses in queues, control problems and graphical methods. A total of 83 individuals from both industry and academic estab lishments participated in the Conference. A list of these partici pants can be found on page 373. A total of 18 papers were presented, with sUbstantial time being devoted to their informal discussion. This volume constitutes the proceedings of the Conference, and includes all papers presented. TABLE OF CONTENTS MARCEL F. NEUTS The Markov Renewal Branching Process • 1 RALPH L. DISNEY and W. PETER CHERRY Some Topics in Queueing Network Theory 23 JULIAN KEILSON Convexity and Complete Monotonicity in Queueing Distributions and Associated Limit Behavior . • • • • • . . • • • •• • • 45 G. F. NEWELL Graphical Representation of Queue Evolution for Multiple-Server Systems • . • • • • • • • • • • 63 N. U. PRABHU Wiener-Hopf Techniques in Queueing Theory 81 / IAJOS TAKACS Occupation Time Problems in the Theory of Queues 91 TAPAN P. BAGCHI and J. G. C. TEMPLETON Some Finite waiting Space Bulk Queueing Systems 133 U.