Ulster University Logo

Ulster Institutional Repository

Discrete time Reward Models for homogeneous semi-Markov Systems

Biomedical Sciences Research Institute Computer Science Research Institute Environmental Sciences Research Institute Nanotechnology & Advanced Materials Research Institute

McClean, SI, Papadopoulou, A and Tsaklides, G (2004) Discrete time Reward Models for homogeneous semi-Markov Systems. Communications in Statistics: Theory and Methods, 33 (3). p. 623. [Journal article]

Full text not available from this repository.

Abstract

Previously,continuous time Markov and semi Markow models have been developed for a multi-grade system with a number of transient states and a single absorbing state.Such systems have been studied with Poisson arrivals with known growth.Such models have been applied to manpower planning and the movement of patients through a hospital system.In this paper,we develop a reward model for a discrete time homogeneous semi Markov system with Poisson arrivals and the same model where the system has growth with known size at each time point.Discrete time is employed here to accommodate a discrete reward structure.Results are obtained for the distribution,and mean of daily rewards of such system at any time,and in steady state;the expected reward in a period of time is also determined.These results are illustrated using data on employees moving through a company hierarchy and data for hospital patients. Key Words: Homogeneity; Poisson recruitment; Semi-Markov process; Stochastic population model; Rewards.

Item Type:Journal article
Faculties and Schools:Faculty of Computing & Engineering
Faculty of Computing & Engineering > School of Computing and Information Engineering
Research Institutes and Groups:Computer Science Research Institute
Computer Science Research Institute > Information and Communication Engineering
ID Code:7563
Deposited By:Professor Sally McClean
Deposited On:12 Apr 2010 16:00
Last Modified:12 Apr 2010 16:00

Repository Staff Only: item control page