Hostname: page-component-78c5997874-v9fdk Total loading time: 0 Render date: 2024-11-13T05:34:45.042Z Has data issue: false hasContentIssue false
  • English
  • Français

A multivariate reward process defined on a semi-Markov process and its first-passage-time distributions

Published online by Cambridge University Press:  14 July 2016

Yasushi Masuda  and
Ushio Sumita
Yasushi Masuda*
Affiliation:
University of California, Riverside
Ushio Sumita*
Affiliation:
University of Rochester
*
∗Postal address: Graduate School of Management, University of California, Riverside, CA 92521, USA.
∗∗Postal address: Simon Graduate School of Business Administration. University of Rochester, Rochester, NY 14627, USA.
Get access Rights & Permissions [Opens in a new window]

Abstract

A multivariate reward process defined on a semi-Markov process is studied. Transform results for the distributions of the multivariate reward and related processes are derived through the method of supplementary variables and the Markov renewal equations. These transform results enable the asymptotic behavior to be analyzed. A class of first-passage time distributions of the multivariate reward processes is also investigated.

Keywords

ASYMPTOTIC ANALYSISFIRST-PASSAGE TIME DISTRIBUTIONS
Type
Research Papers
Information
Journal of Applied Probability , Volume 28 , Issue 2 , June 1991 , pp. 360 - 373
Copyright
Copyright © Applied Probability Trust 1991 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Partially supported by IBM Program of Support for Education in the Management of Information Systems, NSF Grant ECS-8600992, and Nippon Telegraph and Telephone Corporation.

References

Çinlar, E. (1969) Markov renewal theory. Adv. Appl. Prob. 1, 123–187.Google Scholar
Çinlar, E. (1975) Markov renewal theory: A survey. Management Sci. 21, 727–752.Google Scholar
Donatiello, L. and Iyer, B. R. (1987) Analysis of a composite reliability measure for fault-tolerant systems. J. Assoc. Comput. Mach. 34, 179–199.Google Scholar
Jewell, W. S. (1963) Markov renewal programming I: Formulation, finite return models. Operat. Res. 11, 938–948.Google Scholar
Keilson, J. (1969) On the matrix renewal function for Markov renewal processes. Ann. Math. Statist. 40, 1901–1907.10.1214/aoms/1177697274Google Scholar
Keilson, J. (1979) Markov Chain Models — Rarity and Exponentiality. Springer-Verlag, Berlin.Google Scholar
Keilson, J. and Wishart, D. M. G. (1964) A central limit theorem for process defined on a finite Markov chain. Proc. Camb. Phil. Soc. 60, 547–567.10.1017/S0305004100038032Google Scholar
Kulkarni, V. G. (1989) A new class of multivariate phase type distributions. Operat. Res. 37, 151–158.Google Scholar
Kulkarni, V. G., Nicola, V. F. and Trivedi, K. S. (1987) The completion time of a job on multimode systems. Adv. Appl. Prob. 19, 932–954.Google Scholar
Kubat, P., Sumita, U. and Masuda, Y. (1988) Dynamic performance evaluation of communication/computer systems with highly reliable components. Prob. Eng. Inf. Sci. 2, 185–213.10.1017/S0269964800000735Google Scholar
Masuda, Y. (1987) Dynamic Analysis of Computer and Communication Systems: Semi-Markov Approach. Ph.D. Thesis, Simon Graduate School of Business Administration, University of Rochester.Google Scholar
Masuda, Y. and Sumita, U. (1987) Analysis of counting process associated with semi-Markov process: number of entries into a subset of state space. Adv. Appl. Prob. 19, 767–783.Google Scholar
Mclean, R. A. and Neuts, M. F. (1967) The integral of a step function defined on a semi-Markov process. SIAM J. Appl. Math. 15, 726–737.Google Scholar
Meyer, J. F. (1982) Closed-form solutions of performability. IEEE Trans. Computers 31, 648–657.10.1109/TC.1982.1676062Google Scholar
Naylor, A. W. and Sell, G. R. (1982) Linear Operator Theory in Engineering and Science. Springer-Verlag, Berlin.Google Scholar
Pyke, R. and Schaufele, R. A. (1964) Limit theorem for Markov renewal processes. Ann. Math. Statist. 35, 1746–1764.Google Scholar
Smith, W. L. (1955) Regenerative stochastic processes. Proc. R. Soc. London A 232, 6–31.Google Scholar
Sumita, U. (1984) The matrix Laguerre transform. Appl. Math. Computation 15, 1–28.10.1016/0096-3003(84)90050-XGoogle Scholar
Sumita, U. and Kijima, M. (1985) The bivariate Laguerre transform and its applications: numerical exploration of bivariate process. Adv. Appl. Prob. 17, 683–708.10.2307/1427083Google Scholar
Sumita, U. and Masuda, Y. (1987) An alternative approach to the analysis of finite semi-Markov processes. Stoch. Models. 3, 67–87.Google Scholar
Sumita, U., Shanthikumar, J. G. and Masuda, Y. (1987) Analysis of fault-tolerant computer systems. Microelectron. Reliability 27, 65–78.Google Scholar