A modeling framework that combines markov models and discrete-event simulation for stroke patient care

Abstract

Stroke disease places a heavy burden on society, incurring long periods of hospital and community care. Also stroke is a highly complex disease with heterogeneous outcomes and multiple strategies for therapy and care. In this article we develop a modeling framework that clusters patients with respect to their length of stay (LOS); phase-type models are then used to describe patient flows for each cluster. In most cases, there are multiple outcomes, such as discharge to normal residence, nursing home, or death. We therefore derive a novel analytical model for the distribution of LOS in such situations. A model of the whole care system is developed, based on Poisson admissions to hospital, and results obtained for expected numbers in different states of the system at any time. We can thus describe the whole integrated system of stroke patient care, which will facilitate planning of services. We also use the basic model to build a discrete-event simulation, which incorporates back-up queues to model delayed discharge. Based on stroke patients' data from the Belfast City Hospital, various scenarios are explored with a focus on the potential efficiency gains if LOS, prior to discharge to a private nursing home, can be reduced. Predictions for bed occupancy are also provided. The overall modeling framework characterizes the behavior of stroke patient populations, with a focus on integrated system-wide planning, encompassing hospital and community services. Within this general framework we can develop either analytic or simulation models that take account of patient heterogeneity and multiple care options.

References

1. Au-Yeung, S. W. M., Harder, U., Mccoy, E. J., and Knottenbelt, W. J. 2009. Predicting patient arrivals to an accident and Emergency Department. Emerg. Med. J. 26, 241--244.
2. Alexopoulos, C., Goldsman, D., Fontanesi, J., Kopald. D., and Wilson, K. R. 2008. Modeling patient arrivals in community clinics, OMEGA. Int. J. Manage. Science. 36, 4, 853--863.
3. Bagust, A., Place, M., and Posnett, J. W. 1999. Dynamics of bed use in accommodating emergency admissions: stochastic simulation model. British Med. J. 319, 155--158.
4. Barnett, M. J., Kaboli, P. J., Sirio, C. A., and Rosenthal, G. E. 2002 Day of the week of intensive care arrival and patient outcomes: A multisite regional evaluation. Med. Care. 40, 6, 530--539.
5. Bartholomew, D. J., Forbes, A. F., and Mcclean, S. I. 1991. Statistical Techniques for Manpower Planning 2nd Ed., Wiley.
6. Brailsford, S. C., Lattimer, V. A., Tarnaras, P., and Turnbull, J. C. 2004. Emergency and on-demand health care: modeling a large complex system. J. Oper. Res. Soc. 55, 1, 34--42.
7. Cox, J. and Goldratt, E. M. 1986. The Goal: A Process of Ongoing Improvement. North River Press, Great Barrington, MA.
8. Cox, D. R. and Oakes D. 1984. Analysis of Survival Data. Chapman and Hall.
9. de Bruin, A. M., Van Rossum, M. C., Visser, M. C., and Koole, G. M. 2007. Modelling the emergency cardiac in-patient flow: an application of queuing theory. Health Care Manag. Sci. 10, 2, 125--137.
10. Department of Health. 2002. The NHS Plan: A Plan for Investment, a Plan for Reform. Cm 2818-I, Chapter 7: Changes between health and social services, The Stationery Office, London, 70--3.
11. Dimakou, S., Parkin, D., Devlin, N., and Appleby, J. 2009. Identifying the impact of government targets on waiting times in the NHS. Health Care Manag. Sci. 12, 1--10.
12. Donnelly, M., Power, M., Russell, M., and Fullerton, K. 2004. Randomized controlled trial of an early discharge rehabilitation service: The Belfast community stroke trial. Stroke 35, 27--133.
13. Eldabi, T., Paul, R. J., and Taylor, S. J. 2000. Simulating economic factors in adjuvant breast cancer treatment. J Oper. Res. Soc. 51, 4, 465--475.
14. Everitt, J. E. 2002. A decision support simulation model for the management of an elective surgery waiting system. Health Care Manag. Sci. 5, 89--95.
15. Faddy, M. J. and Mcclean, S. I. 2000. Analysing data on lengths of stay of hospital patients using phase-type distributions. Appl Stoch. Models and Data Anal. 15, 311--317.
16. Faddy, M. J. and Mcclean S. I. 2005. Markov chain modeling for geriatric patient care. Meth. Inform. Med. 44, 369--373
17. Fackrell, M. 2009. Modelling healthcare systems with phase-type distributions. Health Care Manag. Sci. 12, 1, 11--26.
18. Garg, L., McClean, S. I., Meenan, B. J., El-Darzi, E., and Millard, P. H. 2009. Clustering patient LOS using mixtures of Gaussian models and Phase type distributions, Proceeding of the IEEE Symposium on Computer-Based Medical Systems, 1--7.
19. Hacke, W., Kaste, M., and Fieschi, C. 1995. Intravenous thrombolysis with recumbent tissue activator for acute hemi-spheric stroke: The European acute stroke study (ECASS). J. Amer. Ass. 274, 1017--1022.
20. Harper, P. R. 2002, A framework for operational modeling of hospital resources. Health Care Manag. Sci. 5, 3, 165--173.
21. Harper, A. M., Taranto, S. E., Edwards, E. B., and Daily O. P. 2000. An update on a successful simulation project: The UNOS liver allocation model. In Proceedings of the Winter Simulation Conference. Joines J. A., Barton R. R., Kang K., and Fishwick P. A. (Eds.), Institute of Electrical and Electronics Engineers. Piscataway, NJ, 1955--1962.
22. Harrison, G. W. and Millard, P. H. 1991. Balancing acute and long-stay care: The mathematics of throughput in departments of geriatric medicine. Method. Inform. Med. 30, 221--228.
23. Harrison, G. Q., Shafer, A., and Mackay. 2005. Modelling variability in hospital bed occupancy. Health Care Manag. Sci. 8, 4, 325--334.
24. Jasinarachchi, K. H., Ibrahim, I. R., Keegan, B. C., Mathialagan, R., Mcgourty, J. C., Phillips, J. R., and Myint, P. K. 2009. Delayed transfer of care from NHS secondary care to primary care in England: Its determinants, effect on hospital bed days, prevalence of acute medical conditions and deaths during delay, in older adults aged 65 years and over. BMC Geriatrics, 9, 4.
25. Katsaliaki, K., Brailsford, S. Browning, D., and Knight, P. 2005. Mapping care pathways for the elderly, J Health Organ Manag, 19, 1, 57--72
26. Kim, S.-C. and Horowitz, I. 2002, Scheduling hospital services: The efficacy of elective-surgery quotas. Omega Int. J. Manag. Science 30, 5, 335--346.
27. Kuhl, M. E. and Wilson, J. R. 2001. Modeling and simulating Poisson processes having trends or nontrigonometric cyclic effects. Eur. J. Oper. Res. 133, 3, 566--582.
28. Kuhl, M. E., Lada, E. K., Steiger, E. K., Flannigan Wagner, M. A., and Wilson, J. R. 2008. Introduction to modeling and generating probabilistic input processes for simulation. Proceedings of the Winter Simulation Conference. 48--61.
29. Kydd, A. 2008. The patient experience of being a delayed discharge, J. Nurs. Manag. 16, 2, 121--6.
30. Latouche, G. and Ramaswami, V. 1999. Introduction to Matrix Analytic Methods in Stochastic Models. SIAM, Philadelphia, PA.
31. McClean S. I. 1976. A continuous time population model with Poisson recruitment. J. Appl. Prob. 13, 348--354.
32. Mcclean, S. I. and Millard, P. H. 2007. Where to treat the older patient? Can Markov models help us better understand the relationship between hospital and community care? J. Oper. Res. Soc. 58, 2, 255--261, ISSN 0160-5682.
33. McClean, S. I., Papadopolou, A. A., and Tsaklides, G. 2004. A reward model for a semi-Markov system with poisson arrivals. Comm. Statist. Theory Methods 33, 3, 623--638.
34. Marshall, A. H. and Mcclean, S. I. 2003. Conditional phase-type distributions for modeling patient LOS in hospital. Intern. Trans. Oper. Res. 10, 6, 565--576.
35. Marshall, A. H. and Mcclean, S. I. 2004. Using Coxian phase-type distributions to identify patient characteristics for duration of stay in hospital. Health Care Manag. Sci. 7, 285--289.
36. Marshall, A. H, Shaw, B., and Mcclean, S. I. 2007. Estimating costs for a group of geriatric patients using the Coxian phase-type distribution. Stat. Med. 26, 2716--2729.
37. Mayer, D. 2004. Essential Evidence-Based Medicine. Cambridge University Press.
38. National Audit Office. 2000. Inpatient Admissions and Bed Management in NHS Acute Hospitals. The stationary office London.
39. National Audit Office. 2003. Ensuring the Effective Discharge of Older Patients from NHS Acute Hospitals. The stationary office London.
40. Neuts, M. F. 1981. Matrix-Geometric Solutions in Stochastic Models: An Algorithmic Approach. The John Hopkins University Press, Baltimore.
41. Quantin, C., Entezam, F., Brunet-Lecomte, P., Lepage E., Guy, H., and Dusserre, L. 1999. High cost factors for leukaemia and lymphoma patients: A new analysis of costs within these diagnosis related groups. J. Epid. Com. Health 53, 24--31.
42. Shahani, A. K., Ridley, S. A., and Nielsen, M. S. 2008. Modelling patient flows as an aid to decision-making for critical care capacities and organisation. Anaesthesia. 63, 10, 1074--80.
43. Shanmugam, R., Anand, S., and Burke, G. 2007. Mining air pollution data to learn stroke incidence, Model Assisted Stat. Appl. 2, 3--58, IOS Press.
44. Stineman, M. G., Maislin, G., Fiedler, R. C., and Granger, C. V. 1997. A prediction model for functional recovery in stroke. Stroke 28, 550--556.
45. Sundberg, G., Bagust, A., and Terent, A. 2003. A model for costs of stroke services. Health Policy 63, 81--94.
46. Syme, P., Litzer, S., and Mckinnon, K. 2003 Estimating stroke unit bed numbers for Scotland: The Scottish borders stroke study Poisson bed-occupancy model. Proceedings of the 12th European Stroke Conference, 21--24.
47. Taylor, K. and Lane, D. 1998. Simulation applied to health services: Opportunities for applying the systems dynamics approach. J. Health Serv. Res. Policy. 3, 226--232.
48. Taylor, G. J., McClean, S. I., and Millard, P. H. 1998. Using a continuous-time Markov model with Poisson arrivals to describe the movements of geriatric patients. Appl. Stoch. Models Data Anal. 14, 165--174.
49. Van Straten, A., Van Der Meulen, J. H. P. van den Bos, G. A. M., and Limburg, M. 1997. Length of hospital stay and discharge delays in stroke patients. Stroke. 28, 1, 137--140.
50. Wardlaw, J. M., Zoppo, G., Yamaguchi, T., and Berge, E. 2003. Thrombolysis for acute ischemic stroke. Cochrane Review, The Cochrane Library. Cochrane Database System Rev 3. Oxford.
51. Xie, H., Chaussalet, T. J., and Millard, P. H. 2005. A continuous-time Markov model for the LOS of elderly people in institutional long-term care. J Royal Stat. Soc. Series A: Statistics in Society. 168, 51--61.
52. Zimmerman, J. E., Kramer, A. A., Mcnair, D. S., and Malila, F. M. 2006. Acute physiology and chronic health evaluation (APACHE) IV: Hospital mortality assessment for today's critically ill patients. Crit. Care Med. 34, 5, 1297--1310.