Predicting the implementation impact of RAPIDx AI  in South Australian emergency departments

Maria Alejandra Pinero de Plaza; Kristina Lambrakis; Carlos Javier Barrera Causil; Fernando Marmolejo Ramos; Derek Chew; Alline Beleigoli; Michael Lawless; Mandy Archibald; Alexandra Mudd; Penelope McMillan; Erin Morton; Rachel Ambagtsheer; Ehsan Khan; Robyn Clark; Renuka Visvanathan; Lalit Yadav; Alison Kitson

Predicting the implementation impact of RAPIDx AI in South Australian emergency departments

Maria Alejandra Pinero de Plaza, Kristina Lambrakis, Carlos Javier Barrera Causil, Fernando Marmolejo Ramos, Derek Chew, Alline Beleigoli, Michael Lawless, Mandy Archibald, Alexandra Mudd, Penelope McMillan, Erin Morton, Rachel Ambagtsheer, Ehsan Khan, Robyn Clark, Renuka Visvanathan, Lalit Yadav, Alison Kitson

Research output: Contribution to conference › Poster › peer-review

Abstract

Background: There were 75,900 presentations to Australian public hospital Emergency Departments (EDs) with a principal diagnosis of Coronary Heart Disease in 2020–21. RAPIDx AI is a randomised controlled trial to test whether computer algorithms in hospital EDs can help doctors provide better care for patients with symptoms that may be due to their heart.

Objective: To develop an evaluation and prediction method to measure stakeholders' perspectives about the implementation impact of RAPIDx AI. This methodological innovation is necessary because person-centred healthcare services require effective technology integration within clinical workflows to provide better patient care while considering the needs of all end-users involved and affected by such types of tech/practices/service changes.

Methods: We introduce an evaluation framework and method based on complexity science and participatory action research (PROLIFERATE). Using Bayesian statistics, we created a protocol and produced computer-simulated results to demonstrate the evaluation and prediction capabilities of the method concerning RAPIDx AI. Ethical approval was granted by the Southern Adelaide Human Research Ethics Committee (SACHREC): OfR no.272.20

Results: Our methodological innovation is informed by 95% probability prediction and credible intervals on these domains of stakeholders' perspectives: Comprehension, Emotional response; Uptake barriers; Motivation and Optimisation. Computer-simulated responses to a PROLIFERATE online survey predicted an Average Impact for RAPIDx AI. The simulation results imply that motivational and emotional knowledge-translation strategies must be implemented for clinicians and the community to improve RAPIDx AI sustainability. (PROLIFERATE constructs benchmarked at 50%—algorithm and data analysis developed in R.)

Conclusion: PROLIFERATE considers the non-linear characteristics of complex and adaptive workflows of acute care environments from an end-user perspective. It can monitor real-world clinical settings, research outcomes, and technological products by assessing their fitness via person-centred parameters and a transdisciplinary approach.

Original language	English
Number of pages	1
Publication status	Published - 28 Oct 2022
Externally published	Yes
Event	South Australian Cardiovascular Showcase - Adelaide, Australia Duration: 28 Oct 2022 → 28 Oct 2022

Conference

Conference	South Australian Cardiovascular Showcase
Country/Territory	Australia
City	Adelaide
Period	28/10/22 → 28/10/22

Cite this

de Plaza, M. A. P., Lambrakis, K., Causil, C. J. B., Ramos, F. M., Chew, D., Beleigoli, A., Lawless, M., Archibald, M., Mudd, A., McMillan, P., Morton, E., Ambagtsheer, R., Khan, E., Clark, R., Visvanathan, R., Yadav, L., & Kitson, A. (2022). Predicting the implementation impact of RAPIDx AI in South Australian emergency departments. Poster session presented at South Australian Cardiovascular Showcase, Adelaide, South Australia, Australia.

@conference{223435f11b3648ec884cc566e18ed2e0,

title = "Predicting the implementation impact of RAPIDx AI in South Australian emergency departments",

abstract = " Background: There were 75,900 presentations to Australian public hospital Emergency Departments (EDs) with a principal diagnosis of Coronary Heart Disease in 2020–21. RAPIDx AI is a randomised controlled trial to test whether computer algorithms in hospital EDs can help doctors provide better care for patients with symptoms that may be due to their heart. Objective: To develop an evaluation and prediction method to measure stakeholders' perspectives about the implementation impact of RAPIDx AI. This methodological innovation is necessary because person-centred healthcare services require effective technology integration within clinical workflows to provide better patient care while considering the needs of all end-users involved and affected by such types of tech/practices/service changes. Methods: We introduce an evaluation framework and method based on complexity science and participatory action research (PROLIFERATE). Using Bayesian statistics, we created a protocol and produced computer-simulated results to demonstrate the evaluation and prediction capabilities of the method concerning RAPIDx AI. Ethical approval was granted by the Southern Adelaide Human Research Ethics Committee (SACHREC): OfR no.272.20 Results: Our methodological innovation is informed by 95\% probability prediction and credible intervals on these domains of stakeholders' perspectives: Comprehension, Emotional response; Uptake barriers; Motivation and Optimisation. Computer-simulated responses to a PROLIFERATE online survey predicted an Average Impact for RAPIDx AI. The simulation results imply that motivational and emotional knowledge-translation strategies must be implemented for clinicians and the community to improve RAPIDx AI sustainability. (PROLIFERATE constructs benchmarked at 50\%—algorithm and data analysis developed in R.) Conclusion: PROLIFERATE considers the non-linear characteristics of complex and adaptive workflows of acute care environments from an end-user perspective. It can monitor real-world clinical settings, research outcomes, and technological products by assessing their fitness via person-centred parameters and a transdisciplinary approach. ",

author = "\{de Plaza\}, \{Maria Alejandra Pinero\} and Kristina Lambrakis and Causil, \{Carlos Javier Barrera\} and Ramos, \{Fernando Marmolejo\} and Derek Chew and Alline Beleigoli and Michael Lawless and Mandy Archibald and Alexandra Mudd and Penelope McMillan and Erin Morton and Rachel Ambagtsheer and Ehsan Khan and Robyn Clark and Renuka Visvanathan and Lalit Yadav and Alison Kitson",

year = "2022",

month = oct,

day = "28",

language = "English",

note = "South Australian Cardiovascular Showcase ; Conference date: 28-10-2022 Through 28-10-2022",

}

de Plaza, MAP, Lambrakis, K, Causil, CJB, Ramos, FM, Chew, D, Beleigoli, A, Lawless, M, Archibald, M, Mudd, A, McMillan, P, Morton, E, Ambagtsheer, R, Khan, E, Clark, R, Visvanathan, R, Yadav, L & Kitson, A 2022, 'Predicting the implementation impact of RAPIDx AI in South Australian emergency departments', South Australian Cardiovascular Showcase, Adelaide, Australia, 28/10/22 - 28/10/22.

Predicting the implementation impact of RAPIDx AI in South Australian emergency departments. / de Plaza, Maria Alejandra Pinero; Lambrakis, Kristina; Causil, Carlos Javier Barrera et al.
2022. Poster session presented at South Australian Cardiovascular Showcase, Adelaide, South Australia, Australia.

Research output: Contribution to conference › Poster › peer-review

TY - CONF

T1 - Predicting the implementation impact of RAPIDx AI in South Australian emergency departments

AU - de Plaza, Maria Alejandra Pinero

AU - Lambrakis, Kristina

AU - Causil, Carlos Javier Barrera

AU - Ramos, Fernando Marmolejo

AU - Chew, Derek

AU - Beleigoli, Alline

AU - Lawless, Michael

AU - Archibald, Mandy

AU - Mudd, Alexandra

AU - McMillan, Penelope

AU - Morton, Erin

AU - Ambagtsheer, Rachel

AU - Khan, Ehsan

AU - Clark, Robyn

AU - Visvanathan, Renuka

AU - Yadav, Lalit

AU - Kitson, Alison

PY - 2022/10/28

Y1 - 2022/10/28

N2 - Background: There were 75,900 presentations to Australian public hospital Emergency Departments (EDs) with a principal diagnosis of Coronary Heart Disease in 2020–21. RAPIDx AI is a randomised controlled trial to test whether computer algorithms in hospital EDs can help doctors provide better care for patients with symptoms that may be due to their heart. Objective: To develop an evaluation and prediction method to measure stakeholders' perspectives about the implementation impact of RAPIDx AI. This methodological innovation is necessary because person-centred healthcare services require effective technology integration within clinical workflows to provide better patient care while considering the needs of all end-users involved and affected by such types of tech/practices/service changes. Methods: We introduce an evaluation framework and method based on complexity science and participatory action research (PROLIFERATE). Using Bayesian statistics, we created a protocol and produced computer-simulated results to demonstrate the evaluation and prediction capabilities of the method concerning RAPIDx AI. Ethical approval was granted by the Southern Adelaide Human Research Ethics Committee (SACHREC): OfR no.272.20 Results: Our methodological innovation is informed by 95% probability prediction and credible intervals on these domains of stakeholders' perspectives: Comprehension, Emotional response; Uptake barriers; Motivation and Optimisation. Computer-simulated responses to a PROLIFERATE online survey predicted an Average Impact for RAPIDx AI. The simulation results imply that motivational and emotional knowledge-translation strategies must be implemented for clinicians and the community to improve RAPIDx AI sustainability. (PROLIFERATE constructs benchmarked at 50%—algorithm and data analysis developed in R.) Conclusion: PROLIFERATE considers the non-linear characteristics of complex and adaptive workflows of acute care environments from an end-user perspective. It can monitor real-world clinical settings, research outcomes, and technological products by assessing their fitness via person-centred parameters and a transdisciplinary approach.

AB - Background: There were 75,900 presentations to Australian public hospital Emergency Departments (EDs) with a principal diagnosis of Coronary Heart Disease in 2020–21. RAPIDx AI is a randomised controlled trial to test whether computer algorithms in hospital EDs can help doctors provide better care for patients with symptoms that may be due to their heart. Objective: To develop an evaluation and prediction method to measure stakeholders' perspectives about the implementation impact of RAPIDx AI. This methodological innovation is necessary because person-centred healthcare services require effective technology integration within clinical workflows to provide better patient care while considering the needs of all end-users involved and affected by such types of tech/practices/service changes. Methods: We introduce an evaluation framework and method based on complexity science and participatory action research (PROLIFERATE). Using Bayesian statistics, we created a protocol and produced computer-simulated results to demonstrate the evaluation and prediction capabilities of the method concerning RAPIDx AI. Ethical approval was granted by the Southern Adelaide Human Research Ethics Committee (SACHREC): OfR no.272.20 Results: Our methodological innovation is informed by 95% probability prediction and credible intervals on these domains of stakeholders' perspectives: Comprehension, Emotional response; Uptake barriers; Motivation and Optimisation. Computer-simulated responses to a PROLIFERATE online survey predicted an Average Impact for RAPIDx AI. The simulation results imply that motivational and emotional knowledge-translation strategies must be implemented for clinicians and the community to improve RAPIDx AI sustainability. (PROLIFERATE constructs benchmarked at 50%—algorithm and data analysis developed in R.) Conclusion: PROLIFERATE considers the non-linear characteristics of complex and adaptive workflows of acute care environments from an end-user perspective. It can monitor real-world clinical settings, research outcomes, and technological products by assessing their fitness via person-centred parameters and a transdisciplinary approach.

UR - https://researchnow.flinders.edu.au/en/publications/183f251a-2cf6-477f-ae97-c769c425e5b7

M3 - Poster

T2 - South Australian Cardiovascular Showcase

Y2 - 28 October 2022 through 28 October 2022

ER -

Predicting the implementation impact of RAPIDx AI in South Australian emergency departments

Abstract

Conference

Other files and links

Fingerprint

Cite this