Evaluating artificial intelligence in clinical settings: let us not reinvent the wheel (Preprint)

Given the requirement to minimise risks and maximise benefits of technology applications in healthcare provision, there is an urgent need to incorporate theory-informed health information technology evaluation frameworks into existing and emerging guidelines for the evaluation of Artificial Intelligence (AI). Such frameworks can help developers, implementers, and strategic decision makers to build on experience and the existing empirical evidence base. We provide a pragmatic conceptual overview of selected concrete examples on how existing theoryinformed health information technology evaluation frameworks may be used to inform the safe development and implementation of AI in healthcare settings. The list is not exhaustive and is intended to illustrate applications in line with various stakeholder requirements. Existing health information technology evaluation frameworks can help to inform AI-based development and implementation by supporting developers and strategic decision makers in considering relevant technology, user, and organisational dimensions. This can facilitate the design of technologies, their implementation in user and organisational settings, and sustainability and scalability of technologies.