Validity, reliability, and responsiveness of daily monitoring visual analog scales in MASK-air®

Bernardo Sousa-Pinto; Patrik Eklund; Oliver Pfaar; Ludger Klimek; Torsten Zuberbier; Wienczyslawa Czarlewski; Annabelle Bédard; Carsten Bindslev-Jensen; Anna Bedbrook; Sinthia Bosnic-Anticevich; Luisa Brussino; Victoria Cardona; Alvaro A. Cruz; Govert de Vries; Philippe Devillier; Wytske J. Fokkens; José Miguel Fuentes-Pérez; Bilun Gemicioğlu; Tari Haahtela; Yunen Rocío Huerta-Villalobos; Juan Carlos Ivancevich; Inger Kull; Piotr Kuna; Violeta Kvedariene; Désirée E. Larenas Linnemann; Daniel Laune; Michael Makris; Erik Melén; Mário Morais-Almeida; Ralph Mösges; Joaquim Mullol; Robyn E. O'Hehir; Nikolaos G. Papadopoulos; Ana Margarida Pereira; Emmanuel P. Prokopakis; Fotis Psarros; Frederico S. Regateiro; Sietze Reitsma; Boleslaw Samolinski; Nicola Scichilone; Jane da Silva; Cristiana Stellato; Ana Todo-Bom; Peter Valentin Tomazic; Sanna Toppila Salmi; Antonio Valero; Arunas Valiulis; Erkka Valovirta; Michiel van Eerd; Maria Teresa Ventura; Arzu Yorgancioglu; Xavier Basagaña; Josep M. Antó; Jean Bousquet; João A. Fonseca

doi:10.1002/clt2.12062

Validity, reliability, and responsiveness of daily monitoring visual analog scales in MASK-air®

Bernardo Sousa-Pinto, Patrik Eklund, Oliver Pfaar, Ludger Klimek, Torsten Zuberbier, Wienczyslawa Czarlewski, Annabelle Bédard, Carsten Bindslev-Jensen, Anna Bedbrook, Sinthia Bosnic-Anticevich, Luisa Brussino, Victoria Cardona, Alvaro A. Cruz, Govert de Vries, Philippe Devillier, Wytske J. Fokkens, José Miguel Fuentes-Pérez, Bilun Gemicioğlu, Tari Haahtela, Yunen Rocío Huerta-VillalobosJuan Carlos Ivancevich, Inger Kull, Piotr Kuna, Violeta Kvedariene, Désirée E. Larenas Linnemann, Daniel Laune, Michael Makris, Erik Melén, Mário Morais-Almeida, Ralph Mösges, Joaquim Mullol, Robyn E. O'Hehir, Nikolaos G. Papadopoulos, Ana Margarida Pereira, Emmanuel P. Prokopakis, Fotis Psarros, Frederico S. Regateiro, Sietze Reitsma, Boleslaw Samolinski, Nicola Scichilone, Jane da Silva, Cristiana Stellato, Ana Todo-Bom, Peter Valentin Tomazic, Sanna Toppila Salmi, Antonio Valero, Arunas Valiulis, Erkka Valovirta, Michiel van Eerd, Maria Teresa Ventura, Arzu Yorgancioglu, Xavier Basagaña, Josep M. Antó, Jean Bousquet, João A. Fonseca

Research output: Contribution to journal › Review article › peer-review

57 Citations (Scopus)

65 Downloads (Pure)

Abstract

Background: MASK-air® is an app that supports allergic rhinitis patients in disease control. Users register daily allergy symptoms and their impact on activities using visual analog scales (VASs). We aimed to assess the concurrent validity, reliability, and responsiveness of these daily VASs. Methods: Daily monitoring VAS data were assessed in MASK-air® users with allergic rhinitis. Concurrent validity was assessed by correlating daily VAS values with those of the EuroQol-5 Dimensions (EQ-5D) VAS, the Control of Allergic Rhinitis and Asthma Test (CARAT) score, and the Work Productivity and Activity Impairment Allergic Specific (WPAI-AS) Questionnaire (work and activity impairment scores). Intra-rater reliability was assessed in users providing multiple daily VASs within the same day. Test–retest reliability was tested in clinically stable users, as defined by the EQ-5D VAS, CARAT, or “VAS Work” (i.e., VAS assessing the impact of allergy on work). Responsiveness was determined in users with two consecutive measurements of EQ-5D-VAS or “VAS Work” indicating clinical change. Results: A total of 17,780 MASK-air® users, with 317,176 VAS days, were assessed. Concurrent validity was moderate–high (Spearman correlation coefficient range: 0.437–0.716). Intra-rater reliability intraclass correlation coefficients (ICCs) ranged between 0.870 (VAS assessing global allergy symptoms) and 0.937 (VAS assessing allergy symptoms on sleep). Test–retest reliability ICCs ranged between 0.604 and 0.878—“VAS Work” and “VAS asthma” presented the highest ICCs. Moderate/large responsiveness effect sizes were observed—the sleep VAS was associated with lower responsiveness, while the global allergy symptoms VAS demonstrated higher responsiveness. Conclusion: In MASK-air®, daily monitoring VASs have high intra-rater reliability and moderate–high validity, reliability, and responsiveness, pointing to a reliable measure of symptom loads.

Original language	English
Article number	e12062
Pages (from-to)	1-15
Number of pages	15
Journal	Clinical and Translational Allergy
Volume	11
Issue number	7
DOIs	https://doi.org/10.1002/clt2.12062
Publication status	Published - Aug 2021
Externally published	Yes

Bibliographical note

Copyright the Author(s) 2021. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.

Keywords

allergic rhinitis
mobile health
reliability
responsiveness
visual analog scales

Access to Document

10.1002/clt2.12062Licence: CC BY

Publisher version (open access)Final published version, 468 KBLicence: CC BY

Cite this

Sousa-Pinto, B., Eklund, P., Pfaar, O., Klimek, L., Zuberbier, T., Czarlewski, W., Bédard, A., Bindslev-Jensen, C., Bedbrook, A., Bosnic-Anticevich, S., Brussino, L., Cardona, V., Cruz, A. A., de Vries, G., Devillier, P., Fokkens, W. J., Fuentes-Pérez, J. M., Gemicioğlu, B., Haahtela, T., ... Fonseca, J. A. (2021). Validity, reliability, and responsiveness of daily monitoring visual analog scales in MASK-air®. Clinical and Translational Allergy, 11(7), 1-15. Article e12062. https://doi.org/10.1002/clt2.12062

@article{cb4a7434317743afa125ce08c51f34a9,

title = "Validity, reliability, and responsiveness of daily monitoring visual analog scales in MASK-air{\textregistered}",

abstract = "Background: MASK-air{\textregistered} is an app that supports allergic rhinitis patients in disease control. Users register daily allergy symptoms and their impact on activities using visual analog scales (VASs). We aimed to assess the concurrent validity, reliability, and responsiveness of these daily VASs. Methods: Daily monitoring VAS data were assessed in MASK-air{\textregistered} users with allergic rhinitis. Concurrent validity was assessed by correlating daily VAS values with those of the EuroQol-5 Dimensions (EQ-5D) VAS, the Control of Allergic Rhinitis and Asthma Test (CARAT) score, and the Work Productivity and Activity Impairment Allergic Specific (WPAI-AS) Questionnaire (work and activity impairment scores). Intra-rater reliability was assessed in users providing multiple daily VASs within the same day. Test–retest reliability was tested in clinically stable users, as defined by the EQ-5D VAS, CARAT, or “VAS Work” (i.e., VAS assessing the impact of allergy on work). Responsiveness was determined in users with two consecutive measurements of EQ-5D-VAS or “VAS Work” indicating clinical change. Results: A total of 17,780 MASK-air{\textregistered} users, with 317,176 VAS days, were assessed. Concurrent validity was moderate–high (Spearman correlation coefficient range: 0.437–0.716). Intra-rater reliability intraclass correlation coefficients (ICCs) ranged between 0.870 (VAS assessing global allergy symptoms) and 0.937 (VAS assessing allergy symptoms on sleep). Test–retest reliability ICCs ranged between 0.604 and 0.878—“VAS Work” and “VAS asthma” presented the highest ICCs. Moderate/large responsiveness effect sizes were observed—the sleep VAS was associated with lower responsiveness, while the global allergy symptoms VAS demonstrated higher responsiveness. Conclusion: In MASK-air{\textregistered}, daily monitoring VASs have high intra-rater reliability and moderate–high validity, reliability, and responsiveness, pointing to a reliable measure of symptom loads.",

keywords = "allergic rhinitis, mobile health, reliability, responsiveness, visual analog scales",

author = "Bernardo Sousa-Pinto and Patrik Eklund and Oliver Pfaar and Ludger Klimek and Torsten Zuberbier and Wienczyslawa Czarlewski and Annabelle B{\'e}dard and Carsten Bindslev-Jensen and Anna Bedbrook and Sinthia Bosnic-Anticevich and Luisa Brussino and Victoria Cardona and Cruz, \{Alvaro A.\} and \{de Vries\}, Govert and Philippe Devillier and Fokkens, \{Wytske J.\} and Fuentes-P{\'e}rez, \{Jos{\'e} Miguel\} and Bilun Gemicioğlu and Tari Haahtela and Huerta-Villalobos, \{Yunen Roc{\'i}o\} and Ivancevich, \{Juan Carlos\} and Inger Kull and Piotr Kuna and Violeta Kvedariene and \{Larenas Linnemann\}, \{D{\'e}sir{\'e}e E.\} and Daniel Laune and Michael Makris and Erik Mel{\'e}n and M{\'a}rio Morais-Almeida and Ralph M{\"o}sges and Joaquim Mullol and O'Hehir, \{Robyn E.\} and Papadopoulos, \{Nikolaos G.\} and Pereira, \{Ana Margarida\} and Prokopakis, \{Emmanuel P.\} and Fotis Psarros and Regateiro, \{Frederico S.\} and Sietze Reitsma and Boleslaw Samolinski and Nicola Scichilone and \{da Silva\}, Jane and Cristiana Stellato and Ana Todo-Bom and Tomazic, \{Peter Valentin\} and \{Toppila Salmi\}, Sanna and Antonio Valero and Arunas Valiulis and Erkka Valovirta and \{van Eerd\}, Michiel and Ventura, \{Maria Teresa\} and Arzu Yorgancioglu and Xavier Basaga{\~n}a and Ant{\'o}, \{Josep M.\} and Jean Bousquet and Fonseca, \{Jo{\~a}o A.\}",

note = "Copyright the Author(s) 2021. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.",

year = "2021",

month = aug,

doi = "10.1002/clt2.12062",

language = "English",

volume = "11",

pages = "1--15",

journal = "Clinical and Translational Allergy",

issn = "2045-7022",

publisher = "Springer, Springer Nature",

number = "7",

}

Sousa-Pinto, B, Eklund, P, Pfaar, O, Klimek, L, Zuberbier, T, Czarlewski, W, Bédard, A, Bindslev-Jensen, C, Bedbrook, A, Bosnic-Anticevich, S, Brussino, L, Cardona, V, Cruz, AA, de Vries, G, Devillier, P, Fokkens, WJ, Fuentes-Pérez, JM, Gemicioğlu, B, Haahtela, T, Huerta-Villalobos, YR, Ivancevich, JC, Kull, I, Kuna, P, Kvedariene, V, Larenas Linnemann, DE, Laune, D, Makris, M, Melén, E, Morais-Almeida, M, Mösges, R, Mullol, J, O'Hehir, RE, Papadopoulos, NG, Pereira, AM, Prokopakis, EP, Psarros, F, Regateiro, FS, Reitsma, S, Samolinski, B, Scichilone, N, da Silva, J, Stellato, C, Todo-Bom, A, Tomazic, PV, Toppila Salmi, S, Valero, A, Valiulis, A, Valovirta, E, van Eerd, M, Ventura, MT, Yorgancioglu, A, Basagaña, X, Antó, JM, Bousquet, J & Fonseca, JA 2021, 'Validity, reliability, and responsiveness of daily monitoring visual analog scales in MASK-air®', Clinical and Translational Allergy, vol. 11, no. 7, e12062, pp. 1-15. https://doi.org/10.1002/clt2.12062

TY - JOUR

T1 - Validity, reliability, and responsiveness of daily monitoring visual analog scales in MASK-air®

AU - Sousa-Pinto, Bernardo

AU - Eklund, Patrik

AU - Pfaar, Oliver

AU - Klimek, Ludger

AU - Zuberbier, Torsten

AU - Czarlewski, Wienczyslawa

AU - Bédard, Annabelle

AU - Bindslev-Jensen, Carsten

AU - Bedbrook, Anna

AU - Bosnic-Anticevich, Sinthia

AU - Brussino, Luisa

AU - Cardona, Victoria

AU - Cruz, Alvaro A.

AU - de Vries, Govert

AU - Devillier, Philippe

AU - Fokkens, Wytske J.

AU - Fuentes-Pérez, José Miguel

AU - Gemicioğlu, Bilun

AU - Haahtela, Tari

AU - Huerta-Villalobos, Yunen Rocío

AU - Ivancevich, Juan Carlos

AU - Kull, Inger

AU - Kuna, Piotr

AU - Kvedariene, Violeta

AU - Larenas Linnemann, Désirée E.

AU - Laune, Daniel

AU - Makris, Michael

AU - Melén, Erik

AU - Morais-Almeida, Mário

AU - Mösges, Ralph

AU - Mullol, Joaquim

AU - O'Hehir, Robyn E.

AU - Papadopoulos, Nikolaos G.

AU - Pereira, Ana Margarida

AU - Prokopakis, Emmanuel P.

AU - Psarros, Fotis

AU - Regateiro, Frederico S.

AU - Reitsma, Sietze

AU - Samolinski, Boleslaw

AU - Scichilone, Nicola

AU - da Silva, Jane

AU - Stellato, Cristiana

AU - Todo-Bom, Ana

AU - Tomazic, Peter Valentin

AU - Toppila Salmi, Sanna

AU - Valero, Antonio

AU - Valiulis, Arunas

AU - Valovirta, Erkka

AU - van Eerd, Michiel

AU - Ventura, Maria Teresa

AU - Yorgancioglu, Arzu

AU - Basagaña, Xavier

AU - Antó, Josep M.

AU - Bousquet, Jean

AU - Fonseca, João A.

N1 - Copyright the Author(s) 2021. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.

PY - 2021/8

Y1 - 2021/8

N2 - Background: MASK-air® is an app that supports allergic rhinitis patients in disease control. Users register daily allergy symptoms and their impact on activities using visual analog scales (VASs). We aimed to assess the concurrent validity, reliability, and responsiveness of these daily VASs. Methods: Daily monitoring VAS data were assessed in MASK-air® users with allergic rhinitis. Concurrent validity was assessed by correlating daily VAS values with those of the EuroQol-5 Dimensions (EQ-5D) VAS, the Control of Allergic Rhinitis and Asthma Test (CARAT) score, and the Work Productivity and Activity Impairment Allergic Specific (WPAI-AS) Questionnaire (work and activity impairment scores). Intra-rater reliability was assessed in users providing multiple daily VASs within the same day. Test–retest reliability was tested in clinically stable users, as defined by the EQ-5D VAS, CARAT, or “VAS Work” (i.e., VAS assessing the impact of allergy on work). Responsiveness was determined in users with two consecutive measurements of EQ-5D-VAS or “VAS Work” indicating clinical change. Results: A total of 17,780 MASK-air® users, with 317,176 VAS days, were assessed. Concurrent validity was moderate–high (Spearman correlation coefficient range: 0.437–0.716). Intra-rater reliability intraclass correlation coefficients (ICCs) ranged between 0.870 (VAS assessing global allergy symptoms) and 0.937 (VAS assessing allergy symptoms on sleep). Test–retest reliability ICCs ranged between 0.604 and 0.878—“VAS Work” and “VAS asthma” presented the highest ICCs. Moderate/large responsiveness effect sizes were observed—the sleep VAS was associated with lower responsiveness, while the global allergy symptoms VAS demonstrated higher responsiveness. Conclusion: In MASK-air®, daily monitoring VASs have high intra-rater reliability and moderate–high validity, reliability, and responsiveness, pointing to a reliable measure of symptom loads.

AB - Background: MASK-air® is an app that supports allergic rhinitis patients in disease control. Users register daily allergy symptoms and their impact on activities using visual analog scales (VASs). We aimed to assess the concurrent validity, reliability, and responsiveness of these daily VASs. Methods: Daily monitoring VAS data were assessed in MASK-air® users with allergic rhinitis. Concurrent validity was assessed by correlating daily VAS values with those of the EuroQol-5 Dimensions (EQ-5D) VAS, the Control of Allergic Rhinitis and Asthma Test (CARAT) score, and the Work Productivity and Activity Impairment Allergic Specific (WPAI-AS) Questionnaire (work and activity impairment scores). Intra-rater reliability was assessed in users providing multiple daily VASs within the same day. Test–retest reliability was tested in clinically stable users, as defined by the EQ-5D VAS, CARAT, or “VAS Work” (i.e., VAS assessing the impact of allergy on work). Responsiveness was determined in users with two consecutive measurements of EQ-5D-VAS or “VAS Work” indicating clinical change. Results: A total of 17,780 MASK-air® users, with 317,176 VAS days, were assessed. Concurrent validity was moderate–high (Spearman correlation coefficient range: 0.437–0.716). Intra-rater reliability intraclass correlation coefficients (ICCs) ranged between 0.870 (VAS assessing global allergy symptoms) and 0.937 (VAS assessing allergy symptoms on sleep). Test–retest reliability ICCs ranged between 0.604 and 0.878—“VAS Work” and “VAS asthma” presented the highest ICCs. Moderate/large responsiveness effect sizes were observed—the sleep VAS was associated with lower responsiveness, while the global allergy symptoms VAS demonstrated higher responsiveness. Conclusion: In MASK-air®, daily monitoring VASs have high intra-rater reliability and moderate–high validity, reliability, and responsiveness, pointing to a reliable measure of symptom loads.

KW - allergic rhinitis

KW - mobile health

KW - reliability

KW - responsiveness

KW - visual analog scales

UR - https://www.scopus.com/pages/publications/85115860874

U2 - 10.1002/clt2.12062

DO - 10.1002/clt2.12062

M3 - Review article

C2 - 34567526

SN - 2045-7022

VL - 11

SP - 1

EP - 15

JO - Clinical and Translational Allergy

JF - Clinical and Translational Allergy

IS - 7

M1 - e12062

ER -

Validity, reliability, and responsiveness of daily monitoring visual analog scales in MASK-air®

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this