-
JMIR mHealth and uHealth · Jul 2020
Evaluation Criteria for Weight Management Apps: Validation Using a Modified Delphi Process.
- Noemí Robles, Elisa Puigdomènech Puig, Corpus Gómez-Calderón, Francesc Saigí-Rubió, Guillem Cuatrecasas Cambra, Alberto Zamora, Montse Moharra, Guillermo Paluzié, Mariona Balfegó, and Carme Carrion.
- eHealth Lab Research Group, Universitat Oberta de Catalunya, Barcelona, Spain.
- JMIR Mhealth Uhealth. 2020 Jul 22; 8 (7): e16899.
BackgroundThe use of apps for weight management has increased over recent years; however, there is a lack of evidence regarding the efficacy and safety of these apps. The EVALAPPS project will develop and validate an assessment instrument to specifically assess the safety and efficacy of weight management apps.ObjectiveThe aim of this study was to reach a consensus among stakeholders on a comprehensive set of criteria to guide development of the EVALAPPS assessment instrument. A modified Delphi process was used in order to verify the robustness of the criteria that had been identified through a literature review and to prioritize a set of the identified criteria.MethodsStakeholders (n=31) were invited to participate in a 2-round Delphi process with 114 initial criteria that had been identified from the literature. In round 1, participants rated criteria according to relevance on a scale from 0 ("I suggest this criterion is excluded") to 5 ("This criterion is extremely relevant"). A criterion was accepted if the median rating was 4 or higher and if the relative intraquartile range was equal to 0.67 or lower. In round 2, participants were asked about criteria that had been discarded in round 1. A prioritization strategy was used to identify crucial criteria according to (1) the importance attributed by participants (criteria with a mean rating of 4.00 or higher), (2) the level of consensus (criteria with a score of 4 or 5 by at least 80% of the participants).ResultsThe response rate was 83.9% (26/31) in round 1 and 90.3% (28/31) in round 2. A total of 107 out of 114 criteria (93.9%) were accepted by consensus-105 criteria in round 1 and 2 criteria in round 2. After prioritization, 53 criteria were deemed crucial. These related mainly to the dimensions of security and privacy (13/53, 24.5%) and usability (9/53, 17.0%), followed by activity data (5/53, 9.4%), clinical effectiveness (5/53, 9.4%), and reliability (5/53, 9.4%).ConclusionsResults confirmed the robustness of the criteria that were identified, with those relating to security and privacy being deemed most relevant by stakeholders. Additionally, a specific set of criteria based on health indicators (activity data, physical state data, and personal data) was also prioritized.©Noemí Robles, Elisa Puigdomènech Puig, Corpus Gómez-Calderón, Francesc Saigí-Rubió, Guillem Cuatrecasas Cambra, Alberto Zamora, Montse Moharra, Guillermo Paluzié, Mariona Balfegó, Carme Carrion. Originally published in JMIR mHealth and uHealth (http://mhealth.jmir.org), 22.07.2020.
Notes
Knowledge, pearl, summary or comment to share?You can also include formatting, links, images and footnotes in your notes
- Simple formatting can be added to notes, such as
*italics*
,_underline_
or**bold**
. - Superscript can be denoted by
<sup>text</sup>
and subscript<sub>text</sub>
. - Numbered or bulleted lists can be created using either numbered lines
1. 2. 3.
, hyphens-
or asterisks*
. - Links can be included with:
[my link to pubmed](http://pubmed.com)
- Images can be included with:
![alt text](https://bestmedicaljournal.com/study_graph.jpg "Image Title Text")
- For footnotes use
[^1](This is a footnote.)
inline. - Or use an inline reference
[^1]
to refer to a longer footnote elseweher in the document[^1]: This is a long footnote.
.