The evolution of mobile apps for asthma: an updated systematic assessment of content and tools
Identifieur interne : 000177 ( Pmc/Corpus ); précédent : 000176; suivant : 000178The evolution of mobile apps for asthma: an updated systematic assessment of content and tools
Auteurs : Kit Huckvale ; Cecily Morrison ; Jing Ouyang ; Aseem Ghaghda ; Josip CarSource :
- BMC Medicine [ 1741-7015 ] ; 2015.
Abstract
Interest in mobile apps that support long-term conditions such as asthma is matched by recognition of the importance of the quality and safety of apps intended for patient use. We assessed how changes over a 2-year period affected the clinical suitability of apps providing self-management information and tools for people with asthma by updating a review first performed in 2011.
Systematic content assessment of all apps for iOS and Android examining the comprehensiveness of asthma information, consistency with the evidence base for asthma self-management and adherence to best practice principles for trustworthy content, comparing the quality of apps available in 2011 to those released since.
Between 2011 and 2013, numbers of asthma apps more than doubled from 93 to 191, despite withdrawal of 25% (n = 23/93) of existing apps. Newer apps were no more likely than those available in 2011 to include comprehensive information, such as the use of action plans, or offer guidance consistent with evidence; 13% (n = 19/147) of all apps, and 39% (n = 9/23) of those intended to manage acute asthma, recommended self-care procedures unsupported by evidence. Despite increases in the numbers of apps targeting specific skills, such as acute asthma management (n = 12 to 23) and inhaler technique (from n = 2 to 12), the proportion consistent with guidelines (17%, n = 4/23) and inhaler instructions (25%, n = 3/12), respectively, was low, and most apps provided only either basic information about asthma (50%, n = 75/147) or simple diary functions (24%, n = 36/147).
In addition to persisting questions about clinical quality and safety, dynamic aspects of app turnover and feature evolution affect the suitability of asthma apps for use in routine care. The findings underline the need for coordinated quality assurance processes that can adapt to changing clinical and information governance-related risks, ensure compliance with the evidence base and reflect local variations in clinical practice. It is unclear if substantial clinical benefits can be realized from a landscape dominated by low quality generic information apps and tools that do not adhere to accepted medical practice.
The online version of this article (doi:10.1186/s12916-015-0303-x) contains supplementary material, which is available to authorized users.
Url:
DOI: 10.1186/s12916-015-0303-x
PubMed: 25857569
PubMed Central: 4391129
Links to Exploration step
PMC:4391129Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">The evolution of mobile apps for asthma: an updated systematic assessment of content and tools</title><author><name sortKey="Huckvale, Kit" sort="Huckvale, Kit" uniqKey="Huckvale K" first="Kit" last="Huckvale">Kit Huckvale</name><affiliation><nlm:aff id="Aff1">Global eHealth Unit, Imperial College London, Reynolds Building, St Dunstan’s Road, London, W6 8RP UK</nlm:aff></affiliation></author><author><name sortKey="Morrison, Cecily" sort="Morrison, Cecily" uniqKey="Morrison C" first="Cecily" last="Morrison">Cecily Morrison</name><affiliation><nlm:aff id="Aff1">Global eHealth Unit, Imperial College London, Reynolds Building, St Dunstan’s Road, London, W6 8RP UK</nlm:aff></affiliation></author><author><name sortKey="Ouyang, Jing" sort="Ouyang, Jing" uniqKey="Ouyang J" first="Jing" last="Ouyang">Jing Ouyang</name><affiliation><nlm:aff id="Aff1">Global eHealth Unit, Imperial College London, Reynolds Building, St Dunstan’s Road, London, W6 8RP UK</nlm:aff></affiliation></author><author><name sortKey="Ghaghda, Aseem" sort="Ghaghda, Aseem" uniqKey="Ghaghda A" first="Aseem" last="Ghaghda">Aseem Ghaghda</name><affiliation><nlm:aff id="Aff1">Global eHealth Unit, Imperial College London, Reynolds Building, St Dunstan’s Road, London, W6 8RP UK</nlm:aff></affiliation></author><author><name sortKey="Car, Josip" sort="Car, Josip" uniqKey="Car J" first="Josip" last="Car">Josip Car</name><affiliation><nlm:aff id="Aff1">Global eHealth Unit, Imperial College London, Reynolds Building, St Dunstan’s Road, London, W6 8RP UK</nlm:aff></affiliation><affiliation><nlm:aff id="Aff2">Health Services and Outcomes Research Programme, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore</nlm:aff></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">25857569</idno><idno type="pmc">4391129</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4391129</idno><idno type="RBID">PMC:4391129</idno><idno type="doi">10.1186/s12916-015-0303-x</idno><date when="2015">2015</date><idno type="wicri:Area/Pmc/Corpus">000177</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">The evolution of mobile apps for asthma: an updated systematic assessment of content and tools</title><author><name sortKey="Huckvale, Kit" sort="Huckvale, Kit" uniqKey="Huckvale K" first="Kit" last="Huckvale">Kit Huckvale</name><affiliation><nlm:aff id="Aff1">Global eHealth Unit, Imperial College London, Reynolds Building, St Dunstan’s Road, London, W6 8RP UK</nlm:aff></affiliation></author><author><name sortKey="Morrison, Cecily" sort="Morrison, Cecily" uniqKey="Morrison C" first="Cecily" last="Morrison">Cecily Morrison</name><affiliation><nlm:aff id="Aff1">Global eHealth Unit, Imperial College London, Reynolds Building, St Dunstan’s Road, London, W6 8RP UK</nlm:aff></affiliation></author><author><name sortKey="Ouyang, Jing" sort="Ouyang, Jing" uniqKey="Ouyang J" first="Jing" last="Ouyang">Jing Ouyang</name><affiliation><nlm:aff id="Aff1">Global eHealth Unit, Imperial College London, Reynolds Building, St Dunstan’s Road, London, W6 8RP UK</nlm:aff></affiliation></author><author><name sortKey="Ghaghda, Aseem" sort="Ghaghda, Aseem" uniqKey="Ghaghda A" first="Aseem" last="Ghaghda">Aseem Ghaghda</name><affiliation><nlm:aff id="Aff1">Global eHealth Unit, Imperial College London, Reynolds Building, St Dunstan’s Road, London, W6 8RP UK</nlm:aff></affiliation></author><author><name sortKey="Car, Josip" sort="Car, Josip" uniqKey="Car J" first="Josip" last="Car">Josip Car</name><affiliation><nlm:aff id="Aff1">Global eHealth Unit, Imperial College London, Reynolds Building, St Dunstan’s Road, London, W6 8RP UK</nlm:aff></affiliation><affiliation><nlm:aff id="Aff2">Health Services and Outcomes Research Programme, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore</nlm:aff></affiliation></author></analytic><series><title level="j">BMC Medicine</title><idno type="eISSN">1741-7015</idno><imprint><date when="2015">2015</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><sec><title>Background</title><p>Interest in mobile apps that support long-term conditions such as asthma is matched by recognition of the importance of the quality and safety of apps intended for patient use. We assessed how changes over a 2-year period affected the clinical suitability of apps providing self-management information and tools for people with asthma by updating a review first performed in 2011.</p></sec><sec><title>Methods</title><p>Systematic content assessment of all apps for iOS and Android examining the comprehensiveness of asthma information, consistency with the evidence base for asthma self-management and adherence to best practice principles for trustworthy content, comparing the quality of apps available in 2011 to those released since.</p></sec><sec><title>Results</title><p>Between 2011 and 2013, numbers of asthma apps more than doubled from 93 to 191, despite withdrawal of 25% (n = 23/93) of existing apps. Newer apps were no more likely than those available in 2011 to include comprehensive information, such as the use of action plans, or offer guidance consistent with evidence; 13% (n = 19/147) of all apps, and 39% (n = 9/23) of those intended to manage acute asthma, recommended self-care procedures unsupported by evidence. Despite increases in the numbers of apps targeting specific skills, such as acute asthma management (n = 12 to 23) and inhaler technique (from n = 2 to 12), the proportion consistent with guidelines (17%, n = 4/23) and inhaler instructions (25%, n = 3/12), respectively, was low, and most apps provided only either basic information about asthma (50%, n = 75/147) or simple diary functions (24%, n = 36/147).</p></sec><sec><title>Conclusions</title><p>In addition to persisting questions about clinical quality and safety, dynamic aspects of app turnover and feature evolution affect the suitability of asthma apps for use in routine care. The findings underline the need for coordinated quality assurance processes that can adapt to changing clinical and information governance-related risks, ensure compliance with the evidence base and reflect local variations in clinical practice. It is unclear if substantial clinical benefits can be realized from a landscape dominated by low quality generic information apps and tools that do not adhere to accepted medical practice.</p></sec><sec><title>Electronic supplementary material</title><p>The online version of this article (doi:10.1186/s12916-015-0303-x) contains supplementary material, which is available to authorized users.</p></sec></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Klasnja, P" uniqKey="Klasnja P">P Klasnja</name></author><author><name sortKey="Pratt, W" uniqKey="Pratt W">W Pratt</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Fox, S" uniqKey="Fox S">S Fox</name></author><author><name sortKey="Duggan, M" uniqKey="Duggan M">M Duggan</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Aitken, M" uniqKey="Aitken M">M Aitken</name></author><author><name sortKey="Gauntlett, C" uniqKey="Gauntlett C">C Gauntlett</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Steinhubl, Sr" uniqKey="Steinhubl S">SR Steinhubl</name></author><author><name sortKey="Muse, Ed" uniqKey="Muse E">ED Muse</name></author><author><name sortKey="Topol, Ej" uniqKey="Topol E">EJ Topol</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="England, Nhs" uniqKey="England N">NHS England</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Rosser, Ba" uniqKey="Rosser B">BA Rosser</name></author><author><name sortKey="Eccleston, C" uniqKey="Eccleston C">C Eccleston</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mccartney, M" uniqKey="Mccartney M">M McCartney</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cortez, Ng" uniqKey="Cortez N">NG Cortez</name></author><author><name sortKey="Cohen, Ig" uniqKey="Cohen I">IG Cohen</name></author><author><name sortKey="Kesselheim, As" uniqKey="Kesselheim A">AS Kesselheim</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wolf, Ja" uniqKey="Wolf J">JA Wolf</name></author><author><name sortKey="Moreau, Jf" uniqKey="Moreau J">JF Moreau</name></author><author><name sortKey="Akilov, O" uniqKey="Akilov O">O Akilov</name></author><author><name sortKey="Patton, T" uniqKey="Patton T">T Patton</name></author><author><name sortKey="English, Jc" uniqKey="English J">JC English</name></author><author><name sortKey="Ho, J" uniqKey="Ho J">J Ho</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Huckvale, K" uniqKey="Huckvale K">K Huckvale</name></author><author><name sortKey="Car, J" uniqKey="Car J">J Car</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Atienza, Aa" uniqKey="Atienza A">AA Atienza</name></author><author><name sortKey="Patrick, K" uniqKey="Patrick K">K Patrick</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Buijink, Awg" uniqKey="Buijink A">AWG Buijink</name></author><author><name sortKey="Visser, Bj" uniqKey="Visser B">BJ Visser</name></author><author><name sortKey="Marshall, L" uniqKey="Marshall L">L Marshall</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="De La Vega, R" uniqKey="De La Vega R">R De La Vega</name></author><author><name sortKey="Miro, J" uniqKey="Miro J">J Miro</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bender, Jl" uniqKey="Bender J">JL Bender</name></author><author><name sortKey="Yue, Ry" uniqKey="Yue R">RY Yue</name></author><author><name sortKey="To, Mj" uniqKey="To M">MJ To</name></author><author><name sortKey="Deacken, L" uniqKey="Deacken L">L Deacken</name></author><author><name sortKey="Jadad, Ar" uniqKey="Jadad A">AR Jadad</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Huckvale, K" uniqKey="Huckvale K">K Huckvale</name></author><author><name sortKey="Car, M" uniqKey="Car M">M Car</name></author><author><name sortKey="Morrison, C" uniqKey="Morrison C">C Morrison</name></author><author><name sortKey="Car, J" uniqKey="Car J">J Car</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Partridge, Mr" uniqKey="Partridge M">MR Partridge</name></author><author><name sortKey="Negro, Rwd" uniqKey="Negro R">RWD Negro</name></author><author><name sortKey="Olivieri, D" uniqKey="Olivieri D">D Olivieri</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Masoli, M" uniqKey="Masoli M">M Masoli</name></author><author><name sortKey="Fabian, D" uniqKey="Fabian D">D Fabian</name></author><author><name sortKey="Holt, S" uniqKey="Holt S">S Holt</name></author><author><name sortKey="Beasley, R" uniqKey="Beasley R">R Beasley</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Patel, S" uniqKey="Patel S">S Patel</name></author><author><name sortKey="Park, H" uniqKey="Park H">H Park</name></author><author><name sortKey="Bonato, P" uniqKey="Bonato P">P Bonato</name></author><author><name sortKey="Chan, L" uniqKey="Chan L">L Chan</name></author><author><name sortKey="Rodgers, M" uniqKey="Rodgers M">M Rodgers</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Heredia, A" uniqKey="Heredia A">A Heredia</name></author><author><name sortKey="Garcia Guzman, J" uniqKey="Garcia Guzman J">J Garcia-Guzman</name></author><author><name sortKey="Amescua Seco, A" uniqKey="Amescua Seco A">A Amescua-Seco</name></author><author><name sortKey="Velasco Diego, M" uniqKey="Velasco Diego M">M Velasco-Diego</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Charani, E" uniqKey="Charani E">E Charani</name></author><author><name sortKey="Castro Sanchez, E" uniqKey="Castro Sanchez E">E Castro-Sanchez</name></author><author><name sortKey="Moore, L" uniqKey="Moore L">L Moore</name></author><author><name sortKey="Holmes, A" uniqKey="Holmes A">A Holmes</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Barton, A" uniqKey="Barton A">A Barton</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Alliance, Ecd" uniqKey="Alliance E">ECD Alliance</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Food, Us" uniqKey="Food U">US Food</name></author><author><name sortKey="Administration, D" uniqKey="Administration D">D Administration</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Ferrero Alvarez Rementeria, J" uniqKey="Ferrero Alvarez Rementeria J">J Ferrero-Alvarez-Rementeria</name></author><author><name sortKey="Santana Lopez, V" uniqKey="Santana Lopez V">V Santana-Lopez</name></author><author><name sortKey="Escobar Ubreva, A" uniqKey="Escobar Ubreva A">A Escobar-Ubreva</name></author><author><name sortKey="Vazquez Vazquez, M" uniqKey="Vazquez Vazquez M">M Vazquez-Vazquez</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Marvel, Fa" uniqKey="Marvel F">FA Marvel</name></author><author><name sortKey="Chase, J" uniqKey="Chase J">J Chase</name></author><author><name sortKey="Madruga, M" uniqKey="Madruga M">M Madruga</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Fisher, Ra" uniqKey="Fisher R">RA Fisher</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Freeman, Gh" uniqKey="Freeman G">GH Freeman</name></author><author><name sortKey="Halton, Jh" uniqKey="Halton J">JH Halton</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Holm, S" uniqKey="Holm S">S Holm</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cates, Cj" uniqKey="Cates C">CJ Cates</name></author><author><name sortKey="Rowe, Bh" uniqKey="Rowe B">BH Rowe</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Van Der Palen, J" uniqKey="Van Der Palen J">J van der Palen</name></author><author><name sortKey="Klein, Jj" uniqKey="Klein J">JJ Klein</name></author><author><name sortKey="Kerkhoff, Ahm" uniqKey="Kerkhoff A">AHM Kerkhoff</name></author><author><name sortKey="Van Herwaarden, Cla" uniqKey="Van Herwaarden C">CLA van Herwaarden</name></author><author><name sortKey="Seydel, Er" uniqKey="Seydel E">ER Seydel</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Melani, As" uniqKey="Melani A">AS Melani</name></author><author><name sortKey="Bonavia, M" uniqKey="Bonavia M">M Bonavia</name></author><author><name sortKey="Cilenti, V" uniqKey="Cilenti V">V Cilenti</name></author><author><name sortKey="Cinti, C" uniqKey="Cinti C">C Cinti</name></author><author><name sortKey="Lodi, M" uniqKey="Lodi M">M Lodi</name></author><author><name sortKey="Martucci, P" uniqKey="Martucci P">P Martucci</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Freitas, Da" uniqKey="Freitas D">DA Freitas</name></author><author><name sortKey="Holloway, Ea" uniqKey="Holloway E">EA Holloway</name></author><author><name sortKey="Bruno, Ss" uniqKey="Bruno S">SS Bruno</name></author><author><name sortKey="Chaves, Gs" uniqKey="Chaves G">GS Chaves</name></author><author><name sortKey="Fregonezi, Ga" uniqKey="Fregonezi G">GA Fregonezi</name></author><author><name sortKey="Mendonca, Kp" uniqKey="Mendonca K">KP Mendonca</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Chomutare, T" uniqKey="Chomutare T">T Chomutare</name></author><author><name sortKey="Fernandez Luque, L" uniqKey="Fernandez Luque L">L Fernandez-Luque</name></author><author><name sortKey=" Rsand, E" uniqKey=" Rsand E">E Årsand</name></author><author><name sortKey="Hartvigsen, G" uniqKey="Hartvigsen G">G Hartvigsen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Abroms, Lc" uniqKey="Abroms L">LC Abroms</name></author><author><name sortKey="Lee Westmaas, J" uniqKey="Lee Westmaas J">J Lee Westmaas</name></author><author><name sortKey="Bontemps Jones, J" uniqKey="Bontemps Jones J">J Bontemps-Jones</name></author><author><name sortKey="Ramani, R" uniqKey="Ramani R">R Ramani</name></author><author><name sortKey="Mellerson, J" uniqKey="Mellerson J">J Mellerson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Breton, E" uniqKey="Breton E">E Breton</name></author><author><name sortKey="Fuemmeler, B" uniqKey="Fuemmeler B">B Fuemmeler</name></author><author><name sortKey="Abroms, L" uniqKey="Abroms L">L Abroms</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gibson, Pg" uniqKey="Gibson P">PG Gibson</name></author><author><name sortKey="Powell, H" uniqKey="Powell H">H Powell</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bodenheimer, T" uniqKey="Bodenheimer T">T Bodenheimer</name></author><author><name sortKey="Lorig, K" uniqKey="Lorig K">K Lorig</name></author><author><name sortKey="Holman, H" uniqKey="Holman H">H Holman</name></author><author><name sortKey="Grumbach, K" uniqKey="Grumbach K">K Grumbach</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Newcomb, Pa" uniqKey="Newcomb P">PA Newcomb</name></author><author><name sortKey="Mcgrath, Kw" uniqKey="Mcgrath K">KW McGrath</name></author><author><name sortKey="Covington, Jk" uniqKey="Covington J">JK Covington</name></author><author><name sortKey="Lazarus, Sc" uniqKey="Lazarus S">SC Lazarus</name></author><author><name sortKey="Janson, Sl" uniqKey="Janson S">SL Janson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Paasche Orlow, Mk" uniqKey="Paasche Orlow M">MK Paasche-Orlow</name></author><author><name sortKey="Riekert, Ka" uniqKey="Riekert K">KA Riekert</name></author><author><name sortKey="Bilderback, A" uniqKey="Bilderback A">A Bilderback</name></author><author><name sortKey="Chanmugam, A" uniqKey="Chanmugam A">A Chanmugam</name></author><author><name sortKey="Hill, P" uniqKey="Hill P">P Hill</name></author><author><name sortKey="Rand, Cs" uniqKey="Rand C">CS Rand</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hall, Jl" uniqKey="Hall J">JL Hall</name></author><author><name sortKey="Mcgraw, D" uniqKey="Mcgraw D">D McGraw</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mosnaim, Gs" uniqKey="Mosnaim G">GS Mosnaim</name></author><author><name sortKey="Powell, Lh" uniqKey="Powell L">LH Powell</name></author><author><name sortKey="Rathkopf, M" uniqKey="Rathkopf M">M Rathkopf</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Burnay, E" uniqKey="Burnay E">E Burnay</name></author><author><name sortKey="Cruz Correia, R" uniqKey="Cruz Correia R">R Cruz-Correia</name></author><author><name sortKey="Jacinto, T" uniqKey="Jacinto T">T Jacinto</name></author><author><name sortKey="Sousa, As" uniqKey="Sousa A">AS Sousa</name></author><author><name sortKey="Fonseca, J" uniqKey="Fonseca J">J Fonseca</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Michie, S" uniqKey="Michie S">S Michie</name></author><author><name sortKey="Richardson, M" uniqKey="Richardson M">M Richardson</name></author><author><name sortKey="Johnston, M" uniqKey="Johnston M">M Johnston</name></author><author><name sortKey="Abraham, C" uniqKey="Abraham C">C Abraham</name></author><author><name sortKey="Francis, J" uniqKey="Francis J">J Francis</name></author><author><name sortKey="Hardeman, W" uniqKey="Hardeman W">W Hardeman</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Colledge, A" uniqKey="Colledge A">A Colledge</name></author><author><name sortKey="Car, J" uniqKey="Car J">J Car</name></author><author><name sortKey="Donnelly, A" uniqKey="Donnelly A">A Donnelly</name></author><author><name sortKey="Majeed, A" uniqKey="Majeed A">A Majeed</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Yang, Yt" uniqKey="Yang Y">YT Yang</name></author><author><name sortKey="Silverman, Rd" uniqKey="Silverman R">RD Silverman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Food, Us" uniqKey="Food U">US Food</name></author><author><name sortKey="Administration, D" uniqKey="Administration D">D Administration</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Lewis, Tl" uniqKey="Lewis T">TL Lewis</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Albrecht, Uv" uniqKey="Albrecht U">UV Albrecht</name></author><author><name sortKey="Von Jan, U" uniqKey="Von Jan U">U von Jan</name></author><author><name sortKey="Jungnickel, T" uniqKey="Jungnickel T">T Jungnickel</name></author><author><name sortKey="Pramann, O" uniqKey="Pramann O">O Pramann</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Marcano Belisario, Js" uniqKey="Marcano Belisario J">JS Marcano Belisario</name></author><author><name sortKey="Huckvale, K" uniqKey="Huckvale K">K Huckvale</name></author><author><name sortKey="Greenfield, G" uniqKey="Greenfield G">G Greenfield</name></author><author><name sortKey="Car, J" uniqKey="Car J">J Car</name></author><author><name sortKey="Gunn, Lh" uniqKey="Gunn L">LH Gunn</name></author></analytic></biblStruct></listBibl></div1></back></TEI><pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">BMC Med</journal-id><journal-id journal-id-type="iso-abbrev">BMC Med</journal-id><journal-title-group><journal-title>BMC Medicine</journal-title></journal-title-group><issn pub-type="epub">1741-7015</issn><publisher><publisher-name>BioMed Central</publisher-name><publisher-loc>London</publisher-loc></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">25857569</article-id><article-id pub-id-type="pmc">4391129</article-id><article-id pub-id-type="publisher-id">303</article-id><article-id pub-id-type="doi">10.1186/s12916-015-0303-x</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group></article-categories><title-group><article-title>The evolution of mobile apps for asthma: an updated systematic assessment of content and tools</article-title></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name><surname>Huckvale</surname><given-names>Kit</given-names></name><address><email>c.huckvale@imperial.ac.uk</email></address><xref ref-type="aff" rid="Aff1"></xref></contrib><contrib contrib-type="author"><name><surname>Morrison</surname><given-names>Cecily</given-names></name><address><email>cecilym@microsoft.com</email></address><xref ref-type="aff" rid="Aff1"></xref></contrib><contrib contrib-type="author"><name><surname>Ouyang</surname><given-names>Jing</given-names></name><address><email>jing.ouyang12@imperial.ac.uk</email></address><xref ref-type="aff" rid="Aff1"></xref></contrib><contrib contrib-type="author"><name><surname>Ghaghda</surname><given-names>Aseem</given-names></name><address><email>aseem.ghaghda12@imperial.ac.uk</email></address><xref ref-type="aff" rid="Aff1"></xref></contrib><contrib contrib-type="author" corresp="yes"><name><surname>Car</surname><given-names>Josip</given-names></name><address><email>josip.car@imperial.ac.uk</email></address><xref ref-type="aff" rid="Aff1"></xref><xref ref-type="aff" rid="Aff2"></xref></contrib><aff id="Aff1"><label></label>Global eHealth Unit, Imperial College London, Reynolds Building, St Dunstan’s Road, London, W6 8RP UK</aff><aff id="Aff2"><label></label>Health Services and Outcomes Research Programme, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore</aff></contrib-group><pub-date pub-type="epub"><day>23</day><month>3</month><year>2015</year></pub-date><pub-date pub-type="pmc-release"><day>23</day><month>3</month><year>2015</year></pub-date><pub-date pub-type="collection"><year>2015</year></pub-date><volume>13</volume><elocation-id>58</elocation-id><history><date date-type="received"><day>4</day><month>12</month><year>2014</year></date><date date-type="accepted"><day>26</day><month>2</month><year>2015</year></date></history><permissions><copyright-statement>© Huckvale et al.; licensee BioMed Central. 2015</copyright-statement><license license-type="open-access"><license-p>This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0">http://creativecommons.org/licenses/by/4.0</ext-link>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/">http://creativecommons.org/publicdomain/zero/1.0/</ext-link>) applies to the data made available in this article, unless otherwise stated.</license-p></license></permissions><abstract id="Abs1"><sec><title>Background</title><p>Interest in mobile apps that support long-term conditions such as asthma is matched by recognition of the importance of the quality and safety of apps intended for patient use. We assessed how changes over a 2-year period affected the clinical suitability of apps providing self-management information and tools for people with asthma by updating a review first performed in 2011.</p></sec><sec><title>Methods</title><p>Systematic content assessment of all apps for iOS and Android examining the comprehensiveness of asthma information, consistency with the evidence base for asthma self-management and adherence to best practice principles for trustworthy content, comparing the quality of apps available in 2011 to those released since.</p></sec><sec><title>Results</title><p>Between 2011 and 2013, numbers of asthma apps more than doubled from 93 to 191, despite withdrawal of 25% (n = 23/93) of existing apps. Newer apps were no more likely than those available in 2011 to include comprehensive information, such as the use of action plans, or offer guidance consistent with evidence; 13% (n = 19/147) of all apps, and 39% (n = 9/23) of those intended to manage acute asthma, recommended self-care procedures unsupported by evidence. Despite increases in the numbers of apps targeting specific skills, such as acute asthma management (n = 12 to 23) and inhaler technique (from n = 2 to 12), the proportion consistent with guidelines (17%, n = 4/23) and inhaler instructions (25%, n = 3/12), respectively, was low, and most apps provided only either basic information about asthma (50%, n = 75/147) or simple diary functions (24%, n = 36/147).</p></sec><sec><title>Conclusions</title><p>In addition to persisting questions about clinical quality and safety, dynamic aspects of app turnover and feature evolution affect the suitability of asthma apps for use in routine care. The findings underline the need for coordinated quality assurance processes that can adapt to changing clinical and information governance-related risks, ensure compliance with the evidence base and reflect local variations in clinical practice. It is unclear if substantial clinical benefits can be realized from a landscape dominated by low quality generic information apps and tools that do not adhere to accepted medical practice.</p></sec><sec><title>Electronic supplementary material</title><p>The online version of this article (doi:10.1186/s12916-015-0303-x) contains supplementary material, which is available to authorized users.</p></sec></abstract><kwd-group xml:lang="en"><title>Keywords</title><kwd>Android</kwd><kwd>App</kwd><kwd>Asthma</kwd><kwd>Cross-sectional study</kwd><kwd>iPhone</kwd><kwd>mHealth</kwd><kwd>Mobile health</kwd><kwd>Smartphone</kwd><kwd>Systematic assessment</kwd><kwd>Update</kwd></kwd-group><custom-meta-group><custom-meta><meta-name>issue-copyright-statement</meta-name><meta-value>© The Author(s) 2015</meta-value></custom-meta></custom-meta-group></article-meta></front><body><sec id="Sec1" sec-type="introduction"><title>Background</title><p>Medical apps for patients are software programs that run on personal mobile devices and offer functions such as disease tracking, access to clinical and peer support, health information, and reminders [<xref ref-type="bibr" rid="CR1">1</xref>]. Survey data indicate that approximately three fifths of US and UK adults own an app-capable smartphone [<xref ref-type="bibr" rid="CR2">2</xref>,<xref ref-type="bibr" rid="CR3">3</xref>] and around half of adults report knowing about and using apps [<xref ref-type="bibr" rid="CR2">2</xref>]. In 2012, a fifth reported having downloaded a health or fitness app, increasing amongst people with recent changes in health status [<xref ref-type="bibr" rid="CR4">4</xref>]. Industry estimates suggest that, by 2018, over one billion individuals worldwide will use a health or fitness app [<xref ref-type="bibr" rid="CR5">5</xref>] drawn from a pool of consumer health apps estimated to number in excess of 15,000 [<xref ref-type="bibr" rid="CR6">6</xref>]. In 2014, over a third of US clinicians reported having recommended an app to a patient in the past year [<xref ref-type="bibr" rid="CR7">7</xref>], and a survey of US adults suggested that nine of ten would use one issued ‘on prescription’ by a healthcare professional [<xref ref-type="bibr" rid="CR8">8</xref>]. Among policymakers and clinicians, interest in apps reflects the potential to improve patient support and, potentially, health outcomes by equipping individuals with tools for self-management and remote monitoring [<xref ref-type="bibr" rid="CR9">9</xref>-<xref ref-type="bibr" rid="CR11">11</xref>]. However, there is also increasing recognition of the importance of ensuring that medical apps are effective [<xref ref-type="bibr" rid="CR12">12</xref>,<xref ref-type="bibr" rid="CR13">13</xref>], safe [<xref ref-type="bibr" rid="CR14">14</xref>,<xref ref-type="bibr" rid="CR15">15</xref>], meet patient needs [<xref ref-type="bibr" rid="CR16">16</xref>,<xref ref-type="bibr" rid="CR17">17</xref>], and comply with existing evidence-based clinical practice [<xref ref-type="bibr" rid="CR18">18</xref>-<xref ref-type="bibr" rid="CR20">20</xref>].</p><p>In 2011, we mapped [<xref ref-type="bibr" rid="CR21">21</xref>] the types of apps available for patients with asthma, chosen as a prevalent long-term condition with potential social and economic [<xref ref-type="bibr" rid="CR22">22</xref>,<xref ref-type="bibr" rid="CR23">23</xref>] impacts and which requires a range of self-management skills in everyday life [<xref ref-type="bibr" rid="CR24">24</xref>]. We explored the degree to which apps conformed to evidence-based recommendations derived from international asthma guidelines. We characterized the range of possible functions supported by apps for asthma, including information provision, peak flow and symptom diaries, and medication trackers. While highlighting the potential to support tailored education and assist clinical decision-making using monitoring data, the review uncovered a range of potential issues. Few information apps addressed key educational topics recommended in international guidance. Many advocated strategies for acute asthma management and trigger avoidance that were unsupported by current evidence. Assessment and diagnostic tools were largely unvalidated, some had errors of design, and the small number of apps offering therapeutic interventions had no basis in evidence.</p><p>Rapid evolution is characteristic of mobile technologies. New hardware and software capabilities create opportunities for health; for example, remote monitoring enabled by always-on network connections and wearable sensors [<xref ref-type="bibr" rid="CR25">25</xref>]. Modern development methods mean that apps commonly undergo cycles of refinement in response to testing and user feedback [<xref ref-type="bibr" rid="CR26">26</xref>]. Changes in mobile devices and software have been accompanied by a broadening discussion about quality and safety that has involved clinicians [<xref ref-type="bibr" rid="CR27">27</xref>,<xref ref-type="bibr" rid="CR28">28</xref>], policy groups [<xref ref-type="bibr" rid="CR29">29</xref>], and, more recently, regulators [<xref ref-type="bibr" rid="CR30">30</xref>,<xref ref-type="bibr" rid="CR31">31</xref>]. Compared to 2011, there is greater understanding of potential risks and more resources targeted towards medical app developers, aiming to improve the quality of medical apps [<xref ref-type="bibr" rid="CR32">32</xref>-<xref ref-type="bibr" rid="CR35">35</xref>]. As a result, there is an opportunity to explore the impact that these changes may have had on apps intended for patient use.</p><p>We aimed to explore changes in the content, function, and clinical quality of apps since 2011. We used a systematic approach, based on a systematic literature review, to identify, classify, and review apps for asthma. By updating our earlier review, we sought to differentiate persistent quality issues from those that are new or have proven transient.</p></sec><sec id="Sec2" sec-type="materials|methods"><title>Methods</title><sec id="Sec3"><title>App selection</title><p>All apps from the two most widely-used [<xref ref-type="bibr" rid="CR36">36</xref>] mobile platforms (Android and iOS) incorporated in the original review [<xref ref-type="bibr" rid="CR21">21</xref>] were automatically eligible for inclusion. We chose not to include apps running on other platforms, such as Blackberry, whose market share is currently declining [<xref ref-type="bibr" rid="CR36">36</xref>]. To identify new apps, we performed a stepwise process of search, screening, and review. We searched the public app stores of the two most popular smartphone operating systems using the terms ‘asthma’, ‘inhaler’, ‘peak flow’, and related word variants, e.g., ‘asthmatic’. After removing apps already included from the previous study, results were screened to eliminate obviously irrelevant content. The remaining apps were downloaded and reviewed to reach a final decision for inclusion. Screening and review were performed by three reviewers (KH, JO, and AG), working independently. Final decisions were reached by consensus.</p><p>Free and paid-for smartphone and tablet apps were eligible for inclusion if they contained asthma-specific content or tools intended for use by patients or the public (see list below). Apps targeted exclusively towards clinicians were not included. Apps were excluded if they could not be downloaded from UK app stores or, after at least two attempts on different test devices, would not start. Apps from any country were eligible provided they supported English.</p><sec id="Sec4"><title>Inclusion criteria</title><p><list list-type="bullet"><list-item><p>Smartphone or tablet app</p></list-item><list-item><p>Free or paid</p></list-item><list-item><p>Running on Android or iOS platforms</p></list-item><list-item><p>Content or tools addressing one or more aspects of asthma diagnosis, management, or support as either the sole function or in a way that means asthma-related elements can be isolated from the rest of the content</p></list-item><list-item><p>Presenting content in any format</p></list-item><list-item><p>English language</p></list-item><list-item><p>Targeted at patients of any age</p></list-item></list></p></sec><sec id="Sec5"><title>Exclusion criteria</title><p><list list-type="bullet"><list-item><p>Not available through an approved device marketplace</p></list-item><list-item><p>Explicitly disclaimed use for a health-related purpose</p></list-item><list-item><p>Could not be downloaded because of country restrictions that prevented access in the UK</p></list-item><list-item><p>Could not be used because of technical problems, after two attempts</p></list-item></list></p></sec></sec><sec id="Sec6"><title>App assessment</title><p>Apps were assessed using a systematic approach to characterize functions and content. Apps containing information about asthma were evaluated using a set of criteria derived from US [<xref ref-type="bibr" rid="CR37">37</xref>], UK [<xref ref-type="bibr" rid="CR24">24</xref>], and international [<xref ref-type="bibr" rid="CR38">38</xref>] asthma guidelines. Information content was evaluated for coverage of eight domains identified as priorities for self-management education (basic facts about asthma, basic principles of treatment, trigger avoidance, how to use treatment, self-monitoring skills, the role of action plans, managing exacerbations, and personalized care), using a set of operational criteria derived from guidelines. These criteria were those used in our earlier review except for one criterion in the self-monitoring domain which was modified in response to peer feedback to acknowledge symptom-based methods for self-monitoring (criteria and change detailed in Additional file <xref rid="MOESM1" ref-type="media">1</xref>: Table AF1). Coverage of each educational domain was rated as either complete (all criteria satisfied), partial (some criteria satisfied), or absent. Content was also evaluated for consistency with evidence-based recommendations concerning eight aspects of asthma management derived from guidelines (Additional file <xref rid="MOESM1" ref-type="media">1</xref>: Table AF2). For those apps with content addressing a particular topic, the advice given was rated as being either consistent or inconsistent with underlying evidence. Consistency was judged both on the basis of factual accuracy and appropriate qualification of advice to reflect either uncertainty or limitations in the applicability of evidence, such as recommendations relevant only to individuals with more severe asthma, in which case we expected any information to be appropriately qualified. Information content was evaluated regardless of the delivery medium. However, apps focusing only on complementary and alternative medicine, using the definition of the NIH National Center for Complementary and Alternative Medicine [<xref ref-type="bibr" rid="CR39">39</xref>], were excluded from this analysis because there was no basis to expect that they should comply with guideline recommendations. For diaries and other self-management tools, the nature of inputs and outputs and methods for summarizing and sharing data were characterized. For all apps with calculator and questionnaire functions, we attempted to locate validation information in the form of an authoritative citation. Where validation information was found, the behaviour of the app in handling inputs and producing appropriate outputs was assessed. All apps were assessed for compliance with principles for ethical disclosure of authorship and data protection practices, using criteria previously adapted from those assessing online health information devised by the Health on the Net Foundation [<xref ref-type="bibr" rid="CR40">40</xref>] (criteria in Additional file <xref rid="MOESM1" ref-type="media">1</xref>: Table AF3). We also recorded any software issues that were encountered during testing, using a schema devised during the first review to classify problems such as crashes or errors in the user interface (detailed in Additional file <xref rid="MOESM1" ref-type="media">1</xref>: Table AF4).</p><p>Apps included in the original review had previously been assessed using these criteria. To ensure scoring consistency, we conducted a process of calibration in which a random selection of 10 apps was re-assessed and the outcomes compared to previous judgments. Apps that had been updated between 2011 and 2013 were also reassessed. Apps were reviewed by an author of the original review (KH) and one of two additional reviewers (JO and AG), working independently. After reconciliation, the results of the assessment process were recorded, along with basic characteristics of included apps, in a structured data extraction form (template in Additional file <xref rid="MOESM1" ref-type="media">1</xref>: Table AF5) for analysis.</p></sec><sec id="Sec7"><title><italic>Post hoc</italic> evaluation</title><p>In addition to the planned analyses described above, we performed a <italic>post hoc</italic> evaluation of inhaler technique guidance in response to the growing number of apps that include this function, using criteria derived from manufacturer guidance to assess key steps, such as inhaler preparation, necessary for effective drug delivery into the lungs (detailed in Additional file <xref rid="MOESM1" ref-type="media">1</xref>: Table AF6).</p></sec><sec id="Sec8"><title>Data analysis</title><p>Apps available on multiple platforms were grouped for subsequent analysis. When an app was available as multiple versions on the same platform, for example ‘demo’ and ‘full’ editions, the most fully featured version was used for analysis (irrespective of free/paid status). The decision to define the unit of analysis as the platform-independent app reflected learning from the original review concerning the possible risk of bias resulting from double counting some apps. In that review, we treated each app version separately because we anticipated different quality issues arising from the need to tailor each app according to the platform and version. However, the final results suggested that this was not, in general, the case. While in 2011 only a small number of apps were affected (n = 13), and sensitivity analysis undertaken during that analysis demonstrated minimal impact on results, by 2013 the number of duplicates was substantially larger (n = 77) with consequently greater scope for bias.</p><p>Descriptive statistics were used to summarize the types, functions, and quality characteristics of apps available in 2011, those released since 2011, and overall. When reporting comparisons between 2011 and 2013, data are always written in chronological order, e.g., for “(X vs. Y)”, X are data from 2011 and Y reflect data for apps released since 2011. We hypothesized that newer apps might have different quality characteristics arising from greater experience amongst developers and discourse in both medical and computer science literature emphasizing the importance of high-quality medical apps. To explore differences in the quality of information apps, we compared the proportion of educational domains completely, partially, or not satisfied, and the proportion of guidance consistent with the evidence base in those available in 2011 and those released since. We also compared the proportion of apps satisfying principles for ethical disclosures of information and the proportion of apps with specific software issues. Apart from these planned comparisons, we performed a small number of additional tests to compare differences in the proportion of paid-for apps, apps addressing complementary and alternative medicine, and the incorporation of features such as support details, in-app help, and social sharing features. These are marked as <italic>post hoc</italic> comparisons in the results.</p><p>For all comparisons, we used a two-tailed Fisher’s exact test [<xref ref-type="bibr" rid="CR41">41</xref>], with the Freeman-Halton extension [<xref ref-type="bibr" rid="CR42">42</xref>] to handle two by three cases for information comprehensiveness and (<italic>post hoc</italic>) content orientation. To adjust for multiple comparisons, we used a Holm-Bonferroni [<xref ref-type="bibr" rid="CR43">43</xref>] sequential adjustment to control the group-wise error rate at 5%, instead of specifying a fixed significance level for comparisons. All analyses were performed using R (Version 3.1.2).</p></sec></sec><sec id="Sec9" sec-type="results"><title>Results</title><p>Searches performed in June, July, and August 2013 identified 764 apps (Figure <xref rid="Fig1" ref-type="fig">1</xref>, n = 538 Android, 226 Apple). After excluding unsuitable apps (n = 643), 191 apps were selected for evaluation. These included 70 apps identified in the 2011 review that remained available. Details of apps excluded at the final review stage are provided in Additional file <xref rid="MOESM2" ref-type="media">2</xref>: Table AF7.<fig id="Fig1"><label>Figure 1</label><caption><p><bold>Flowchart of app selection process.</bold> Flowchart details the process of selecting individual apps for inclusion in the study. After evaluation of 191 apps, duplicates available on both iOS and Android (n = 24) and, when more fully featured versions were available, ‘lite’ or demonstration versions (n = 20) were excluded, leaving 147 unique apps for subsequent analysis.</p></caption><graphic xlink:href="12916_2015_303_Fig1_HTML" id="MO1"></graphic></fig></p><p>The number of apps for asthma more than doubled between 2011 and 2013 (from 93 to 191), dominated by growth in apps available for Android (from 41 to 103, 151% increase, vs. iOS 52 to 88, 69% increase, charted over time in Figure <xref rid="Fig2" ref-type="fig">2</xref>). Forty-one apps were available on both Android and iOS platforms and a further 36 had multiple versions on a single platform. After removing 24 platform duplicates and 20 demonstration versions where a more fully-featured version was available, analysis was performed on 147 unique apps. Over a quarter (28%, n = 22/78 unique apps) included in the original review had been withdrawn, and a similar proportion (24%, n = 19/78) updated, between 2011 and 2013. Withdrawals are included in reported 2011 statistics but not in overall 2013 totals. At the conclusion of analysis in June 2014, a further 20 apps had been withdrawn. These are retained for analysis, but annotated as withdrawn in data tables provided in Additional file <xref rid="MOESM2" ref-type="media">2</xref>.<fig id="Fig2"><label>Figure 2</label><caption><p><bold>Growth in numbers of asthma apps.</bold> Plot shows the total number of available apps for asthma against time, based on the original release date, for the period 2009 to mid-2013. Withdrawals are accounted for. Vertical lines indicate the dates of the 2011 and 2013 surveys. Data were not available for 5 apps; therefore, final n = 186.</p></caption><graphic xlink:href="12916_2015_303_Fig2_HTML" id="MO2"></graphic></fig></p><p>Table <xref rid="Tab1" ref-type="table">1</xref> summarizes the basic characteristics of included apps. Compared to apps available in 2011, apps released since were significantly more likely to be free (33%, n = 26/78 vs. 64%, n = 59/92, <italic>P</italic> <0.001, <italic>post hoc</italic>) but also more likely to carry advertising (18%, n = 14/78 vs. 34%, n = 31/92, <italic>P</italic> = 0.024, <italic>post hoc</italic>), although the difference was not significant after sequential adjustment. Between 2011 and 2013 the median cost of paid-for apps decreased from £1.27 GBP to £0.89 (£1.12 overall), reflecting a reduction in the proportion of apps charging more than £1.00 (37%, n = 29/78 vs. 22%, n = 20/92). The proportion of apps offering in-app upgrades to unlock addition functions remained unchanged at 9% (n = 13/147) overall, (8%, n = 7/78 vs. 7%, n = 6/92, <italic>P</italic> = 0.576, <italic>post hoc</italic>). While the US remained the main source of apps for asthma, accounting for almost half of apps with a known country of origin available in 2013 (48%, n = 52/108), the number of countries represented increased from 13 to 21. Although the overall proportion of apps indicating that the product was targeted at a particular group remained low (16%, n = 24/147), apps released since 2011 were significantly more likely to provide information targeting parents/caregivers (4%, n = 3/78 vs. 16%, n = 15/92, <italic>P</italic> = 0.011, <italic>post hoc</italic>). There was also a non-significant increase in the proportion of apps targeting children (3%, n = 2/78 vs. 8%, n = 7/92, <italic>P</italic> = 0.182, <italic>post hoc</italic>).<table-wrap id="Tab1"><label>Table 1</label><caption><p><bold>Basic characteristics of included apps</bold></p></caption><table frame="hsides" rules="groups"><thead><tr valign="top"><th></th><th colspan="2"><bold>2011 (n = 78)</bold></th><th colspan="2"><bold>New 2013 (n = 92)</bold><bold>¤</bold></th><th colspan="2"><bold>All 2013 (n = 147)</bold><bold>¤</bold></th></tr><tr valign="top"><th><bold>Characteristic</bold></th><th><bold>Yes</bold></th><th><bold>%</bold></th><th><bold>Yes</bold></th><th><bold>%</bold></th><th><bold>Yes</bold></th><th><bold>%</bold></th></tr></thead><tbody><tr valign="top"><td><bold>Platform</bold></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr valign="top"><td>Android only</td><td>32</td><td>41%</td><td>52</td><td>57%</td><td>73</td><td>50%</td></tr><tr valign="top"><td>iOS only</td><td>40</td><td>51%</td><td>28</td><td>30%</td><td>57</td><td>39%</td></tr><tr valign="top"><td>Both</td><td>6</td><td>8%</td><td>12</td><td>13%</td><td>17</td><td>12%</td></tr><tr valign="top"><td><bold>Cost</bold></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr valign="top"><td>Free</td><td>26</td><td>33%</td><td>59</td><td>64%</td><td>80</td><td>54%</td></tr><tr valign="top"><td>Paid-for</td><td>52</td><td>67%</td><td>33</td><td>36%</td><td>67</td><td>46%</td></tr><tr valign="top"><td>Median</td><td>£1.27</td><td>–</td><td>£0.89</td><td>–</td><td>£1.12</td><td>–</td></tr><tr valign="top"><td><bold>Country of origin</bold><sup><bold>†</bold></sup></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr valign="top"><td>US</td><td>24</td><td>31%</td><td>31</td><td>34%</td><td>52</td><td>35%</td></tr><tr valign="top"><td>UK</td><td>5</td><td>6%</td><td>6</td><td>7%</td><td>8</td><td>5%</td></tr><tr valign="top"><td>India</td><td>7</td><td>9%</td><td>7</td><td>8%</td><td>8</td><td>5%</td></tr><tr valign="top"><td>Australia</td><td>3</td><td>4%</td><td>4</td><td>4%</td><td>7</td><td>5%</td></tr><tr valign="top"><td>Other</td><td>10</td><td>13%</td><td>24</td><td>26%</td><td>33</td><td>22%</td></tr><tr valign="top"><td>Unknown</td><td>29</td><td>37%</td><td>20</td><td>22%</td><td>39</td><td>27%</td></tr><tr valign="top"><td><bold>Content orientation</bold></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr valign="top"><td>Conventional medicine only</td><td>56</td><td>72%</td><td>59</td><td>64%</td><td>101</td><td>69%</td></tr><tr valign="top"><td>Complementary/alternative medicine only</td><td>15</td><td>19%</td><td>17</td><td>18%</td><td>26</td><td>18%</td></tr><tr valign="top"><td>Mixed</td><td>7</td><td>9%</td><td>16</td><td>17%</td><td>20</td><td>14%</td></tr><tr valign="top"><td><bold>Audience targeting</bold><sup><bold>‡</bold></sup></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr valign="top"><td>Children or young adults</td><td>2</td><td>3%</td><td>7</td><td>8%</td><td>8</td><td>5%</td></tr><tr valign="top"><td>Parents or caregivers</td><td>3</td><td>4%</td><td>15</td><td>16%</td><td>19</td><td>13%</td></tr><tr valign="top"><td>No audience stated</td><td>73</td><td>94%</td><td>73</td><td>79%</td><td>123</td><td>84%</td></tr><tr valign="top"><td><bold>Other features</bold></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr valign="top"><td>Adverts</td><td>14</td><td>18%</td><td>31</td><td>34%</td><td>39</td><td>27%</td></tr><tr valign="top"><td>Social sharing</td><td>13</td><td>17%</td><td>35</td><td>38%</td><td>61</td><td>41%</td></tr><tr valign="top"><td>Cloud storage</td><td>3</td><td>4%</td><td>10</td><td>11%</td><td>16</td><td>11%</td></tr><tr valign="top"><td>Clinical disclaimer</td><td>32</td><td>41%</td><td>37</td><td>40%</td><td>55</td><td>37%</td></tr><tr valign="top"><td>In-app help</td><td>14</td><td>18%</td><td>28</td><td>30%</td><td>43</td><td>29%</td></tr><tr valign="top"><td>Online help</td><td>5</td><td>6%</td><td>6</td><td>7%</td><td>10</td><td>7%</td></tr></tbody></table><table-wrap-foot><p>¤ New 2013, Apps available in 2013 that were not available in 2011; All 2013, All apps available in 2013, excluding those available in 2011 that were subsequently discontinued.</p><p><sup>†</sup>Four countries with highest overall number of apps in 2013 shown. Other countries were: Ireland (n = 5), Germany (n = 4), Switzerland (n = 4), Japan (n = 3), Romania (n = 2), Singapore (n = 2), Austria (n = 1), France (n = 1), Italy (n = 1), Norway (n = 1), Poland (n = 1), Portugal (n = 1), Spain (n = 1), and Sweden (n = 1).</p><p><sup>‡</sup>Audience targeting was identified by specific claims made in the app title or description or content. We found no cases where apps explicitly indicated they were intended for adult use only. A small number of apps targeted both children and a parent or caregiver (2011, n = 0; New 2013, n = 3; All 2013, n = 3).</p></table-wrap-foot></table-wrap></p><p>Information provision remained the function most commonly offered by nearly three fifths of apps for asthma (56%, n = 83/147; Table <xref rid="Tab2" ref-type="table">2</xref>), followed by self-management tools in almost half (48%, n = 70/147). The number of apps combining self-management tools, such as diaries, with any form of information content grew from one (1%) in 2011 to nine (6%) in 2013. As in 2011, small numbers of apps available in 2013 provided functions for assessing asthma symptoms using questionnaires (n = 11) or sensors (n = 2) or assisting with aspects of therapy (n = 6). Although there was an increase in the proportion of apps released since 2011 incorporating mixed content addressing both conventional and alternative medical traditions, the change in relative frequencies was not significant (<italic>P</italic> = 0.268, <italic>post hoc</italic>; Table <xref rid="Tab2" ref-type="table">2</xref>) and the overall proportion of apps presenting content oriented towards conventional medical practice changed minimally (69% n = 101/147 vs. 73% n = 57/78 in 2011).<table-wrap id="Tab2"><label>Table 2</label><caption><p><bold>Breakdown of app functions</bold></p></caption><table frame="hsides" rules="groups"><thead><tr valign="top"><th></th><th colspan="6"><bold>By date</bold><sup><bold>†</bold></sup></th><th colspan="2"><bold>By platform</bold></th></tr><tr valign="top"><th></th><th colspan="2"><bold>2011 (n = 78)</bold></th><th colspan="2"><bold>New 2013 (n = 92)</bold><bold>¤</bold></th><th colspan="2"><bold>All 2013 (n = 147)</bold><bold>¤</bold></th><th colspan="2"><bold>All 2013 (n = 191)</bold></th></tr><tr valign="top"><th><bold>Function</bold></th><th><bold>n</bold></th><th><bold>%</bold></th><th><bold>n</bold></th><th><bold>%</bold></th><th><bold>n</bold></th><th><bold>%</bold></th><th><bold>Android</bold></th><th><bold>iOS</bold></th></tr></thead><tbody><tr valign="top"><td><bold>Information</bold></td><td>37</td><td>47%</td><td>60</td><td>65%</td><td>83</td><td>56%</td><td>66</td><td>44</td></tr><tr valign="top"><td>General information</td><td>36</td><td>46%</td><td>51</td><td>55%</td><td>74</td><td>50%</td><td>56</td><td>39</td></tr><tr valign="top"><td>Acute asthma management (First aid)</td><td>12</td><td>15%</td><td>18</td><td>20%</td><td>23</td><td>16%</td><td>19</td><td>14</td></tr><tr valign="top"><td>Inhaler technique guidance</td><td>2</td><td>3%</td><td>10</td><td>11%</td><td>12</td><td>8%</td><td>6</td><td>13</td></tr><tr valign="top"><td>Other therapeutic instructions</td><td>13</td><td>17%</td><td>10</td><td>11%</td><td>16</td><td>11%</td><td>15</td><td>9</td></tr><tr valign="top"><td><bold>Self-management tools</bold></td><td>36</td><td>46%</td><td>38</td><td>41%</td><td>70</td><td>48%</td><td>42</td><td>49</td></tr><tr valign="top"><td>Diaries and trackers</td><td>21</td><td>27%</td><td>18</td><td>20%</td><td>36</td><td>24%</td><td>23</td><td>26</td></tr><tr valign="top"><td>Pollen status</td><td>3</td><td>4%</td><td>8</td><td>9%</td><td>12</td><td>8%</td><td>6</td><td>10</td></tr><tr valign="top"><td>Pollution status</td><td>3</td><td>4%</td><td>6</td><td>7%</td><td>9</td><td>6%</td><td>2</td><td>9</td></tr><tr valign="top"><td>Allergen database</td><td>4</td><td>5%</td><td>3</td><td>3%</td><td>7</td><td>5%</td><td>5</td><td>4</td></tr><tr valign="top"><td>Forum</td><td>0</td><td>0%</td><td>1</td><td>1%</td><td>1</td><td>1%</td><td>1</td><td>0</td></tr><tr valign="top"><td>Online pharmacy</td><td>0</td><td>0%</td><td>1</td><td>1%</td><td>1</td><td>1%</td><td>1</td><td>0</td></tr><tr valign="top"><td>Combined with information</td><td>1</td><td>1%</td><td>8</td><td>9%</td><td>9</td><td>6%</td><td>6</td><td>7</td></tr><tr valign="top"><td><bold>Assessment tools</bold></td><td>9</td><td>12%</td><td>8</td><td>9%</td><td>16</td><td>11%</td><td>10</td><td>11</td></tr><tr valign="top"><td>Physiological measurement</td><td>2</td><td>3%</td><td>1</td><td>1%</td><td>3</td><td>2%</td><td>0</td><td>4</td></tr><tr valign="top"><td>Assessment questionnaires</td><td>4</td><td>5%</td><td>7</td><td>8%</td><td>11</td><td>7%</td><td>7</td><td>9</td></tr><tr valign="top"><td>Standalone calculators</td><td>2</td><td>3%</td><td>2</td><td>2%</td><td>4</td><td>3%</td><td>3</td><td>1</td></tr><tr valign="top"><td><bold>Therapeutic tools</bold></td><td>2</td><td>3%</td><td>5</td><td>5%</td><td>6</td><td>4%</td><td>1</td><td>5</td></tr></tbody></table><table-wrap-foot><p>The table compares the types of functions present in apps for asthma available in 2011 and 2013, and provides a breakdown by platform for 2013; 25 apps included in the 2011 assessment were withdrawn and this accounts for the lower overall total in 2013. Some apps contained multiple functions and are counted more than once.</p><p><sup>†</sup>Apps available on both Android and iOS are counted only once.</p><p>¤ New 2013, Apps available in 2013 that were not available in 2011; All 2013, All apps available in 2013, excluding those available in 2011 that were subsequently discontinued.</p></table-wrap-foot></table-wrap></p><sec id="Sec10"><title>Information apps</title><p>The number of apps offering information about asthma increased from 37 in 2011 to 83 by 2013, with 60 new apps and 14 withdrawals. Most information apps available in 2013 incorporated general information about asthma (89%, n = 74/83), although a growing proportion of apps (23%, n = 18/78 vs. 34%, n = 31/92, <italic>P</italic> = 0.174, <italic>post hoc</italic>) also incorporated specific instructions about the management of acute asthma, inhaler technique, and other aspects of self-management (discussed further in Therapeutic Instructions and Tools, below.) Apps used a range of media to communicate information including text (64%, n = 53/83), video and animation (10%, n = 8/83), or by combining different media types (27%, n = 22/83). A significantly greater proportion of apps released since 2011 used a medium other than text to communicate information (11%, n = 4/37 vs. 42%, n = 25/60, <italic>P</italic> = 0.001, <italic>post hoc</italic>). A new development was the use of gameplay (n = 3) to provide interactive education in three products targeted at children and teenagers. Full details of information-containing apps are provided in Additional file <xref rid="MOESM2" ref-type="media">2</xref>: Table AF8.</p><p>Although increasing in number, the proportion of products presenting information based exclusively around conventional medical practices was unchanged (51%, n = 19/37 vs. 50%, n = 30/60). Just over a fifth of all apps available in 2013 (23%, n = 19/83) combined alternative and conventional information and the remainder (28%, n = 23/83) presented information based on alternative medical principles alone. Consequently, there were 59 apps (vs. 23 in 2011) incorporating conventional medical information for which it was possible to assess coverage of self-management education topics and consistency with guideline recommendations.</p><p>Over two thirds (83%, n = 49/59) of all apps available in 2013 provided at least some details about basic aspects of asthma pathophysiology (Table <xref rid="Tab3" ref-type="table">3</xref>). However, only just over half provided information about basic principles of medical management (53%, n = 31/59), and fewer addressed key self-management skills, including allergen and trigger avoidance (44%, n = 26/59), self-monitoring skills (39%, n = 23/59), or how to use treatment appropriately (39%, n = 23/59). Less than a third of apps addressed how to recognize the signs of deterioration (31%, n = 18/59), the importance of personalized treatment and goal setting (31%, n = 18/59), and the role of an action plan (22%, n = 13/59). There was no significant difference in the proportion of apps released since 2011 addressing domains other than basic facts (27%, n = 6/22 vs. 20%, n = 9/45, <italic>P</italic> = 0.542), nor in the proportion of apps addressing each domain considered individually (<italic>P</italic> values shown in Table <xref rid="Tab3" ref-type="table">3</xref>). While the overall number of products addressing three or more educational domains, at least partially, grew from 14 to 31 between 2011 and 2013, new apps were not more likely to address multiple domains (64%, n = 14/22 vs. 51% n = 23/45, <italic>P</italic> = 0.435). In the same period, the number of products addressing all eight domains at least partially grew from two to five (with one withdrawal). As in 2011, however, no product provided complete coverage of all eight domains by satisfying all criteria.<table-wrap id="Tab3"><label>Table 3</label><caption><p><bold>Coverage of asthma self-management education topics by information apps</bold></p></caption><table frame="hsides" rules="groups"><thead><tr valign="top"><th></th><th colspan="4"><bold>2011 (n = 23)</bold></th><th colspan="4"><bold>New 2013 (n = 44)</bold><bold>¤</bold></th><th></th><th colspan="4"><bold>All 2013 (n = 59)</bold><bold>¤</bold></th></tr><tr valign="top"><th><bold>Educational topic</bold></th><th><bold>No</bold></th><th><bold>Partially</bold></th><th><bold>Wholly</bold></th><th><bold>%</bold><sup><bold>†</bold></sup></th><th><bold>No</bold></th><th><bold>Partially</bold></th><th><bold>Wholly</bold></th><th><bold>%</bold></th><th><bold><italic>P</italic></bold><bold>value</bold><sup><bold>‡</bold></sup></th><th><bold>No</bold></th><th><bold>Partially</bold></th><th><bold>Wholly</bold></th><th><bold>%</bold></th></tr></thead><tbody><tr valign="top"><td>Basic facts about the nature of the condition</td><td>2</td><td>15</td><td>6</td><td>91%</td><td>9</td><td>26</td><td>9</td><td>80%</td><td>0.510</td><td>10</td><td>37</td><td>12</td><td>83%</td></tr><tr valign="top"><td>Allergen and trigger avoidance</td><td>9</td><td>12</td><td>2</td><td>61%</td><td>25</td><td>19</td><td>0</td><td>43%</td><td>0.094</td><td>33</td><td>24</td><td>2</td><td>44%</td></tr><tr valign="top"><td>The nature of treatment: relievers and preventers</td><td>11</td><td>7</td><td>5</td><td>52%</td><td>22</td><td>18</td><td>4</td><td>50%</td><td>0.333</td><td>28</td><td>25</td><td>6</td><td>53%</td></tr><tr valign="top"><td>Recognizing and responding appropriately to acute exacerbations</td><td>14</td><td>7</td><td>2</td><td>39%</td><td>30</td><td>9</td><td>5</td><td>32%</td><td>0.728</td><td>41</td><td>12</td><td>6</td><td>31%</td></tr><tr valign="top"><td>How to use treatment</td><td>16</td><td>6</td><td>1</td><td>30%</td><td>27</td><td>17</td><td>0</td><td>39%</td><td>0.259</td><td>36</td><td>22</td><td>1</td><td>39%</td></tr><tr valign="top"><td>Self-monitoring and assessment skills</td><td>16</td><td>6</td><td>1</td><td>30%</td><td>27</td><td>16</td><td>1</td><td>39%</td><td>0.632</td><td>36</td><td>20</td><td>3</td><td>39%</td></tr><tr valign="top"><td>The role of a written, personalized action plan</td><td>18</td><td>2</td><td>3</td><td>22%</td><td>34</td><td>5</td><td>5</td><td>23%</td><td>1.000</td><td>46</td><td>6</td><td>7</td><td>22%</td></tr><tr valign="top"><td>Personalizing the definition of good asthma control</td><td>17</td><td>5</td><td>1</td><td>26%</td><td>29</td><td>15</td><td>0</td><td>34%</td><td>0.244</td><td>41</td><td>18</td><td>0</td><td>31%</td></tr></tbody></table><table-wrap-foot><p>The table compares the proportion of apps containing asthma self-management education information that address guideline-recommended topics either partially or wholly between 2011 and 2013. Apps focusing solely on complementary and alternative medicine were excluded.</p><p><sup>†</sup>The proportion of information apps that wholly or partially address a given educational topic.</p><p><sup>‡</sup>Two-tailed probability obtained from the Freeman-Halton extension to Fisher’s exact test of the comparison of topic coverage in apps available in 2011 and those released subsequently. After applying a Holm-Bonferroni correction to control the family-wise error rate at less than or equal to 5%, no comparisons achieved significance.</p><p>¤ New 2013, Apps available in 2013 that were not available in 2011; All 2013, All apps available in 2013, excluding those available in 2011 that were subsequently discontinued.</p></table-wrap-foot></table-wrap></p><p>Thirty-six apps (vs. 14 in 2011) were evaluated for consistency of recommendations against nine evidence-based topics (Table <xref rid="Tab4" ref-type="table">4</xref>) because they contained content addressing at least one topic. Smoking cessation and passive smoking avoidance were the topics most commonly addressed by apps (by n = 19 and 21, respectively) and, as in 2011, were correctly recommended as beneficial by all apps. All apps addressing immunotherapy (n = 5) and weight reduction (n = 7) correctly advocated their use in specific patient populations. However, apps were also likely to recommend actions for which there is unclear evidence of benefit, such as mold (n = 12/12) and cockroach (n = 7/7) avoidance measures, removal of pets (n = 7/8), and avoidance of air pollution (n = 15/17). Most apps covering seasonal influenza vaccination recommended it (n = 8/10) without acknowledging the uncertain impact on asthma [<xref ref-type="bibr" rid="CR44">44</xref>]. Compared to 2011, there were no significant differences in the proportion of apps released since that presented advice consistent with the evidence base, either when considering each statement individually (exact <italic>P</italic> values computed from proportions shown in Table <xref rid="Tab4" ref-type="table">4</xref> were all 1.0) or when comparing the proportion of apps containing no statements contradicting evidence (36%, n = 5/14 vs. 43%, n = 12/28, <italic>P</italic> = 0.747). A new finding in 2012 concerned a small number apps (n = 6) containing advice emphasizing the possible harmful effects of conventional medicine and, in two cases, promoting a commercial product, for example a homeopathic remedy. Previously, apps containing mixed content had tended to emphasize the right to choose between medical approaches rather than denying accepted medical practice.<table-wrap id="Tab4"><label>Table 4</label><caption><p><bold>Consistency of information apps with evidence-based recommendations</bold></p></caption><table frame="hsides" rules="groups"><thead><tr valign="top"><th></th><th colspan="3"><bold>2011</bold></th><th colspan="3"><bold>New 2013</bold><bold>¤</bold></th><th colspan="3"><bold>All 2013</bold><bold>¤</bold></th></tr><tr valign="top"><th><bold>Statement</bold></th><th><bold>n</bold><sup><bold>†</bold></sup></th><th><bold>Consistent</bold></th><th><bold>%</bold><sup><bold>‡</bold></sup></th><th><bold>n</bold></th><th><bold>Consistent</bold></th><th><bold>%</bold></th><th><bold>n</bold></th><th><bold>Consistent</bold></th><th><bold>%</bold></th></tr></thead><tbody><tr valign="top"><td>Removal of pets from the home (Qualified benefit)</td><td>3</td><td>1</td><td>33%</td><td>7</td><td>1</td><td>14%</td><td>8</td><td>1</td><td>13%</td></tr><tr valign="top"><td>Fungal allergen avoidance and control measures (Qualified benefit)</td><td>8</td><td>0</td><td>0%</td><td>9</td><td>0</td><td>0%</td><td>13</td><td>0</td><td>0%</td></tr><tr valign="top"><td>Cockroach avoidance and control measures (Qualified benefit)</td><td>6</td><td>0</td><td>0%</td><td>4</td><td>0</td><td>0%</td><td>7</td><td>0</td><td>0%</td></tr><tr valign="top"><td>Cessation of active smoking (Beneficial)</td><td>7</td><td>7</td><td>100%</td><td>14</td><td>14</td><td>100%</td><td>19</td><td>19</td><td>100%</td></tr><tr valign="top"><td>Avoidance of passive smoking (Beneficial)</td><td>8</td><td>8</td><td>100%</td><td>15</td><td>15</td><td>100%</td><td>21</td><td>21</td><td>100%</td></tr><tr valign="top"><td>Avoidance of exposure to air pollution (Qualified benefit)</td><td>8</td><td>1</td><td>13%</td><td>14</td><td>1</td><td>7%</td><td>17</td><td>2</td><td>12%</td></tr><tr valign="top"><td>Immunotherapy in atopic asthma (Beneficial)</td><td>1</td><td>1</td><td>100%</td><td>4</td><td>4</td><td>100%</td><td>5</td><td>5</td><td>100%</td></tr><tr valign="top"><td>Weight reduction in obese patients (Beneficial)</td><td>3</td><td>3</td><td>100%</td><td>4</td><td>4</td><td>100%</td><td>7</td><td>7</td><td>100%</td></tr><tr valign="top"><td>Seasonal influenza vaccination (Qualified benefit)**</td><td>4</td><td>1</td><td>25%</td><td>8</td><td>2</td><td>25%</td><td>10</td><td>2</td><td>20%</td></tr></tbody></table><table-wrap-foot><p>The table compares the proportion of apps containing particular management advice that is consistent with evidence-based recommendations between 2011 and 2013. The expected advice is shown in parentheses. We use the term ‘qualified benefit’ when additional factors, such as personal sensitivity to particular allergens or aspects of personal choice, are relevant concerns and unconditional recommendations are therefore inappropriate. Apps focusing solely on complementary and alternative medicine were excluded. Statistical comparison between apps in 2011 and new apps in 2013 was performed but is not shown because all comparisons, performed using Fisher’s exact test, yielded an exact probability of 1.0.</p><p><sup>†</sup>The number of apps that took a stance on a given topic, for example, by stating that a given action is definitely effective in controlling asthma symptoms.</p><p><sup>‡</sup>The proportion of apps whose stance is consistent with the evidence base.</p><p>¤ New 2013, Apps available in 2013 that were not available in 2011; All 2013, All apps available in 2013, excluding those available in 2011 that were subsequently discontinued.</p><p>**Seasonal influenza vaccination is routinely offered to asthmatic patients; however, it is unclear if vaccination reduces the severity or frequency of flu-related asthma exacerbations [<xref ref-type="bibr" rid="CR44">44</xref>].</p></table-wrap-foot></table-wrap></p></sec><sec id="Sec11"><title>Diaries and trackers</title><p>Thirty six apps available in 2013 (24%, vs. 27% in 2011) were diaries for recording asthma symptoms (n = 27), peak flow measurements (n = 24), and medication (n = 24, detailed in Additional file <xref rid="MOESM2" ref-type="media">2</xref>: Table AF9). Six apps allowed a user to document an action plan. Six incorporated inhaler trackers, including two where this was the sole function, designed to alert a user when a metered dose inhaler or other medication was running low. One app connected to an electronic inhaler to automatically log doses. Two thirds of diaries (67%, n = 24/36) offered a mechanism to summarize either recorded symptoms (n = 4), peak flow (n = 11), or both (n = 9) in chart form. Over half (55% n = 11/20) of apps charting peak flow used predicted (n = 6), personal best (n = 7), or manually entered (n = 3) thresholds to classify charted data to aid interpretation, for example, as ‘green’, ‘yellow’, and ‘red’ zones. Nine apps provided alerts based on changing input values. Seven provided specific advice, either by excerpting relevant parts of a user supplied-action plan (n = 3/6 apps with action plan support) or displaying standardized text (n = 4). Sixteen allowed reminders to be set to take peak flow measurements (n = 9), medication (n = 3), appointments (n = 2), and vaccination (n = 1). Compared to 2011, there were increases in the proportion of apps synchronizing and storing data online (10%, n = 2/21 vs. 44%, n = 8/18, <italic>P</italic> = 0.025, <italic>post hoc</italic>) but not those offering a mechanism for sharing data with clinicians (62%, n = 13/21 vs. 61%, n = 11/18, <italic>P</italic> = 1.000, <italic>post hoc</italic>), for example, email or file export.</p></sec><sec id="Sec12"><title>Other self-management tools</title><p>Nineteen apps (compared to 6 in 2011, Table <xref rid="Tab2" ref-type="table">2</xref>) provided status information about pollen (n = 10), air pollution (n = 7), or both (n = 2; Additional file <xref rid="MOESM2" ref-type="media">2</xref>: Table AF10). Most (n = 12) provided coverage of locations in the US. Only one product, which relied on used-supplied data, offered global coverage. Seven apps (vs. 4 in 2011) offered databases of chemical additives to allow patients to identify potential triggers in food and cosmetic ingredients. One app combined an electronic version of an action plan with links to information about asthma. Another product connected to a forum where users could view topics about asthma management and post their own questions. A third app offered UK patients the ability to purchase asthma medication online.</p></sec><sec id="Sec13"><title>Diagnostic and assessment tools</title><p>Fifteen apps (vs. 6 in 2011) contained diagnostic or assessment functions. Ten products offered questionnaires for asthma diagnosis (n = 4) or assessment (n = 6; Additional file <xref rid="MOESM2" ref-type="media">2</xref>: Table AF11). Two apps used the validated Asthma Control Test under license and one app reused a questionnaire developed by the University of Maryland. The remaining apps either did not provide a citation or validation information or the information provided was insufficient to verify the basis for assessment. Nine products provided predicted peak flow calculators as either the main function (n = 3) or integrated into a diary (n = 6). No calculator app provided a clear citation, but the underlying formula was identified for two apps. Issues first identified in 2011 resulting in incorrect calculation output for two apps where the formula was deduced were unresolved. Three products used the device microphone to attempt to quantify lung volume (n = 1) and analyse breath sounds (n = 2), but were either unvalidated or experimental products that had not yet received regulatory approval.</p></sec><sec id="Sec14"><title>Therapeutic instructions and tools</title><p>Forty-one apps (28% of n = 147) contained specific instructions for the use of inhalers (8%, n = 12/147), first aid for acute exacerbations (16%, n = 23/147), or other approaches to the management of asthma such as the use of herbal remedies (11%, n = 16/147, breakdown in Additional file <xref rid="MOESM2" ref-type="media">2</xref>: Table AF12). After pressurized metered dose inhalers (pMDI), either alone (100%, n = 12/12) or with spacer devices (92%, n = 11/12), the devices most commonly addressed by inhaler technique guidance were Accuhalers (58%, n = 7/12) and Turbohalers (50%, n = 6/12), although a range of additional devices were also covered (Additional file <xref rid="MOESM2" ref-type="media">2</xref>: Table AF12). Apps used text (33%, n = 4/12), video (25%, n = 3/12), animation (8%, n = 1/12), or a combination (33%, n = 4/12) to provide guidance. <italic>Post hoc</italic> evaluation (criteria in Additional file <xref rid="MOESM2" ref-type="media">2</xref>: Table AF6) examined the proportion of apps providing complete and correct information about inhaler preparation (67%, n = 8/12), positioning in the mouth (67%, n = 8/12), and the sequence of inhalation and actuation (50%, n = 6/12). While a quarter (25%, n = 3/12) addressed all three domains, the majority of apps omitted or misstated at least one step necessary for effective delivery of drugs to the lungs [<xref ref-type="bibr" rid="CR45">45</xref>,<xref ref-type="bibr" rid="CR46">46</xref>] for at least one of the inhalers discussed. The most common error (in 25%, n = 4/12) was the failure to explain how inspiration should start before, and continue after, actuation of a pMDI. A variable proportion of apps addressed other aspects of inhaler use such as holding the breath after inhalation (83%, n = 10/12), timing of a second dose (58%, n = 7/12), and mouth rinsing to reduce the risk of candidiasis with inhaled steroids (50%, n = 6/12). While five apps (42%) provided information about identifying empty Turbohalers or Accuhalers, no app addressed dose-tracking using pMDI. The two apps (17%) that covered inhaler care both provided incorrect information about spacer cleaning that risked static build-up interfering with subsequent doses.</p><p>Of the 23 apps incorporating advice about the management of acute asthma, approximately half (52%, n = 12/23) provided a clear description of the signs of acute asthma and gave practical advice such as sitting a patient up (48%, n = 11/23) and offering reassurance (52%, n = 12/23). Three fifths (61%, n = 14/23) provided appropriate instructions about when to seek further help. While almost two thirds (65%, n = 15/23) recommended the use of a rescue inhaler, less than a third (30%, n = 7/23) provided specific dose and timing instructions and only four apps (17%) provided instructions appropriate for children in addition to adults. Overall, four apps (17%) addressed all five components (Additional file <xref rid="MOESM2" ref-type="media">2</xref>: Table AF12). The proportion of apps released since 2011 that made treatment recommendations based on alternative medical practices did not change significantly (76%, n = 13/17 vs. 56%, n = 14/25, <italic>P</italic> = 0.207, <italic>post hoc</italic>), and almost three fifths of apps available in 2013 (58%, n = 19/33), and 39% (n = 9/23) of those intended to manage acute asthma, recommended procedures unsupported by evidence, for example, the use of a hot water bottle to warm the chest, cider vinegar administered orally, or fasting for the duration of an attack.</p><p>A small number of products (n = 6 vs. 2 in 2011) were tools intended to have a therapeutic effect. Three apps provided training in aspects of Buteyko breathing, which may have a future role in asthma management [<xref ref-type="bibr" rid="CR47">47</xref>]. The remaining three were based on alternative medical principles using hypnosis, mantra, and motivational messages.</p></sec><sec id="Sec15"><title>Disclosures and software issues</title><p>Results of assessment for compliance with ethical disclosures about authorship and data protection are summarized in Table <xref rid="Tab5" ref-type="table">5</xref> (based on criteria detailed in Additional file <xref rid="MOESM1" ref-type="media">1</xref>: Table AF4). Perhaps reflecting the increase in apps syncing data to a cloud service (4%, n = 3/78 vs. 11%, n = 10/92, <italic>P</italic> = 0.145, <italic>post hoc</italic>) or offer social sharing (17%, n = 13/78 vs. 38%, n = 35/92, <italic>P</italic> = 0.002, <italic>post hoc</italic>), apps released since 2011 were significantly more likely to have a privacy policy (9%, n = 7/78 vs. 36%, n = 33/92, <italic>P</italic> <0.001). New apps were also significantly more likely to provide contact details (41%, n = 32/78 vs. 64%, n = 59/92, <italic>P</italic> = 0.003). While no apps in 2011 had an editorial or advertising policy, five new apps did. In general, apps provided limited information about the information sources used for the advice they contained. The proportion of apps providing any kind of content attribution was unchanged (36%, n = 21/78 vs. 33%, n = 26/92, <italic>P</italic> = 0.856). Almost three fifths of information-containing apps (57%, n = 47/83) available in 2013 repackaged content available freely online from resources such as Wikipedia, a small increase from 2011 (54%, n = 19/35). The majority (77%, n = 36/47) of these apps did so without referencing the original content sources. Overall, 35% (n = 29/83) were ‘junk’ apps that reused, without attribution, information of generally low quality that was freely available online in a paid-for or advert-supported format.<table-wrap id="Tab5"><label>Table 5</label><caption><p><bold>Summary of ethical disclosures and software issues</bold></p></caption><table frame="hsides" rules="groups"><thead><tr valign="top"><th></th><th colspan="2"><bold>2011 (n = 78)</bold></th><th colspan="2"><bold>New 2013 (n = 92)</bold><bold>¤</bold></th><th></th><th colspan="2"><bold>All 2013 (n = 147)</bold><bold>¤</bold></th></tr><tr valign="top"><th><bold>Quality domain</bold></th><th><bold>Yes</bold></th><th><bold>%</bold><sup><bold>†</bold></sup></th><th><bold>Yes</bold></th><th><bold>%</bold></th><th><bold><italic>P</italic></bold><bold>value</bold><sup><bold>‡</bold></sup></th><th><bold>Yes</bold></th><th><bold>%</bold></th></tr></thead><tbody><tr valign="top"><td><bold>Ethical disclosures</bold></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr valign="top"><td>Attribution of authorship<sup>§</sup></td><td>21</td><td>36%</td><td>26</td><td>33%</td><td>0.856</td><td>40</td><td>33%</td></tr><tr valign="top"><td>Purpose clearly stated</td><td>69</td><td>88%</td><td>88</td><td>96%</td><td>0.090</td><td>141</td><td>96%</td></tr><tr valign="top"><td>Privacy policy available</td><td>7</td><td>9%</td><td>33</td><td>36%</td><td><0.001*</td><td>44</td><td>30%</td></tr><tr valign="top"><td>Information versioning</td><td>1</td><td>1%</td><td>3</td><td>3%</td><td>0.626</td><td>4</td><td>3%</td></tr><tr valign="top"><td>Contact details provided</td><td>32</td><td>41%</td><td>59</td><td>64%</td><td>0.003*</td><td>90</td><td>61%</td></tr><tr valign="top"><td>Funding model clear</td><td>21</td><td>27%</td><td>30</td><td>33%</td><td>0.502</td><td>49</td><td>33%</td></tr><tr valign="top"><td>Editorial/advertising policy</td><td>0</td><td>0%</td><td>5</td><td>5%</td><td>0.063</td><td>5</td><td>3%</td></tr><tr valign="top"><td><bold>Software issues</bold></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr valign="top"><td>Data entry validation issues**</td><td>9</td><td>33%</td><td>8</td><td>32%</td><td>1.000</td><td>16</td><td>33%</td></tr><tr valign="top"><td>Functionality issues</td><td>13</td><td>17%</td><td>9</td><td>10%</td><td>0.252</td><td>15</td><td>10%</td></tr><tr valign="top"><td>User interface issues</td><td>25</td><td>32%</td><td>34</td><td>37%</td><td>0.522</td><td>45</td><td>31%</td></tr><tr valign="top"><td>Crashes</td><td>8</td><td>10%</td><td>8</td><td>9%</td><td>0.796</td><td>13</td><td>9%</td></tr><tr valign="top"><td>Network issues</td><td>3</td><td>4%</td><td>20</td><td>22%</td><td><0.001*</td><td>25</td><td>17%</td></tr><tr valign="top"><td>Other issues</td><td>10</td><td>13%</td><td>18</td><td>20%</td><td>0.301</td><td>28</td><td>19%</td></tr></tbody></table><table-wrap-foot><p>The table compares the proportion of apps satisfying best practices for content attribution and ethical disclosures (detailed in Additional file <xref rid="MOESM1" ref-type="media">1</xref>: Table AF3), and those with software issues identified during testing (detailed with examples in Additional file <xref rid="MOESM1" ref-type="media">1</xref>: Table AF4), between 2011 and 2013.</p><p><sup>†</sup>The proportion of information apps that satisfy a particular domain. Unless otherwise stated, the denominator is the total number of apps shown in the relevant heading.</p><p><sup>‡</sup>Two-tailed probability obtained from Fisher’s exact test of the comparison of topic coverage in apps available in 2011 and those available since 2013. *After applying a Holm-Bonferroni correction to control the family-wise error rate within each domain at less than or equal to 5%, three comparisons were significant.</p><p><sup>§</sup>Denominator for proportions reflects only apps with attributable content, e.g., written information, measurement scales, pollen/pollution data. Attribution of the software itself lies with the developers whose details are always released. Denominators: 2011 n = 59, New 2013 n = 80, 2013 n = 120.</p><p>¤ New 2013, Apps available in 2013 that were not available in 2011; All 2013, All apps available in 2013, excluding those available in 2011 that were subsequently discontinued.</p><p>**Data entry validation concerns steps taken to prevent out-of-range or inappropriate data being stored in an app, for example, textual values allowed in a numeric field. As a result, the denominator reflects only apps permitting data entry, e.g., calculators, diaries. Denominators: 2011 n = 27, New 2013 n = 25, 2013 n = 49.</p></table-wrap-foot></table-wrap></p><p>We also assessed software issues encountered during the test process (using criteria detailed in Additional file <xref rid="MOESM1" ref-type="media">1</xref>: Table AF5). Compared to 2011, there was no change in the proportion of new apps lacking appropriate data entry validation to prevent, for example, textual data being entered in numeric data fields (33%, n = 9/27 vs. 32%, n = 8/25, <italic>P</italic> = 1.000). The proportion of apps with problems with the user interface, such as mislabelled data fields (32%, n = 25/78 vs. 37%, n = 34/92, <italic>P</italic> = 0.522), or core functionality, such as the correct operation of a calculator (17%, n = 13/78 vs. 10%, n = 9/92, <italic>P</italic> = 0.252), was also unchanged. However, there was a significant increase in apps released since 2011 experiencing network problems when trying to access online content or services (4%, n = 3/78 vs. 22%, n = 20/92, <italic>P</italic> <0.001). Crashes affected about one in ten apps during testing, unchanged from 2011 (9%, n = 13/147 overall).</p></sec></sec><sec id="Sec16" sec-type="discussion"><title>Discussion</title><p>Our updated findings present a mixed picture for clinicians interested in integrating apps into routine care. While choice has increased, newer apps for asthma were no more likely than those available in 2011 to satisfy evidence-based recommendations for information content or the design of self-management tools. Our data extend findings of low overall compliance with evidence in recent assessments of medical apps for disease-management [<xref ref-type="bibr" rid="CR20">20</xref>,<xref ref-type="bibr" rid="CR48">48</xref>] and health-promotion [<xref ref-type="bibr" rid="CR49">49</xref>,<xref ref-type="bibr" rid="CR50">50</xref>] by suggesting that issues of quality are sustained and are not isolated to first-generation apps. However, as in 2011, our results question the scope for benefit offered by current apps for asthma. Firstly, rather than focusing on known gaps in self-management where there is evidence that intervention can improve outcomes, such as the use of action plans [<xref ref-type="bibr" rid="CR22">22</xref>,<xref ref-type="bibr" rid="CR51">51</xref>], most apps offer either very basic background information about asthma or simple peak flow diaries. Only a fifth of information apps available in 2013 addressed action plans and the proportion of diaries offering a mechanism for recording a plan was smaller. Secondly, although it is recognized that information provision alone has a limited impact on health behaviour [<xref ref-type="bibr" rid="CR52">52</xref>], the proportion of apps combining information and tools remains small. While apps using multimedia methods, such as video and gameplay, presented welcome new opportunities for tailored support that focuses on specific needs, such as improving inhaler technique [<xref ref-type="bibr" rid="CR53">53</xref>], or on specific groups, such as those with limited literacy [<xref ref-type="bibr" rid="CR54">54</xref>], our assessment highlights the risk of clinically-relevant impacts resulting from inadequate content. For example, three quarters of inhaler training apps left out at least one step considered necessary for effective delivery of drug into the lungs. Thirdly, while apps incorporate a range of features, such as reminders, that could plausibly play a role in interventions designed to improve asthma self-management, apps themselves do not currently provide effective scaffolding to support individuals in changing, and sustaining, behaviour. For example, although many apps offered the ability to send data by email, and the proportion of apps using a mechanism to share data online almost doubled between 2011 and 2013 to 52%, no app offered a built-in mechanism for communication between a professional and patient, potentially limiting the scope for feedback that could assist self-management. Nor was it clear that the online services linked to currently available apps could support the kind of summary and flagging activities necessary to manage cohorts rather than single patients. Evidence is needed that app-supported remote monitoring can generate reliable data, prompt consistent and sustained clinical improvements, and meet the needs of patients across the spectrum of asthma severity [<xref ref-type="bibr" rid="CR55">55</xref>]. Although more apps allowed information to be shared using a social network like Facebook or Twitter, this was never in the context of a structured activity relating to asthma self-management and no apps took advantage of the possibilities for peer support. Similar to the findings of others [<xref ref-type="bibr" rid="CR19">19</xref>,<xref ref-type="bibr" rid="CR56">56</xref>], only one asthma app appeared to be linked to an active research project [<xref ref-type="bibr" rid="CR57">57</xref>], highlighting a broader disconnect between guidance on the design of interventions that incorporate evidence-based components and evaluation [<xref ref-type="bibr" rid="CR58">58</xref>] and what occurs in practice.</p><p>Dynamic aspects of the asthma app marketplace, including rapid growth and turnover, have potential consequences for both clinical services and individuals. Over a quarter of apps included in the original review, including those from reputable content providers, had been withdrawn. While patients may choose apps to suit their changing needs, the costs associated with app selection, staff training, setting up support mechanisms, and appropriate governance create incentives for planned care to be based around small numbers of trusted apps. Unexpected withdrawal of an app may be an inconvenience for individual users, but can threaten the function of an established clinical service. App updates are also potentially disruptive, requiring testing and training. As a result, formal arrangements with app developers, such as service-level contracts, should be considered where apps are being used as part of planned care. Systematic identification of factors influencing app lifespan would be helpful and future work should address this.</p><p>A new finding concerned apps that repackaged existing information either to create content focused on promoting specific commercial products, or to serve as a more general vehicle for hosting adverts operating on a pay-per-click basis. A small number specifically emphasized negative effects associated with conventional medical practice, with the intention of promoting commercial alternatives. Some apps were developed using online tools that specifically target developers with no or limited coding experience. Marketing materials for these tools emphasized their ability to produce apps quickly and in number. If the goal of these apps is simply to generate advertising revenue or an initial purchase, content need only to appear superficially plausible. This kind of low-quality information, coupled with high volume distribution and commercial motive, shares similarities with spam or junk email and websites [<xref ref-type="bibr" rid="CR59">59</xref>]. Indeed, some apps for asthma reused material originally produced by online content farms [<xref ref-type="bibr" rid="CR60">60</xref>]. If sustained, the junk medical app would be an unwelcome development, making it harder for users to locate higher-quality and unbiased content. Unlike the web, where search engines tend to prioritize higher-quality content in results [<xref ref-type="bibr" rid="CR61">61</xref>], conventional app stores offer limited mechanisms for filtering out lower quality and junk apps.</p><p>Apps offering unvalidated diagnostic, assessment, and therapeutic functions with no basis in evidence are a continuing issue that raises questions about patient safety and clinical liability [<xref ref-type="bibr" rid="CR62">62</xref>]. While some apps are likely to fall under the scope of medical app regulation recently proposed in both the US and Europe [<xref ref-type="bibr" rid="CR30">30</xref>,<xref ref-type="bibr" rid="CR31">31</xref>], aspects of how this will work in practice are yet to be agreed, not least because regulators must balance competing demands of risk, costs, and the possible impact on innovation [<xref ref-type="bibr" rid="CR14">14</xref>]. As a result, rapid action appears unlikely, even where standards already exist. For example, while physical sensors, such as peak flow meters, are classified as moderate risk (class 2) medical devices, neither of the two asthma apps that use a device microphone to analyse breath sounds appear to have undergone regulatory approval, and both remain available in November 2014, over 1 year since guidance first came out. Regulation is also constrained by the scope of current legislation which applies only to apps intended to diagnose, treat, or prevent disease. While not ruling out future changes, regulators have stated that information apps do not satisfy this definition, even if they contain procedural guidance such as first aid [<xref ref-type="bibr" rid="CR63">63</xref>], and that they intend to apply discretion when enforcing rules for apps that probably qualify as medical devices but pose a low overall risk such as diaries, pollen alerts, and inhaler trackers [<xref ref-type="bibr" rid="CR14">14</xref>]. While ensuring that potentially useful apps are not burdened by costly and time-consuming approvals, some apps will fall outside established reporting mechanisms that would allow a more complete picture of risk to emerge over time. Further work is necessary to understand the consequences of known defects in tools such as predicted peak flow calculators and identify unanticipated risks, for example, those arising from novel services like online pharmacies that do not involve a usual clinician.</p><p>Our findings have relevance for emerging medical app accreditation programs [<xref ref-type="bibr" rid="CR32">32</xref>,<xref ref-type="bibr" rid="CR64">64</xref>,<xref ref-type="bibr" rid="CR65">65</xref>], which aim to reduce the burden of assessment placed on professionals and patients, provide recognizable badges of app quality, and collate certified apps to make them easily accessible. Rapid app turnover and feature evolution suggest that accreditation processes will need to be revised regularly and programs will need to allocate appropriate resources to reassess their growing cohort of existing certified apps as they are updated. Programs must also consider the possibility of best practices that vary by location and target group. For example, some US inhaler technique guidance apps advised actuating a metered dose inhaler in front of an open mouth, a method not taught in UK self-management education. The growth in connected apps, and those based around advertiser models, highlights the importance of assessment processes which examine privacy and security-related risks as personal and medical data start to be shared online. While we did not explore the governance arrangements of cloud-based apps, privacy and security are topical concerns for patients [<xref ref-type="bibr" rid="CR55">55</xref>,<xref ref-type="bibr" rid="CR66">66</xref>]. Additionally, recent findings highlighting gaps in privacy disclosures [<xref ref-type="bibr" rid="CR67">67</xref>,<xref ref-type="bibr" rid="CR68">68</xref>] and security arrangements [<xref ref-type="bibr" rid="CR69">69</xref>,<xref ref-type="bibr" rid="CR70">70</xref>] in popular health apps suggest that further scrutiny is required. High rates of app turnover emphasize the importance of due-diligence that focuses on the commitment of developers to maintaining their products. The range of functions seen within a single long-term condition in this study highlights the potential complexity of defining comprehensive assessment standards. Similar to the content-independent criteria applied in this study, simplified assessments which focus on high-risk functions and proxy markers for quality, such as the involvement of clinicians in design, have been proposed [<xref ref-type="bibr" rid="CR71">71</xref>,<xref ref-type="bibr" rid="CR72">72</xref>], but their predictive validity is unknown. While most accreditation programs appear to be developing their own criteria, a collaborative, open approach to standard development could share the workload, for example, by involving professional bodies with specific content expertise, enable transparent input by patients, professionals, and developers, and permit evaluation. Further work should explore the extent to which developers can be engaged proactively to increase awareness of accreditation requirements and the potential value of patient and professional input into health app design, which, in turn, may increase the likelihood that apps meet accreditation requirements without potentially costly cycles of rejection and resubmission. Finally, because accreditation programs are voluntary and have yet to prove their ability to control quality issues at scale, most health apps available in public app stores will not be badged for quality. Patient education could address this by, for example, explaining the phenomenon of junk medical apps and characterizing the risks as similar to those presented by the range of information available on the general internet.</p><p>The study used a systematic method to exhaustively sample apps from the two most popular app stores and included steps to minimize bias during the assessment process. By repeating an assessment first performed in 2011, we were able to explore aspects of the dynamics of app turnover and feature development. However, the study had a number of limitations. Apps in languages other than English and those available on platforms other than Android and iOS were not included. It is possible that there are systematic differences in app quality by language or platform that this study could not detect. Because the study involved only two time points, there should be substantial caution in inferring that any changes observed are indicative of trends. Our data reflect issues present in apps available at particular points in time, and while representative categories are likely to persist, the specifics will change, necessitating updated assessment. Finally, because of limitations in the data provided by app stores, we were unable to precisely quantify the scale of app use by patients nor the ways in which apps are used. The potential for a mismatch between available features and those desired by patients was highlighted by a recent review of apps for patients with Parkinson’s disease [<xref ref-type="bibr" rid="CR73">73</xref>]. Future work could explore this issue in relation to asthma, examine whether user reviews and ratings have any predictive validity for app quality, and continue to develop the currently limited evidence-base specifically addressing the design of apps for asthma self-management [<xref ref-type="bibr" rid="CR74">74</xref>].</p></sec><sec id="Sec17" sec-type="conclusion"><title>Conclusions</title><p>In addition to established findings about variable clinical quality and possible safety risks, dynamic aspects of the asthma app marketplace, such as rapid growth and turnover, affect the suitability of apps for use in clinical settings. Efforts to assure the quality of medical apps need to be responsive to the changing features and risks posed by apps, consider governance as well as clinical factors, and recognize the differing needs of patients using apps on their own initiative and those supported by clinical care. Accreditation programs may need to be supplemented by proactive intervention by regulators to address potentially unsafe apps and advice to help patients navigate the increasing numbers of poor quality or ‘junk’ apps for asthma in general app stores.</p></sec></body><back><app-group><app id="App1"><sec id="Sec18"><title>Additional files</title><p><media position="anchor" xlink:href="12916_2015_303_MOESM1_ESM.pdf" id="MOESM1"><label>Additional file 1:</label><caption><p><bold>Tables AF1–6.</bold> Contains: <bold>Table AF1.</bold> Operational criteria for assessing the comprehensiveness of asthma self-management educational materials. Criteria covering eight key educational domains, derived from UK British Thoracic Society/Scottish Intercollegiate Guideline Network (BTS/SIGN), US Expert Panel Report 3 (EPR-3), and Global Initiative for Asthma (GINA) guidelines. <bold>Table AF2.</bold> Management strategies used to assess consistency of asthma information with evidence-base. Strategies and evidence-base derived from UK BTS/SIGN, US EPR-3, and GINA guidelines. <bold>Table AF3.</bold> Ethical disclosure principles for smartphone apps. Adapted from the Health on The Net Foundation principles for health information on the internet. <bold>Table AF4.</bold> Categories of software issue considered during assessment. Categories used to group any software errors, user interface problems, or other issue encountered during testing. <bold>Table AF5.</bold> Data extraction template. Template into which details of apps were recorded for subsequent analysis. <bold>Table AF6.</bold> Operational criteria for assessing inhaler technique education. Criteria covering eight domains, derived from product manufacturer guidance and UK BTS/SIGN, US EPR-3, and GINA guidelines.</p></caption></media><media position="anchor" xlink:href="12916_2015_303_MOESM2_ESM.xlsx" id="MOESM2"><label>Additional file 2:</label><caption><p><bold>Tables AF7–12.</bold> Contains: <bold>Table AF7.</bold> Characteristics of excluded apps. Table detailing apps excluded from analysis and the reasons for exclusion. <bold>Table AF8.</bold> Characteristics of information apps. Table of apps containing written or multimedia information about asthma. Detailed results of evaluation for consistency and comprehensiveness with evidence-based guidelines and adherence to best-practices for content development disclosures. <bold>Table AF9.</bold> Characteristics of diary apps. Table of apps containing asthma diary and related tracking functions. Details of diary function types, action plan support, adherence to best-practices for content development disclosures, and any issues identified during testing. <bold>Table AF10.</bold> Characteristics of apps with other self-management functions. Table of apps containing self-management functions other than diaries and trackers such as air pollution information. Details of function types, adherence to best-practices for content development disclosures, and any issues identified during testing. <bold>Table AF11.</bold> Characteristics of apps with assessment functions. Table of apps containing calculator and questionnaire functions related to asthma diagnosis or management. Details of function types, validation information (if identified), and adherence to best-practices for content development disclosures and any issues identified during testing. <bold>Table AF12.</bold> Characteristics of apps with therapeutic instructions and functions. Table of apps with an intended therapeutic purpose. Details of function types, validation information (if identified), adherence to best-practices for content development disclosures, and any issues identified during testing.</p></caption></media></p></sec></app></app-group><fn-group><fn><p><bold>Competing interests</bold></p><p>All authors have completed the ICMJE uniform disclosure form at <ext-link ext-link-type="uri" xlink:href="http://www.icmje.org/coi_disclosure.pdf">www.icmje.org/coi_disclosure.pdf</ext-link> and declare: KH’s doctoral studies of which this work forms a part are funded by the NIHR CLAHRC for North West London; no financial relationships with any organizations that might have an interest in the submitted work in the previous three years; and no other relationships or activities that could appear to have influenced the submitted work.</p></fn><fn><p><bold>Authors’ contributions</bold></p><p>KH designed the study and data collection tools, performed and supervised searches, screening, and data extraction, cleaned and analyzed the data, and wrote the first draft of the paper; he is guarantor. JO and AG performed screening and data extraction and revised the draft paper. CM reviewed the analysis and revised the draft paper. JC contributed to the original study design and revised the draft paper. All authors, external and internal, had full access to all of the data (including statistical reports and tables) in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. All authors read and approved the final manuscript.</p></fn></fn-group><ack><title>Acknowledgements</title><p>This work received no specific funding. However, KH’s doctoral studies are funded by the National Institute for Health Research (NIHR) under the Collaborations for Leadership in Applied Health Research and Care (CLAHRC) programme for North West London. They played no role in study design, in the collection, analysis, and interpretation of data, in the writing of the report, or in the decision to submit the article for publication. The views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health.</p></ack><ref-list id="Bib1"><title>References</title><ref id="CR1"><label>1.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Klasnja</surname><given-names>P</given-names></name><name><surname>Pratt</surname><given-names>W</given-names></name></person-group><article-title>Healthcare in the pocket: mapping the space of mobile-phone health interventions</article-title><source>J Biomed Inform</source><year>2011</year><volume>45</volume><fpage>184</fpage><lpage>98</lpage><pub-id pub-id-type="doi">10.1016/j.jbi.2011.08.017</pub-id><pub-id pub-id-type="pmid">21925288</pub-id></element-citation></ref><ref id="CR2"><label>2.</label><mixed-citation publication-type="other">Ofcom. The communications market 2014 (August). 2014. <ext-link ext-link-type="uri" xlink:href="http://stakeholders.ofcom.org.uk/market-data-research/market-data/communications-market-reports/cmr14/">http://stakeholders.ofcom.org.uk/market-data-research/market-data/communications-market-reports/cmr14/</ext-link>.</mixed-citation></ref><ref id="CR3"><label>3.</label><mixed-citation publication-type="other">Pew Research Internet Project. Mobile technology fact sheet. <ext-link ext-link-type="uri" xlink:href="http://www.pewinternet.org/fact-sheets/mobile-technology-fact-sheet/">http://www.pewinternet.org/fact-sheets/mobile-technology-fact-sheet/</ext-link>.</mixed-citation></ref><ref id="CR4"><label>4.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Fox</surname><given-names>S</given-names></name><name><surname>Duggan</surname><given-names>M</given-names></name></person-group><source>Mobile health 2012</source><year>2012</year><publisher-loc>Washington DC</publisher-loc><publisher-name>Pew Research Center</publisher-name></element-citation></ref><ref id="CR5"><label>5.</label><mixed-citation publication-type="other">research2guidance. Mobile health market report 2013–2017. <ext-link ext-link-type="uri" xlink:href="http://www.research2guidance.com/shop/index.php/mhealth-report-2">http://www.research2guidance.com/shop/index.php/mhealth-report-2</ext-link>.</mixed-citation></ref><ref id="CR6"><label>6.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Aitken</surname><given-names>M</given-names></name><name><surname>Gauntlett</surname><given-names>C</given-names></name></person-group><source>Patient apps for improved healthcare – from novelty to mainstream</source><year>2013</year><publisher-loc>Parsippany, NJ</publisher-loc><publisher-name>IMS Institute for Healthcare Informatics</publisher-name></element-citation></ref><ref id="CR7"><label>7.</label><mixed-citation publication-type="other">Manhattan Research. 2014 Environment. <ext-link ext-link-type="uri" xlink:href="http://manhattanresearch.com/Products-and-Services/Physician/Taking-the-Pulse-U-S">http://manhattanresearch.com/Products-and-Services/Physician/Taking-the-Pulse-U-S</ext-link>.</mixed-citation></ref><ref id="CR8"><label>8.</label><mixed-citation publication-type="other">Digitas Health. mBook 2013 edition – marketing mobile health. 2013. <ext-link ext-link-type="uri" xlink:href="http://m.2013.digitashealth.com/Mbook2013_web.pdf">http://m.2013.digitashealth.com/Mbook2013_web.pdf</ext-link>.</mixed-citation></ref><ref id="CR9"><label>9.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Steinhubl</surname><given-names>SR</given-names></name><name><surname>Muse</surname><given-names>ED</given-names></name><name><surname>Topol</surname><given-names>EJ</given-names></name></person-group><article-title>Can mobile health technologies transform health care?</article-title><source>JAMA</source><year>2013</year><volume>310</volume><fpage>2395</fpage><lpage>6</lpage><pub-id pub-id-type="doi">10.1001/jama.2013.281078</pub-id><pub-id pub-id-type="pmid">24158428</pub-id></element-citation></ref><ref id="CR10"><label>10.</label><mixed-citation publication-type="other">European Commission. Green paper on mobile health ("mHealth"). Brussels: EC; 2014.</mixed-citation></ref><ref id="CR11"><label>11.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>England</surname><given-names>NHS</given-names></name></person-group><source>Five year forward view</source><year>2014</year><publisher-loc>London</publisher-loc><publisher-name>HM Government</publisher-name></element-citation></ref><ref id="CR12"><label>12.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rosser</surname><given-names>BA</given-names></name><name><surname>Eccleston</surname><given-names>C</given-names></name></person-group><article-title>Smartphone applications for pain management</article-title><source>J Telemed Telecare</source><year>2011</year><volume>17</volume><fpage>308</fpage><lpage>12</lpage><pub-id pub-id-type="doi">10.1258/jtt.2011.101102</pub-id><pub-id pub-id-type="pmid">21844177</pub-id></element-citation></ref><ref id="CR13"><label>13.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>McCartney</surname><given-names>M</given-names></name></person-group><article-title>How do we know whether medical apps work?</article-title><source>BMJ</source><year>2013</year><volume>346</volume><fpage>f1811</fpage><pub-id pub-id-type="doi">10.1136/bmj.f1811</pub-id><pub-id pub-id-type="pmid">23516158</pub-id></element-citation></ref><ref id="CR14"><label>14.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cortez</surname><given-names>NG</given-names></name><name><surname>Cohen</surname><given-names>IG</given-names></name><name><surname>Kesselheim</surname><given-names>AS</given-names></name></person-group><article-title>FDA regulation of mobile health technologies</article-title><source>N Engl J Med</source><year>2014</year><volume>371</volume><fpage>372</fpage><lpage>9</lpage><pub-id pub-id-type="doi">10.1056/NEJMhle1403384</pub-id><pub-id pub-id-type="pmid">25054722</pub-id></element-citation></ref><ref id="CR15"><label>15.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wolf</surname><given-names>JA</given-names></name><name><surname>Moreau</surname><given-names>JF</given-names></name><name><surname>Akilov</surname><given-names>O</given-names></name><name><surname>Patton</surname><given-names>T</given-names></name><name><surname>English</surname><given-names>JC</given-names><suffix>3rd</suffix></name><name><surname>Ho</surname><given-names>J</given-names></name><etal></etal></person-group><article-title>Diagnostic inaccuracy of smartphone applications for melanoma detection</article-title><source>JAMA Dermatol</source><year>2013</year><volume>149</volume><fpage>422</fpage><lpage>6</lpage><pub-id pub-id-type="doi">10.1001/jamadermatol.2013.2382</pub-id><pub-id pub-id-type="pmid">23325302</pub-id></element-citation></ref><ref id="CR16"><label>16.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Huckvale</surname><given-names>K</given-names></name><name><surname>Car</surname><given-names>J</given-names></name></person-group><article-title>Implementation of mobile health tools</article-title><source>JAMA</source><year>2014</year><volume>311</volume><fpage>1447</fpage><lpage>8</lpage><pub-id pub-id-type="doi">10.1001/jama.2014.1106</pub-id><pub-id pub-id-type="pmid">24715083</pub-id></element-citation></ref><ref id="CR17"><label>17.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Atienza</surname><given-names>AA</given-names></name><name><surname>Patrick</surname><given-names>K</given-names></name></person-group><article-title>Mobile health: the killer app for cyberinfrastructure and consumer health</article-title><source>Am J Prev Med</source><year>2011</year><volume>40</volume><fpage>S151</fpage><lpage>3</lpage><pub-id pub-id-type="doi">10.1016/j.amepre.2011.01.008</pub-id><pub-id pub-id-type="pmid">21521588</pub-id></element-citation></ref><ref id="CR18"><label>18.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Buijink</surname><given-names>AWG</given-names></name><name><surname>Visser</surname><given-names>BJ</given-names></name><name><surname>Marshall</surname><given-names>L</given-names></name></person-group><article-title>Medical apps for smartphones: lack of evidence undermines quality and safety</article-title><source>Evid Based Med</source><year>2013</year><volume>18</volume><fpage>90</fpage><lpage>2</lpage><pub-id pub-id-type="doi">10.1136/eb-2012-100885</pub-id><pub-id pub-id-type="pmid">22923708</pub-id></element-citation></ref><ref id="CR19"><label>19.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>De La Vega</surname><given-names>R</given-names></name><name><surname>Miro</surname><given-names>J</given-names></name></person-group><article-title>mHealth: a strategic field without a solid scientific soul. A systematic review of pain-related apps</article-title><source>PLoS One</source><year>2014</year><volume>9</volume><fpage>e101312</fpage><pub-id pub-id-type="doi">10.1371/journal.pone.0101312</pub-id><pub-id pub-id-type="pmid">24999983</pub-id></element-citation></ref><ref id="CR20"><label>20.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bender</surname><given-names>JL</given-names></name><name><surname>Yue</surname><given-names>RY</given-names></name><name><surname>To</surname><given-names>MJ</given-names></name><name><surname>Deacken</surname><given-names>L</given-names></name><name><surname>Jadad</surname><given-names>AR</given-names></name></person-group><article-title>A lot of action, but not in the right direction: systematic review and content analysis of smartphone applications for the prevention, detection, and management of cancer</article-title><source>J Med Internet Res</source><year>2013</year><volume>15</volume><fpage>e287</fpage><pub-id pub-id-type="doi">10.2196/jmir.2661</pub-id><pub-id pub-id-type="pmid">24366061</pub-id></element-citation></ref><ref id="CR21"><label>21.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Huckvale</surname><given-names>K</given-names></name><name><surname>Car</surname><given-names>M</given-names></name><name><surname>Morrison</surname><given-names>C</given-names></name><name><surname>Car</surname><given-names>J</given-names></name></person-group><article-title>Apps for asthma self-management: a systematic assessment of content and tools</article-title><source>BMC Med</source><year>2012</year><volume>10</volume><fpage>144</fpage><pub-id pub-id-type="doi">10.1186/1741-7015-10-144</pub-id><pub-id pub-id-type="pmid">23171675</pub-id></element-citation></ref><ref id="CR22"><label>22.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Partridge</surname><given-names>MR</given-names></name><name><surname>Negro</surname><given-names>RWD</given-names></name><name><surname>Olivieri</surname><given-names>D</given-names></name></person-group><article-title>Understanding patients with asthma and COPD: insights from a European study</article-title><source>Prim Care Respir J</source><year>2011</year><volume>20</volume><fpage>315</fpage><lpage>23</lpage><pub-id pub-id-type="doi">10.4104/pcrj.2011.00056</pub-id><pub-id pub-id-type="pmid">21660394</pub-id></element-citation></ref><ref id="CR23"><label>23.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Masoli</surname><given-names>M</given-names></name><name><surname>Fabian</surname><given-names>D</given-names></name><name><surname>Holt</surname><given-names>S</given-names></name><name><surname>Beasley</surname><given-names>R</given-names></name><collab>Global Initiative for Asthma (GINA) Program</collab></person-group><article-title>The global burden of asthma: executive summary of the GINA dissemination committee report</article-title><source>Allergy</source><year>2004</year><volume>59</volume><fpage>469</fpage><lpage>78</lpage><pub-id pub-id-type="doi">10.1111/j.1398-9995.2004.00526.x</pub-id><pub-id pub-id-type="pmid">15080825</pub-id></element-citation></ref><ref id="CR24"><label>24.</label><mixed-citation publication-type="other">British Thoracic Society, Scottish Intercollegiate Guidelines Network. British guideline on the management of asthma – a national clinical guideline. May 2008, revised January 2012. Edinburgh: SIGN; 2012.</mixed-citation></ref><ref id="CR25"><label>25.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Patel</surname><given-names>S</given-names></name><name><surname>Park</surname><given-names>H</given-names></name><name><surname>Bonato</surname><given-names>P</given-names></name><name><surname>Chan</surname><given-names>L</given-names></name><name><surname>Rodgers</surname><given-names>M</given-names></name></person-group><article-title>A review of wearable sensors and systems with application in rehabilitation</article-title><source>J Neuroeng Rehabil</source><year>2012</year><volume>9</volume><fpage>21</fpage><pub-id pub-id-type="doi">10.1186/1743-0003-9-21</pub-id><pub-id pub-id-type="pmid">22520559</pub-id></element-citation></ref><ref id="CR26"><label>26.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Heredia</surname><given-names>A</given-names></name><name><surname>Garcia-Guzman</surname><given-names>J</given-names></name><name><surname>Amescua-Seco</surname><given-names>A</given-names></name><name><surname>Velasco-Diego</surname><given-names>M</given-names></name></person-group><article-title>Agile practices adapted to mass-market application development</article-title><source>J Softw (Malden)</source><year>2014</year><volume>26</volume><fpage>818</fpage><lpage>28</lpage></element-citation></ref><ref id="CR27"><label>27.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Charani</surname><given-names>E</given-names></name><name><surname>Castro-Sanchez</surname><given-names>E</given-names></name><name><surname>Moore</surname><given-names>L</given-names></name><name><surname>Holmes</surname><given-names>A</given-names></name></person-group><article-title>Do smartphone applications in healthcare require a governance and legal framework? It depends on the application!</article-title><source>BMC Med</source><year>2014</year><volume>12</volume><fpage>29</fpage><pub-id pub-id-type="doi">10.1186/1741-7015-12-29</pub-id><pub-id pub-id-type="pmid">24524344</pub-id></element-citation></ref><ref id="CR28"><label>28.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Barton</surname><given-names>A</given-names></name></person-group><article-title>The regulation of mobile health applications</article-title><source>BMC Med</source><year>2012</year><volume>10</volume><fpage>46</fpage><pub-id pub-id-type="doi">10.1186/1741-7015-10-46</pub-id><pub-id pub-id-type="pmid">22569114</pub-id></element-citation></ref><ref id="CR29"><label>29.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Alliance</surname><given-names>ECD</given-names></name></person-group><source>Green paper on mHealth apps – input from the European Chronic Disease Alliance (ECDA)</source><year>2014</year><publisher-loc>Brussels</publisher-loc><publisher-name>ECDA</publisher-name></element-citation></ref><ref id="CR30"><label>30.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Food</surname><given-names>US</given-names></name><name><surname>Administration</surname><given-names>D</given-names></name></person-group><source>Mobile medical applications – guidance for industry and food and drug administration staff</source><year>2013</year><publisher-loc>US Department of Health and Human Services</publisher-loc><publisher-name>Rockville, MD</publisher-name></element-citation></ref><ref id="CR31"><label>31.</label><mixed-citation publication-type="other">Medicines and Healthcare Regulatory Agency. Guidance on medical device stand-alone software (including apps). <ext-link ext-link-type="uri" xlink:href="http://www.mhra.gov.uk/Howweregulate/Devices/Software/index.htm">http://www.mhra.gov.uk/Howweregulate/Devices/Software/index.htm</ext-link>.</mixed-citation></ref><ref id="CR32"><label>32.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ferrero-Alvarez-Rementeria</surname><given-names>J</given-names></name><name><surname>Santana-Lopez</surname><given-names>V</given-names></name><name><surname>Escobar-Ubreva</surname><given-names>A</given-names></name><name><surname>Vazquez-Vazquez</surname><given-names>M</given-names></name></person-group><article-title>Quality and safety strategy for mobile health applications: a certification programme</article-title><source>Eur J ePractice</source><year>2013</year><volume>21</volume><fpage>14</fpage><lpage>26</lpage></element-citation></ref><ref id="CR33"><label>33.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Marvel</surname><given-names>FA</given-names></name><name><surname>Chase</surname><given-names>J</given-names></name><name><surname>Madruga</surname><given-names>M</given-names></name></person-group><article-title>Ideas to iPhones: A 10-step framework for creating mobile medical applications with case report from Madruga and Marvel’s Medical Black Book app</article-title><source>J Mob Technol Med</source><year>2014</year><volume>3</volume><fpage>35</fpage><lpage>41</lpage><pub-id pub-id-type="doi">10.7309/jmtm.3.2.6</pub-id></element-citation></ref><ref id="CR34"><label>34.</label><mixed-citation publication-type="other">Information Commissioner's Office. Privacy in mobile apps – guidance for app developers. <ext-link ext-link-type="uri" xlink:href="https://ico.org.uk/media/for-organisations/documents/1596/privacy-in-mobile-apps-dp-guidance.pdf">https://ico.org.uk/media/for-organisations/documents/1596/privacy-in-mobile-apps-dp-guidance.pdf</ext-link>.</mixed-citation></ref><ref id="CR35"><label>35.</label><mixed-citation publication-type="other">Macharia E. Five tips for healthcare app development. <ext-link ext-link-type="uri" xlink:href="http://www.software.ac.uk/blog/2013-10-08-five-tips-healthcare-app-development">http://www.software.ac.uk/blog/2013-10-08-five-tips-healthcare-app-development</ext-link>.</mixed-citation></ref><ref id="CR36"><label>36.</label><mixed-citation publication-type="other">IDC. Smartphone OS market share, Q3 2014. <ext-link ext-link-type="uri" xlink:href="http://www.idc.com/prodserv/smartphone-os-market-share.jsp">http://www.idc.com/prodserv/smartphone-os-market-share.jsp</ext-link>.</mixed-citation></ref><ref id="CR37"><label>37.</label><element-citation publication-type="book"><person-group person-group-type="author"><collab>National Asthma Education and Prevention Program</collab></person-group><source>Expert panel report 3: guidelines for the diagnosis and management of asthma. Full report 2007</source><year>2007</year><publisher-loc>Bethseda, MD</publisher-loc><publisher-name>National Institutes of Health</publisher-name></element-citation></ref><ref id="CR38"><label>38.</label><mixed-citation publication-type="other">Global Initiative for Asthma. Global strategy for asthma management and prevention. Updated 2012. <ext-link ext-link-type="uri" xlink:href="http://www.ginasthma.org">http://www.ginasthma.org</ext-link>.</mixed-citation></ref><ref id="CR39"><label>39.</label><mixed-citation publication-type="other">National Centre for Complementary and Alternative Medicine (NCCAM). Complementary, alternative, or integrative health: what’s in a name? <ext-link ext-link-type="uri" xlink:href="http://nccam.nih.gov/health/whatiscam">http://nccam.nih.gov/health/whatiscam</ext-link>.</mixed-citation></ref><ref id="CR40"><label>40.</label><mixed-citation publication-type="other">Health on the Net Foundation. Operational definition of the HONcode principles. Guidelines v2.0. <ext-link ext-link-type="uri" xlink:href="http://www.hon.ch/HONcode/Guidelines/guidelines.html#Review">http://www.hon.ch/HONcode/Guidelines/guidelines.html#Review</ext-link>.</mixed-citation></ref><ref id="CR41"><label>41.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fisher</surname><given-names>RA</given-names></name></person-group><article-title>On the interpretation of X2 from contingency tables, and the calculation of P</article-title><source>J R Stat Soc</source><year>1922</year><volume>85</volume><fpage>87</fpage><lpage>94</lpage><pub-id pub-id-type="doi">10.2307/2340521</pub-id></element-citation></ref><ref id="CR42"><label>42.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Freeman</surname><given-names>GH</given-names></name><name><surname>Halton</surname><given-names>JH</given-names></name></person-group><article-title>Note on an exact treatment of contingency, goodness of fit and other problems of significance</article-title><source>Biometrika</source><year>1951</year><volume>38</volume><fpage>141</fpage><lpage>9</lpage><pub-id pub-id-type="doi">10.1093/biomet/38.1-2.141</pub-id><pub-id pub-id-type="pmid">14848119</pub-id></element-citation></ref><ref id="CR43"><label>43.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Holm</surname><given-names>S</given-names></name></person-group><article-title>A simple sequentially rejective multiple test procedure</article-title><source>Scand J Stat</source><year>1979</year><volume>6</volume><fpage>65</fpage><lpage>70</lpage></element-citation></ref><ref id="CR44"><label>44.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cates</surname><given-names>CJ</given-names></name><name><surname>Rowe</surname><given-names>BH</given-names></name></person-group><article-title>Vaccines for preventing influenza in people with asthma</article-title><source>Cochrane Database Syst Rev</source><year>2013</year><volume>2</volume><pub-id pub-id-type="pmid">23450529</pub-id></element-citation></ref><ref id="CR45"><label>45.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>van der Palen</surname><given-names>J</given-names></name><name><surname>Klein</surname><given-names>JJ</given-names></name><name><surname>Kerkhoff</surname><given-names>AHM</given-names></name><name><surname>van Herwaarden</surname><given-names>CLA</given-names></name><name><surname>Seydel</surname><given-names>ER</given-names></name></person-group><article-title>Evaluation of the long-term effectiveness of three instruction modes for inhaling medicines</article-title><source>Patient Educ Couns</source><year>1997</year><volume>32</volume><fpage>S87</fpage><lpage>95</lpage><pub-id pub-id-type="doi">10.1016/S0738-3991(97)00100-6</pub-id><pub-id pub-id-type="pmid">9516764</pub-id></element-citation></ref><ref id="CR46"><label>46.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Melani</surname><given-names>AS</given-names></name><name><surname>Bonavia</surname><given-names>M</given-names></name><name><surname>Cilenti</surname><given-names>V</given-names></name><name><surname>Cinti</surname><given-names>C</given-names></name><name><surname>Lodi</surname><given-names>M</given-names></name><name><surname>Martucci</surname><given-names>P</given-names></name><etal></etal></person-group><article-title>Inhaler mishandling remains common in real life and is associated with reduced disease control</article-title><source>Respir Med</source><year>2011</year><volume>105</volume><fpage>930</fpage><lpage>8</lpage><pub-id pub-id-type="doi">10.1016/j.rmed.2011.01.005</pub-id><pub-id pub-id-type="pmid">21367593</pub-id></element-citation></ref><ref id="CR47"><label>47.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Freitas</surname><given-names>DA</given-names></name><name><surname>Holloway</surname><given-names>EA</given-names></name><name><surname>Bruno</surname><given-names>SS</given-names></name><name><surname>Chaves</surname><given-names>GS</given-names></name><name><surname>Fregonezi</surname><given-names>GA</given-names></name><name><surname>Mendonca</surname><given-names>KP</given-names></name></person-group><article-title>Breathing exercises for adults with asthma</article-title><source>Cochrane Database Syst Rev</source><year>2013</year><volume>10</volume><pub-id pub-id-type="pmid">24085551</pub-id></element-citation></ref><ref id="CR48"><label>48.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chomutare</surname><given-names>T</given-names></name><name><surname>Fernandez-Luque</surname><given-names>L</given-names></name><name><surname>Årsand</surname><given-names>E</given-names></name><name><surname>Hartvigsen</surname><given-names>G</given-names></name></person-group><article-title>Features of mobile diabetes applications: review of the literature and analysis of current applications compared against evidence-based guidelines</article-title><source>J Med Internet Res</source><year>2011</year><volume>13</volume><fpage>e65</fpage><pub-id pub-id-type="doi">10.2196/jmir.1874</pub-id><pub-id pub-id-type="pmid">21979293</pub-id></element-citation></ref><ref id="CR49"><label>49.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Abroms</surname><given-names>LC</given-names></name><name><surname>Lee Westmaas</surname><given-names>J</given-names></name><name><surname>Bontemps-Jones</surname><given-names>J</given-names></name><name><surname>Ramani</surname><given-names>R</given-names></name><name><surname>Mellerson</surname><given-names>J</given-names></name></person-group><article-title>A content analysis of popular smartphone apps for smoking cessation</article-title><source>Am J Prev Med</source><year>2013</year><volume>45</volume><fpage>732</fpage><lpage>6</lpage><pub-id pub-id-type="doi">10.1016/j.amepre.2013.07.008</pub-id><pub-id pub-id-type="pmid">24237915</pub-id></element-citation></ref><ref id="CR50"><label>50.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Breton</surname><given-names>E</given-names></name><name><surname>Fuemmeler</surname><given-names>B</given-names></name><name><surname>Abroms</surname><given-names>L</given-names></name></person-group><article-title>Weight loss – there is an app for that! But does it adhere to evidence-informed practices?</article-title><source>Behav Med Pract Policy Res</source><year>2011</year><volume>1</volume><fpage>523</fpage><lpage>9</lpage><pub-id pub-id-type="doi">10.1007/s13142-011-0076-5</pub-id></element-citation></ref><ref id="CR51"><label>51.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gibson</surname><given-names>PG</given-names></name><name><surname>Powell</surname><given-names>H</given-names></name></person-group><article-title>Written action plans for asthma: an evidence-based review of the key components</article-title><source>Thorax</source><year>2004</year><volume>59</volume><fpage>94</fpage><lpage>9</lpage><pub-id pub-id-type="doi">10.1136/thorax.2003.011858</pub-id><pub-id pub-id-type="pmid">14760143</pub-id></element-citation></ref><ref id="CR52"><label>52.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bodenheimer</surname><given-names>T</given-names></name><name><surname>Lorig</surname><given-names>K</given-names></name><name><surname>Holman</surname><given-names>H</given-names></name><name><surname>Grumbach</surname><given-names>K</given-names></name></person-group><article-title>Patient self-management of chronic disease in primary care</article-title><source>JAMA</source><year>2002</year><volume>288</volume><fpage>2469</fpage><lpage>75</lpage><pub-id pub-id-type="doi">10.1001/jama.288.19.2469</pub-id><pub-id pub-id-type="pmid">12435261</pub-id></element-citation></ref><ref id="CR53"><label>53.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Newcomb</surname><given-names>PA</given-names></name><name><surname>McGrath</surname><given-names>KW</given-names></name><name><surname>Covington</surname><given-names>JK</given-names></name><name><surname>Lazarus</surname><given-names>SC</given-names></name><name><surname>Janson</surname><given-names>SL</given-names></name></person-group><article-title>Barriers to patient-clinician collaboration in asthma management: the patient experience</article-title><source>J Asthma</source><year>2010</year><volume>47</volume><fpage>192</fpage><lpage>7</lpage><pub-id pub-id-type="doi">10.3109/02770900903486397</pub-id><pub-id pub-id-type="pmid">20170328</pub-id></element-citation></ref><ref id="CR54"><label>54.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Paasche-Orlow</surname><given-names>MK</given-names></name><name><surname>Riekert</surname><given-names>KA</given-names></name><name><surname>Bilderback</surname><given-names>A</given-names></name><name><surname>Chanmugam</surname><given-names>A</given-names></name><name><surname>Hill</surname><given-names>P</given-names></name><name><surname>Rand</surname><given-names>CS</given-names></name><etal></etal></person-group><article-title>Tailored education may reduce health literacy disparities in asthma self-management</article-title><source>Am J Respir Crit Care Med</source><year>2005</year><volume>172</volume><fpage>980</fpage><lpage>6</lpage><pub-id pub-id-type="doi">10.1164/rccm.200409-1291OC</pub-id><pub-id pub-id-type="pmid">16081544</pub-id></element-citation></ref><ref id="CR55"><label>55.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hall</surname><given-names>JL</given-names></name><name><surname>McGraw</surname><given-names>D</given-names></name></person-group><article-title>For telehealth to succeed, privacy and security risks must be identified and addressed</article-title><source>Health Aff (Millwood)</source><year>2014</year><volume>33</volume><fpage>216</fpage><lpage>21</lpage><pub-id pub-id-type="doi">10.1377/hlthaff.2013.0997</pub-id><pub-id pub-id-type="pmid">24493763</pub-id></element-citation></ref><ref id="CR56"><label>56.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mosnaim</surname><given-names>GS</given-names></name><name><surname>Powell</surname><given-names>LH</given-names></name><name><surname>Rathkopf</surname><given-names>M</given-names></name></person-group><article-title>A review of published studies using interactive internet tools or mobile devices to improve asthma knowledge or health outcomes</article-title><source>Pediatr Allergy Immunol Pulmonol</source><year>2012</year><volume>25</volume><fpage>55</fpage><lpage>63</lpage><pub-id pub-id-type="doi">10.1089/ped.2011.0112</pub-id></element-citation></ref><ref id="CR57"><label>57.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Burnay</surname><given-names>E</given-names></name><name><surname>Cruz-Correia</surname><given-names>R</given-names></name><name><surname>Jacinto</surname><given-names>T</given-names></name><name><surname>Sousa</surname><given-names>AS</given-names></name><name><surname>Fonseca</surname><given-names>J</given-names></name></person-group><article-title>Challenges of a mobile application for asthma and allergic rhinitis patient enablement-interface and synchronization</article-title><source>Telemed J E Health</source><year>2013</year><volume>19</volume><fpage>13</fpage><lpage>8</lpage><pub-id pub-id-type="doi">10.1089/tmj.2012.0020</pub-id><pub-id pub-id-type="pmid">23215639</pub-id></element-citation></ref><ref id="CR58"><label>58.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Michie</surname><given-names>S</given-names></name><name><surname>Richardson</surname><given-names>M</given-names></name><name><surname>Johnston</surname><given-names>M</given-names></name><name><surname>Abraham</surname><given-names>C</given-names></name><name><surname>Francis</surname><given-names>J</given-names></name><name><surname>Hardeman</surname><given-names>W</given-names></name><etal></etal></person-group><article-title>The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions</article-title><source>Ann Behav Med</source><year>2013</year><volume>46</volume><fpage>81</fpage><lpage>95</lpage><pub-id pub-id-type="doi">10.1007/s12160-013-9486-6</pub-id><pub-id pub-id-type="pmid">23512568</pub-id></element-citation></ref><ref id="CR59"><label>59.</label><mixed-citation publication-type="other">Markines B, Cattuto C, Menczer F. Social spam detection. 5th International Workshop on Adversarial Information Retrieval on the Web. 20 April 2009; Madrid: ACM; 2009. p. 41–8.</mixed-citation></ref><ref id="CR60"><label>60.</label><mixed-citation publication-type="other">McCreadie R, Macdonald C, Ounis I, Giles J, Jabr F. An examination of content farms in web search using crowdsourcing. 21st ACM International Conference on Information and Knowledge Management. 29 October – 2 November 2012. Maui, Hawaii: ACM; 2012. p. 2551–4.</mixed-citation></ref><ref id="CR61"><label>61.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Colledge</surname><given-names>A</given-names></name><name><surname>Car</surname><given-names>J</given-names></name><name><surname>Donnelly</surname><given-names>A</given-names></name><name><surname>Majeed</surname><given-names>A</given-names></name></person-group><article-title>Health information for patients: time to look beyond patient information leaflets</article-title><source>J R Soc Med</source><year>2008</year><volume>101</volume><fpage>447</fpage><lpage>53</lpage><pub-id pub-id-type="doi">10.1258/jrsm.2008.080149</pub-id><pub-id pub-id-type="pmid">18779246</pub-id></element-citation></ref><ref id="CR62"><label>62.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yang</surname><given-names>YT</given-names></name><name><surname>Silverman</surname><given-names>RD</given-names></name></person-group><article-title>Mobile health applications: the patchwork of legal and liability issues suggests strategies to improve oversight</article-title><source>Health Aff (Millwood)</source><year>2014</year><volume>33</volume><fpage>222</fpage><lpage>7</lpage><pub-id pub-id-type="doi">10.1377/hlthaff.2013.0958</pub-id><pub-id pub-id-type="pmid">24493764</pub-id></element-citation></ref><ref id="CR63"><label>63.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Food</surname><given-names>US</given-names></name><name><surname>Administration</surname><given-names>D</given-names></name></person-group><source>Appendix A – examples of mobile apps that are not medical devices. Mobile Medical Applications – Guidance for Industry and Food and Drug Administration Staff</source><year>2013</year><publisher-loc>Rockville, MD</publisher-loc><publisher-name>US Department of Health and Human Services</publisher-name></element-citation></ref><ref id="CR64"><label>64.</label><mixed-citation publication-type="other">Agencia de Calidad Sanitaria de Andalucia. [Distintivo app saludable]. <ext-link ext-link-type="uri" xlink:href="http://www.calidadappsalud.com/">http://www.calidadappsalud.com/</ext-link>.</mixed-citation></ref><ref id="CR65"><label>65.</label><mixed-citation publication-type="other">NHS Health Apps Library. Review process. <ext-link ext-link-type="uri" xlink:href="http://apps.nhs.uk/review-process">http://apps.nhs.uk/review-process</ext-link>.</mixed-citation></ref><ref id="CR66"><label>66.</label><mixed-citation publication-type="other">King J. “How come I’m allowing strangers to go through my phone?” – smartphones and privacy expectations. Symposium On Usable Privacy and Security (SOUPS) 2012. July 11th–13th, 2012. Washington, DC; 2012.</mixed-citation></ref><ref id="CR67"><label>67.</label><mixed-citation publication-type="other">Office of the Privacy Commissioner of Canada. Results of the 2014 Global Privacy Enforcement Network sweep. <ext-link ext-link-type="uri" xlink:href="https://www.priv.gc.ca/media/nr-c/2014/bg_140910_e.asp">https://www.priv.gc.ca/media/nr-c/2014/bg_140910_e.asp</ext-link>.</mixed-citation></ref><ref id="CR68"><label>68.</label><mixed-citation publication-type="other">Sunyaev A, Dehling T, Taylor PL, Mandl KD. Availability and quality of mobile health app privacy policies. J Am Med Inform Assoc. 2014.</mixed-citation></ref><ref id="CR69"><label>69.</label><mixed-citation publication-type="other">Privacy Rights Clearinghouse. Fact Sheet 39: Mobile health and fitness apps: what are the privacy risks? <ext-link ext-link-type="uri" xlink:href="https://www.privacyrights.org/mobile-health-and-fitness-apps-what-are-privacy-risks">https://www.privacyrights.org/mobile-health-and-fitness-apps-what-are-privacy-risks</ext-link>.</mixed-citation></ref><ref id="CR70"><label>70.</label><mixed-citation publication-type="other">Dolan B. Happtique suspends mobile health app certification program. <ext-link ext-link-type="uri" xlink:href="http://mobihealthnews.com/28165/happtique-suspends-mobile-health-app-certification-program/">http://mobihealthnews.com/28165/happtique-suspends-mobile-health-app-certification-program/</ext-link>.</mixed-citation></ref><ref id="CR71"><label>71.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lewis</surname><given-names>TL</given-names></name></person-group><article-title>A systematic self-certification model for mobile medical apps</article-title><source>J Med Internet Res</source><year>2013</year><volume>15</volume><fpage>e89</fpage><pub-id pub-id-type="doi">10.2196/jmir.2446</pub-id><pub-id pub-id-type="pmid">23615332</pub-id></element-citation></ref><ref id="CR72"><label>72.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Albrecht</surname><given-names>UV</given-names></name><name><surname>von Jan</surname><given-names>U</given-names></name><name><surname>Jungnickel</surname><given-names>T</given-names></name><name><surname>Pramann</surname><given-names>O</given-names></name></person-group><article-title>App-synopsis – standard reporting for medical apps</article-title><source>Stud Health Technol Inform</source><year>2013</year><volume>192</volume><fpage>1154</fpage><pub-id pub-id-type="pmid">23920928</pub-id></element-citation></ref><ref id="CR73"><label>73.</label><mixed-citation publication-type="other">Divakaruni A, Armstrong M, Gruber-Baldini A, Shulman L. Discordance between medication apps and needs of patients with Parkinson's disease. Neurology. 2014;82:Supplement P3.067.</mixed-citation></ref><ref id="CR74"><label>74.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Marcano Belisario</surname><given-names>JS</given-names></name><name><surname>Huckvale</surname><given-names>K</given-names></name><name><surname>Greenfield</surname><given-names>G</given-names></name><name><surname>Car</surname><given-names>J</given-names></name><name><surname>Gunn</surname><given-names>LH</given-names></name></person-group><article-title>Smartphone and tablet self management apps for asthma</article-title><source>Cochrane Database Syst Rev</source><year>2013</year><volume>11</volume><pub-id pub-id-type="pmid">24282112</pub-id></element-citation></ref></ref-list></back></pmc></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/CyberinfraV1/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000177 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 000177 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= CyberinfraV1
|flux= Pmc
|étape= Corpus
|type= RBID
|clé= PMC:4391129
|texte= The evolution of mobile apps for asthma: an updated systematic assessment of content and tools
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/RBID.i -Sk "pubmed:25857569" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd \
| NlmPubMed2Wicri -a CyberinfraV1
| This area was generated with Dilib version V0.6.25. |  |