Using the random forest method to detect a response shift in the quality of life of multiple sclerosis patients: a cohort study
Identifieur interne : 002168 ( Pmc/Corpus ); précédent : 002167; suivant : 002169Using the random forest method to detect a response shift in the quality of life of multiple sclerosis patients: a cohort study
Auteurs : Mohamed Boucekine ; Anderson Loundou ; Karine Baumstarck ; Patricia Minaya-Flores ; Jean Pelletier ; Badih Ghattas ; Pascal AuquierSource :
- BMC Medical Research Methodology [ 1471-2288 ] ; 2013.
Abstract
Multiple sclerosis (MS), a common neurodegenerative disease, has well-described associations with quality of life (QoL) impairment. QoL changes found in longitudinal studies are difficult to interpret due to the potential response shift (RS) corresponding to respondents’ changing standards, values, and conceptualization of QoL. This study proposes to test the capacity of Random Forest (RF) for detecting RS reprioritization as the relative importance of QoL domains’ changes over time.
This was a longitudinal observational study. The main inclusion criteria were patients 18 years old or more with relapsing-remitting multiple sclerosis. Every 6 months up to month 24, QoL was recorded using generic and MS-specific questionnaires (MusiQoL and SF-36). At 24 months, individuals were divided into two ‘disability change’ groups: worsened and not-worsened patients. The RF method was performed based on Breiman’s description. Analyses were performed to determine which QoL scores of SF-36 predicted the MusiQoL index. The average variable importance (AVI) was estimated.
A total of 417 (79.6%) patients were defined as not-worsened and 107 (20.4%) as worsened. A clear RS was identified in worsened patients. While the mental score AVI was almost one third higher than the physical score AVI at 12 months, it was 1.5 times lower at 24 months.
This work confirms that the RF method offers a useful statistical approach for RS detection. How to integrate the RS in the interpretation of QoL scores remains a challenge for future research.
ClinicalTrials.gov identifier:
Url:
DOI: 10.1186/1471-2288-13-20
PubMed: 23414459
PubMed Central: 3626785
Links to Exploration step
PMC:3626785Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Using the random forest method to detect a response shift in the quality of life of multiple sclerosis patients: a cohort study</title><author><name sortKey="Boucekine, Mohamed" sort="Boucekine, Mohamed" uniqKey="Boucekine M" first="Mohamed" last="Boucekine">Mohamed Boucekine</name><affiliation><nlm:aff id="I1">EA3279, Self-perceived Health Assessment Research Unit, School of Medicine, Université de la Méditerranée, 27 bd Jean Moulin, Marseille cedex 05, F-13385, France</nlm:aff></affiliation></author><author><name sortKey="Loundou, Anderson" sort="Loundou, Anderson" uniqKey="Loundou A" first="Anderson" last="Loundou">Anderson Loundou</name><affiliation><nlm:aff id="I1">EA3279, Self-perceived Health Assessment Research Unit, School of Medicine, Université de la Méditerranée, 27 bd Jean Moulin, Marseille cedex 05, F-13385, France</nlm:aff></affiliation></author><author><name sortKey="Baumstarck, Karine" sort="Baumstarck, Karine" uniqKey="Baumstarck K" first="Karine" last="Baumstarck">Karine Baumstarck</name><affiliation><nlm:aff id="I1">EA3279, Self-perceived Health Assessment Research Unit, School of Medicine, Université de la Méditerranée, 27 bd Jean Moulin, Marseille cedex 05, F-13385, France</nlm:aff></affiliation></author><author><name sortKey="Minaya Flores, Patricia" sort="Minaya Flores, Patricia" uniqKey="Minaya Flores P" first="Patricia" last="Minaya-Flores">Patricia Minaya-Flores</name><affiliation><nlm:aff id="I1">EA3279, Self-perceived Health Assessment Research Unit, School of Medicine, Université de la Méditerranée, 27 bd Jean Moulin, Marseille cedex 05, F-13385, France</nlm:aff></affiliation></author><author><name sortKey="Pelletier, Jean" sort="Pelletier, Jean" uniqKey="Pelletier J" first="Jean" last="Pelletier">Jean Pelletier</name><affiliation><nlm:aff id="I2">Departments of Neurology and CRMBM CNRS6612, Timone University Hospital, APHM, Marseille, France</nlm:aff></affiliation></author><author><name sortKey="Ghattas, Badih" sort="Ghattas, Badih" uniqKey="Ghattas B" first="Badih" last="Ghattas">Badih Ghattas</name><affiliation><nlm:aff id="I3">Department of Mathematics, Faculté des Sciences de Luminy, Aix-Marseille University, Marseille, France</nlm:aff></affiliation></author><author><name sortKey="Auquier, Pascal" sort="Auquier, Pascal" uniqKey="Auquier P" first="Pascal" last="Auquier">Pascal Auquier</name><affiliation><nlm:aff id="I1">EA3279, Self-perceived Health Assessment Research Unit, School of Medicine, Université de la Méditerranée, 27 bd Jean Moulin, Marseille cedex 05, F-13385, France</nlm:aff></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">23414459</idno><idno type="pmc">3626785</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3626785</idno><idno type="RBID">PMC:3626785</idno><idno type="doi">10.1186/1471-2288-13-20</idno><date when="2013">2013</date><idno type="wicri:Area/Pmc/Corpus">002168</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Corpus" wicri:corpus="PMC">002168</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Using the random forest method to detect a response shift in the quality of life of multiple sclerosis patients: a cohort study</title><author><name sortKey="Boucekine, Mohamed" sort="Boucekine, Mohamed" uniqKey="Boucekine M" first="Mohamed" last="Boucekine">Mohamed Boucekine</name><affiliation><nlm:aff id="I1">EA3279, Self-perceived Health Assessment Research Unit, School of Medicine, Université de la Méditerranée, 27 bd Jean Moulin, Marseille cedex 05, F-13385, France</nlm:aff></affiliation></author><author><name sortKey="Loundou, Anderson" sort="Loundou, Anderson" uniqKey="Loundou A" first="Anderson" last="Loundou">Anderson Loundou</name><affiliation><nlm:aff id="I1">EA3279, Self-perceived Health Assessment Research Unit, School of Medicine, Université de la Méditerranée, 27 bd Jean Moulin, Marseille cedex 05, F-13385, France</nlm:aff></affiliation></author><author><name sortKey="Baumstarck, Karine" sort="Baumstarck, Karine" uniqKey="Baumstarck K" first="Karine" last="Baumstarck">Karine Baumstarck</name><affiliation><nlm:aff id="I1">EA3279, Self-perceived Health Assessment Research Unit, School of Medicine, Université de la Méditerranée, 27 bd Jean Moulin, Marseille cedex 05, F-13385, France</nlm:aff></affiliation></author><author><name sortKey="Minaya Flores, Patricia" sort="Minaya Flores, Patricia" uniqKey="Minaya Flores P" first="Patricia" last="Minaya-Flores">Patricia Minaya-Flores</name><affiliation><nlm:aff id="I1">EA3279, Self-perceived Health Assessment Research Unit, School of Medicine, Université de la Méditerranée, 27 bd Jean Moulin, Marseille cedex 05, F-13385, France</nlm:aff></affiliation></author><author><name sortKey="Pelletier, Jean" sort="Pelletier, Jean" uniqKey="Pelletier J" first="Jean" last="Pelletier">Jean Pelletier</name><affiliation><nlm:aff id="I2">Departments of Neurology and CRMBM CNRS6612, Timone University Hospital, APHM, Marseille, France</nlm:aff></affiliation></author><author><name sortKey="Ghattas, Badih" sort="Ghattas, Badih" uniqKey="Ghattas B" first="Badih" last="Ghattas">Badih Ghattas</name><affiliation><nlm:aff id="I3">Department of Mathematics, Faculté des Sciences de Luminy, Aix-Marseille University, Marseille, France</nlm:aff></affiliation></author><author><name sortKey="Auquier, Pascal" sort="Auquier, Pascal" uniqKey="Auquier P" first="Pascal" last="Auquier">Pascal Auquier</name><affiliation><nlm:aff id="I1">EA3279, Self-perceived Health Assessment Research Unit, School of Medicine, Université de la Méditerranée, 27 bd Jean Moulin, Marseille cedex 05, F-13385, France</nlm:aff></affiliation></author></analytic><series><title level="j">BMC Medical Research Methodology</title><idno type="eISSN">1471-2288</idno><imprint><date when="2013">2013</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><sec><title>Background</title><p>Multiple sclerosis (MS), a common neurodegenerative disease, has well-described associations with quality of life (QoL) impairment. QoL changes found in longitudinal studies are difficult to interpret due to the potential response shift (RS) corresponding to respondents’ changing standards, values, and conceptualization of QoL. This study proposes to test the capacity of Random Forest (RF) for detecting RS reprioritization as the relative importance of QoL domains’ changes over time.</p></sec><sec><title>Methods</title><p>This was a longitudinal observational study. The main inclusion criteria were patients 18 years old or more with relapsing-remitting multiple sclerosis. Every 6 months up to month 24, QoL was recorded using generic and MS-specific questionnaires (MusiQoL and SF-36). At 24 months, individuals were divided into two ‘disability change’ groups: worsened and not-worsened patients. The RF method was performed based on Breiman’s description. Analyses were performed to determine which QoL scores of SF-36 predicted the MusiQoL index. The average variable importance (AVI) was estimated.</p></sec><sec><title>Results</title><p>A total of 417 (79.6%) patients were defined as not-worsened and 107 (20.4%) as worsened. A clear RS was identified in worsened patients. While the mental score AVI was almost one third higher than the physical score AVI at 12 months, it was 1.5 times lower at 24 months.</p></sec><sec><title>Conclusion</title><p>This work confirms that the RF method offers a useful statistical approach for RS detection. How to integrate the RS in the interpretation of QoL scores remains a challenge for future research.</p></sec><sec><title>Trial registration</title><p>ClinicalTrials.gov identifier:
<ext-link ext-link-type="uri" xlink:href="http://www.clinicaltrials.gov/ct2/show/NCT00702065?term=multiple+sclerosis+musiqol%rank=1">NCT00702065</ext-link></p></sec></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Mitchell, Aj" uniqKey="Mitchell A">AJ Mitchell</name></author><author><name sortKey="Benito Leon, J" uniqKey="Benito Leon J">J Benito-Leon</name></author><author><name sortKey="Gonzalez, Jm" uniqKey="Gonzalez J">JM Gonzalez</name></author><author><name sortKey="Rivera Navarro, J" uniqKey="Rivera Navarro J">J Rivera-Navarro</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Solari, A" uniqKey="Solari A">A Solari</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Miller, Dm" uniqKey="Miller D">DM Miller</name></author><author><name sortKey="Allen, R" uniqKey="Allen R">R Allen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Rudick, Ra" uniqKey="Rudick R">RA Rudick</name></author><author><name sortKey="Miller, Dm" uniqKey="Miller D">DM Miller</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sprangers, Ma" uniqKey="Sprangers M">MA Sprangers</name></author><author><name sortKey="Schwartz, Ce" uniqKey="Schwartz C">CE Schwartz</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schwartz, Ce" uniqKey="Schwartz C">CE Schwartz</name></author><author><name sortKey="Sprangers, Ma" uniqKey="Sprangers M">MA Sprangers</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="King Kallimanis, Bl" uniqKey="King Kallimanis B">BL King-Kallimanis</name></author><author><name sortKey="Oort, Fj" uniqKey="Oort F">FJ Oort</name></author><author><name sortKey="Nolte, S" uniqKey="Nolte S">S Nolte</name></author><author><name sortKey="Schwartz, Ce" uniqKey="Schwartz C">CE Schwartz</name></author><author><name sortKey="Sprangers, Ma" uniqKey="Sprangers M">MA Sprangers</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ahmed, S" uniqKey="Ahmed S">S Ahmed</name></author><author><name sortKey="Mayo, N" uniqKey="Mayo N">N Mayo</name></author><author><name sortKey="Scott, S" uniqKey="Scott S">S Scott</name></author><author><name sortKey="Kuspinar, A" uniqKey="Kuspinar A">A Kuspinar</name></author><author><name sortKey="Schwartz, C" uniqKey="Schwartz C">C Schwartz</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Li, Y" uniqKey="Li Y">Y Li</name></author><author><name sortKey="Schwartz, Ce" uniqKey="Schwartz C">CE Schwartz</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schwartz, Ce" uniqKey="Schwartz C">CE Schwartz</name></author><author><name sortKey="Sprangers, Ma" uniqKey="Sprangers M">MA Sprangers</name></author><author><name sortKey="Oort, F" uniqKey="Oort F">F Oort</name></author><author><name sortKey="Ahmed, S" uniqKey="Ahmed S">S Ahmed</name></author><author><name sortKey="Bode, R" uniqKey="Bode R">R Bode</name></author><author><name sortKey="Li, Y" uniqKey="Li Y">Y Li</name></author><author><name sortKey="Vollmer, T" uniqKey="Vollmer T">T Vollmer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Breiman, L" uniqKey="Breiman L">L Breiman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Breiman, L" uniqKey="Breiman L">L Breiman</name></author><author><name sortKey="Cutler, A" uniqKey="Cutler A">A Cutler</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Verikas, A" uniqKey="Verikas A">A Verikas</name></author><author><name sortKey="Gelzinis, A" uniqKey="Gelzinis A">A Gelzinis</name></author><author><name sortKey="Bacauskiene, M" uniqKey="Bacauskiene M">M Bacauskiene</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Touw, Wg" uniqKey="Touw W">WG Touw</name></author><author><name sortKey="Bayjanov, Jr" uniqKey="Bayjanov J">JR Bayjanov</name></author><author><name sortKey="Overmars, L" uniqKey="Overmars L">L Overmars</name></author><author><name sortKey="Backus, L" uniqKey="Backus L">L Backus</name></author><author><name sortKey="Boekhorst, J" uniqKey="Boekhorst J">J Boekhorst</name></author><author><name sortKey="Wels, M" uniqKey="Wels M">M Wels</name></author><author><name sortKey="Van Hijum, Sa" uniqKey="Van Hijum S">SA van Hijum</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Chen, X" uniqKey="Chen X">X Chen</name></author><author><name sortKey="Ishwaran, H" uniqKey="Ishwaran H">H Ishwaran</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Goldstein, Ba" uniqKey="Goldstein B">BA Goldstein</name></author><author><name sortKey="Polley, Ec" uniqKey="Polley E">EC Polley</name></author><author><name sortKey="Briggs, Fbs" uniqKey="Briggs F">FBS Briggs</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Flachenecker, P" uniqKey="Flachenecker P">P Flachenecker</name></author><author><name sortKey="Baumstarck Barrau, K" uniqKey="Baumstarck Barrau K">K Baumstarck-Barrau</name></author><author><name sortKey="Butzkueven, H" uniqKey="Butzkueven H">H Butzkueven</name></author><author><name sortKey="Fernandez, O" uniqKey="Fernandez O">O Fernández</name></author><author><name sortKey="Idiman, E" uniqKey="Idiman E">E Idiman</name></author><author><name sortKey="Pelletier, J" uniqKey="Pelletier J">J Pelletier</name></author><author><name sortKey="Stecchi, S" uniqKey="Stecchi S">S Stecchi</name></author><author><name sortKey="Verdun Di Cantogno, E" uniqKey="Verdun Di Cantogno E">E Verdun di Cantogno</name></author><author><name sortKey="Milner, A" uniqKey="Milner A">A Milner</name></author><author><name sortKey="Auquier, P" uniqKey="Auquier P">P Auquier</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mcdonald, Wi" uniqKey="Mcdonald W">WI McDonald</name></author><author><name sortKey="Compston, A" uniqKey="Compston A">A Compston</name></author><author><name sortKey="Edan, G" uniqKey="Edan G">G Edan</name></author><author><name sortKey="Goodkin, D" uniqKey="Goodkin D">D Goodkin</name></author><author><name sortKey="Hartung, Hp" uniqKey="Hartung H">HP Hartung</name></author><author><name sortKey="Lublin, Fd" uniqKey="Lublin F">FD Lublin</name></author><author><name sortKey="Mcfarland, Hf" uniqKey="Mcfarland H">HF McFarland</name></author><author><name sortKey="Paty, Dw" uniqKey="Paty D">DW Paty</name></author><author><name sortKey="Polman, Ch" uniqKey="Polman C">CH Polman</name></author><author><name sortKey="Reingold, Sc" uniqKey="Reingold S">SC Reingold</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Polman, Ch" uniqKey="Polman C">CH Polman</name></author><author><name sortKey="Wolinsky, Js" uniqKey="Wolinsky J">JS Wolinsky</name></author><author><name sortKey="Reingold, Sc" uniqKey="Reingold S">SC Reingold</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kurtzke, Jf" uniqKey="Kurtzke J">JF Kurtzke</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Simeoni, M" uniqKey="Simeoni M">M Simeoni</name></author><author><name sortKey="Auquier, P" uniqKey="Auquier P">P Auquier</name></author><author><name sortKey="Fernandez, O" uniqKey="Fernandez O">O Fernandez</name></author><author><name sortKey="Flachenecker, P" uniqKey="Flachenecker P">P Flachenecker</name></author><author><name sortKey="Stecchi, S" uniqKey="Stecchi S">S Stecchi</name></author><author><name sortKey="Constantinescu, C" uniqKey="Constantinescu C">C Constantinescu</name></author><author><name sortKey="Idiman, E" uniqKey="Idiman E">E Idiman</name></author><author><name sortKey="Boyko, A" uniqKey="Boyko A">A Boyko</name></author><author><name sortKey="Beiske, A" uniqKey="Beiske A">A Beiske</name></author><author><name sortKey="Vollmer, T" uniqKey="Vollmer T">T Vollmer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ware, Je" uniqKey="Ware J">JE Ware</name></author><author><name sortKey="Sherbourne, Cd" uniqKey="Sherbourne C">CD Sherbourne</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Amato, Mp" uniqKey="Amato M">MP Amato</name></author><author><name sortKey="Grimaud, J" uniqKey="Grimaud J">J Grimaud</name></author><author><name sortKey="Achiti, I" uniqKey="Achiti I">I Achiti</name></author><author><name sortKey="Bartolozzi, Ml" uniqKey="Bartolozzi M">ML Bartolozzi</name></author><author><name sortKey="Adeleine, P" uniqKey="Adeleine P">P Adeleine</name></author><author><name sortKey="Hartung, Hp" uniqKey="Hartung H">HP Hartung</name></author><author><name sortKey="Kappos, L" uniqKey="Kappos L">L Kappos</name></author><author><name sortKey="Thompson, A" uniqKey="Thompson A">A Thompson</name></author><author><name sortKey="Trojano, M" uniqKey="Trojano M">M Trojano</name></author><author><name sortKey="Vukusic, S" uniqKey="Vukusic S">S Vukusic</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Goodkin, De" uniqKey="Goodkin D">DE Goodkin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Breiman, L" uniqKey="Breiman L">L Breiman</name></author><author><name sortKey="Friedman, Jh" uniqKey="Friedman J">JH Friedman</name></author><author><name sortKey="Olshen, Ra" uniqKey="Olshen R">RA Olshen</name></author><author><name sortKey="Stone, Cj" uniqKey="Stone C">CJ Stone</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Dempster, M" uniqKey="Dempster M">M Dempster</name></author><author><name sortKey="Carney, R" uniqKey="Carney R">R Carney</name></author><author><name sortKey="Mcclements, R" uniqKey="Mcclements R">R McClements</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ring, L" uniqKey="Ring L">L Ring</name></author><author><name sortKey="Hofer, S" uniqKey="Hofer S">S Hofer</name></author><author><name sortKey="Heuston, F" uniqKey="Heuston F">F Heuston</name></author><author><name sortKey="Harris, D" uniqKey="Harris D">D Harris</name></author><author><name sortKey="O Boyle, Ca" uniqKey="O Boyle C">CA O'Boyle</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fernandez, O" uniqKey="Fernandez O">O Fernandez</name></author><author><name sortKey="Baumstarck Barrau, K" uniqKey="Baumstarck Barrau K">K Baumstarck-Barrau</name></author><author><name sortKey="Simeoni, Mc" uniqKey="Simeoni M">MC Simeoni</name></author><author><name sortKey="Auquier, P" uniqKey="Auquier P">P Auquier</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Norman, G" uniqKey="Norman G">G Norman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Oort, Fj" uniqKey="Oort F">FJ Oort</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Oort, Fj" uniqKey="Oort F">FJ Oort</name></author><author><name sortKey="Visser, Mr" uniqKey="Visser M">MR Visser</name></author><author><name sortKey="Sprangers, Ma" uniqKey="Sprangers M">MA Sprangers</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Li, Y" uniqKey="Li Y">Y Li</name></author><author><name sortKey="Rapkin, B" uniqKey="Rapkin B">B Rapkin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mayo, Ne" uniqKey="Mayo N">NE Mayo</name></author><author><name sortKey="Scott, Sc" uniqKey="Scott S">SC Scott</name></author><author><name sortKey="Dendukuri, N" uniqKey="Dendukuri N">N Dendukuri</name></author><author><name sortKey="Ahmed, S" uniqKey="Ahmed S">S Ahmed</name></author><author><name sortKey="Wood Dauphinee, S" uniqKey="Wood Dauphinee S">S Wood-Dauphinee</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lunetta, Kl" uniqKey="Lunetta K">KL Lunetta</name></author><author><name sortKey="Hayward, Lb" uniqKey="Hayward L">LB Hayward</name></author><author><name sortKey="Segal, J" uniqKey="Segal J">J Segal</name></author><author><name sortKey="Van Eerdewegh, P" uniqKey="Van Eerdewegh P">P Van Eerdewegh</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Liaw, A" uniqKey="Liaw A">A Liaw</name></author><author><name sortKey="Wiener, M" uniqKey="Wiener M">M Wiener</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Boyer, L" uniqKey="Boyer L">L Boyer</name></author><author><name sortKey="Auquier, P" uniqKey="Auquier P">P Auquier</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Awad, Ag" uniqKey="Awad A">AG Awad</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schwartz, Ce" uniqKey="Schwartz C">CE Schwartz</name></author><author><name sortKey="Rapkin, Bd" uniqKey="Rapkin B">BD Rapkin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Rapkin, Bd" uniqKey="Rapkin B">BD Rapkin</name></author><author><name sortKey="Schwartz, Ce" uniqKey="Schwartz C">CE Schwartz</name></author></analytic></biblStruct></listBibl></div1></back></TEI><pmc article-type="research-article" xml:lang="en"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">BMC Med Res Methodol</journal-id><journal-id journal-id-type="iso-abbrev">BMC Med Res Methodol</journal-id><journal-title-group><journal-title>BMC Medical Research Methodology</journal-title></journal-title-group><issn pub-type="epub">1471-2288</issn><publisher><publisher-name>BioMed Central</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">23414459</article-id><article-id pub-id-type="pmc">3626785</article-id><article-id pub-id-type="publisher-id">1471-2288-13-20</article-id><article-id pub-id-type="doi">10.1186/1471-2288-13-20</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group></article-categories><title-group><article-title>Using the random forest method to detect a response shift in the quality of life of multiple sclerosis patients: a cohort study</article-title></title-group><contrib-group><contrib contrib-type="author" corresp="yes" id="A1"><name><surname>Boucekine</surname><given-names>Mohamed</given-names></name><xref ref-type="aff" rid="I1">1</xref><email>boucekine.m@gmail.com</email></contrib><contrib contrib-type="author" id="A2"><name><surname>Loundou</surname><given-names>Anderson</given-names></name><xref ref-type="aff" rid="I1">1</xref><email>anderson.loundou@univmed.fr</email></contrib><contrib contrib-type="author" id="A3"><name><surname>Baumstarck</surname><given-names>Karine</given-names></name><xref ref-type="aff" rid="I1">1</xref><email>karine.baumstarck@univmed.fr</email></contrib><contrib contrib-type="author" id="A4"><name><surname>Minaya-Flores</surname><given-names>Patricia</given-names></name><xref ref-type="aff" rid="I1">1</xref><email>patriciaminaya1@gmail.com</email></contrib><contrib contrib-type="author" id="A5"><name><surname>Pelletier</surname><given-names>Jean</given-names></name><xref ref-type="aff" rid="I2">2</xref><email>jean.pelletier@ap-hm.fr</email></contrib><contrib contrib-type="author" id="A6"><name><surname>Ghattas</surname><given-names>Badih</given-names></name><xref ref-type="aff" rid="I3">3</xref><email>ghattas@univmed.fr</email></contrib><contrib contrib-type="author" id="A7"><name><surname>Auquier</surname><given-names>Pascal</given-names></name><xref ref-type="aff" rid="I1">1</xref><email>pascal.auquier@univmed.fr</email></contrib></contrib-group><aff id="I1"><label>1</label>EA3279, Self-perceived Health Assessment Research Unit, School of Medicine, Université de la Méditerranée, 27 bd Jean Moulin, Marseille cedex 05, F-13385, France</aff><aff id="I2"><label>2</label>Departments of Neurology and CRMBM CNRS6612, Timone University Hospital, APHM, Marseille, France</aff><aff id="I3"><label>3</label>Department of Mathematics, Faculté des Sciences de Luminy, Aix-Marseille University, Marseille, France</aff><pub-date pub-type="collection"><year>2013</year></pub-date><pub-date pub-type="epub"><day>15</day><month>2</month><year>2013</year></pub-date><volume>13</volume><fpage>20</fpage><lpage>20</lpage><history><date date-type="received"><day>5</day><month>11</month><year>2012</year></date><date date-type="accepted"><day>13</day><month>2</month><year>2013</year></date></history><permissions><copyright-statement>Copyright © 2013 Boucekine et al.; licensee BioMed Central Ltd.</copyright-statement><copyright-year>2013</copyright-year><copyright-holder>Boucekine et al.; licensee BioMed Central Ltd.</copyright-holder><license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/2.0"><license-p>This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/2.0">http://creativecommons.org/licenses/by/2.0</ext-link>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p></license></permissions><self-uri xlink:href="http://www.biomedcentral.com/1471-2288/13/20"></self-uri><abstract><sec><title>Background</title><p>Multiple sclerosis (MS), a common neurodegenerative disease, has well-described associations with quality of life (QoL) impairment. QoL changes found in longitudinal studies are difficult to interpret due to the potential response shift (RS) corresponding to respondents’ changing standards, values, and conceptualization of QoL. This study proposes to test the capacity of Random Forest (RF) for detecting RS reprioritization as the relative importance of QoL domains’ changes over time.</p></sec><sec><title>Methods</title><p>This was a longitudinal observational study. The main inclusion criteria were patients 18 years old or more with relapsing-remitting multiple sclerosis. Every 6 months up to month 24, QoL was recorded using generic and MS-specific questionnaires (MusiQoL and SF-36). At 24 months, individuals were divided into two ‘disability change’ groups: worsened and not-worsened patients. The RF method was performed based on Breiman’s description. Analyses were performed to determine which QoL scores of SF-36 predicted the MusiQoL index. The average variable importance (AVI) was estimated.</p></sec><sec><title>Results</title><p>A total of 417 (79.6%) patients were defined as not-worsened and 107 (20.4%) as worsened. A clear RS was identified in worsened patients. While the mental score AVI was almost one third higher than the physical score AVI at 12 months, it was 1.5 times lower at 24 months.</p></sec><sec><title>Conclusion</title><p>This work confirms that the RF method offers a useful statistical approach for RS detection. How to integrate the RS in the interpretation of QoL scores remains a challenge for future research.</p></sec><sec><title>Trial registration</title><p>ClinicalTrials.gov identifier:
<ext-link ext-link-type="uri" xlink:href="http://www.clinicaltrials.gov/ct2/show/NCT00702065?term=multiple+sclerosis+musiqol%rank=1">NCT00702065</ext-link></p></sec></abstract><kwd-group><kwd>Multiple sclerosis</kwd><kwd>Quality of life</kwd><kwd>Response shift</kwd><kwd>Random forest</kwd><kwd>MusiQoL</kwd><kwd>SF-36</kwd><kwd>Longitudinal studies</kwd><kwd>Variable importance</kwd></kwd-group></article-meta></front><body><sec><title>Background</title><p>Regulatory agencies such as the Food and Drug Administration in the United States, the National Institute for Health and Clinical Excellence in England, and the National Authority for Health in France recommend assessing the quality of life (QoL) in patients with chronic disease. Particularly in the field of multiple sclerosis (MS), QoL is recognized as a major outcome measure for assessing health, evaluating treatment, and managing care
[<xref ref-type="bibr" rid="B1">1</xref>,<xref ref-type="bibr" rid="B2">2</xref>]. MS, the most common neurodegenerative disease in young adults, has well-described associations with QoL impairment
[<xref ref-type="bibr" rid="B3">3</xref>,<xref ref-type="bibr" rid="B4">4</xref>].</p><p>QoL is a subjective measure of a patient’s life satisfaction that is affected by many factors related to patients’ intrinsic characteristics, such as mood, coping mechanisms, disease state/progression, and factors related to environmental characteristics, such as life experiences and emotional support. Evaluations of change in QoL are important for tracking the progression of the impact of the disease. QoL changes found in longitudinal studies are difficult to interpret. Are these changes due to a true change of the QoL level or to respondents’ changing standards, values, or conceptualizations
[<xref ref-type="bibr" rid="B5">5</xref>,<xref ref-type="bibr" rid="B6">6</xref>]? This phenomenon is also well described and is referred to as a ‘response shift’ (RS). Classically, three types of RS have been distinguished: (a) changes in internal standards of measurement (recalibration), (b) changes in the priority (i.e., importance) of the component domains of the target construct (reprioritization), and (c) redefinition of the target construct (reconceptualization).</p><p>Several statistical methods have been proposed to detect an RS
[<xref ref-type="bibr" rid="B5">5</xref>], specifically in MS populations: the then-test, structural equation modeling (SEM)
[<xref ref-type="bibr" rid="B7">7</xref>], latent trajectory analysis of residuals
[<xref ref-type="bibr" rid="B8">8</xref>], and more recently, recursive partitioning tree analysis as a data mining method
[<xref ref-type="bibr" rid="B9">9</xref>]. Each method has its own specific advantages and limitations that have been clearly discussed
[<xref ref-type="bibr" rid="B10">10</xref>]. It would be premature to conclude which method is best for detecting an RS. The variety of methods developed illustrates the complexity and difficulty in detecting and measuring an RS.</p><p>The Random Forest (RF) method developed by Breiman
[<xref ref-type="bibr" rid="B11">11</xref>,<xref ref-type="bibr" rid="B12">12</xref>] is mainly used as a predictive approach. It has become a popular technique because the RF classification and regression models are versatile. The RF method has high prediction accuracy compared to other classification and regression algorithms
[<xref ref-type="bibr" rid="B13">13</xref>]. There are numerous examples of the application of the RF in a variety of fields
[<xref ref-type="bibr" rid="B14">14</xref>], specifically in genomics research
[<xref ref-type="bibr" rid="B15">15</xref>] and genetic association studies
[<xref ref-type="bibr" rid="B16">16</xref>]. The method provides an original variable’s importance index for classification and regression that can be applied in other fields
[<xref ref-type="bibr" rid="B14">14</xref>]—for example, to assess the RS in the reprioritization component of QoL assessments.</p><p>This study proposes to test the capacity of the RF approach for detecting RS reprioritization as the relative importance of QoL domains change over time.</p><p>The manuscript is organized as follows:</p><p>- the methods section, including the study design and setting, a brief description of RF specifications and how we use the RF method to detect RS,</p><p>- the results section containing the main findings of the analysis,</p><p>- and the discussion section, including the strengths and limitations of the RF method and opportunities for further research.</p></sec><sec sec-type="methods"><title>Methods</title><sec><title>Study design and setting</title><p>This was a multicenter, multiregional, longitudinal observational study carried out at 32 centers in 12 countries: Argentina, Australia, Austria, Germany, Spain, France, Israel, Italy, Norway, Turkey, the United Kingdom, and the United States
[<xref ref-type="bibr" rid="B17">17</xref>] (Additional file
<xref ref-type="supplementary-material" rid="S1">1</xref>: Table S1).</p><p>The inclusion criteria were as follows: patients 18 years old or more with relapsing-remitting multiple sclerosis (RR-MS) according to the McDonald criteria
[<xref ref-type="bibr" rid="B18">18</xref>,<xref ref-type="bibr" rid="B19">19</xref>] with an Expanded Disability Status Scale (EDSS) score lower than 7.0, with or without treatment, followed up as per the local standard of care practices and with a signed informed consent form. Patients suffering from dementia were excluded. All therapeutic decisions during the study were made at the discretion of the treating physician.</p></sec><sec><title>Ethics committee and regulatory requirements</title><p>This study (ClinicalTrials.gov identifier: NCT00702065) was performed in accordance with the Declaration of Helsinki and all applicable regulatory authority requirements and national laws (Institutional Review Board or Independent Ethics Committee in accordance with the local requirements of each of the 12 countries). Written informed consent from patients was obtained prior to any study procedures.</p></sec><sec><title>Evaluation times and data collection</title><p>The follow-up measurements took place over 24 months after inclusion. At baseline, sociodemographic (age at inclusion, gender, education level, marital status, employment status) and clinical (disease duration) data were obtained. Neurological disability status was assessed using a neurologist-rated EDSS score
[<xref ref-type="bibr" rid="B20">20</xref>]. QoL was determined using the MusiQoL and SF-36 questionnaires when patients attended their local neurological clinic. The MusiQoL questionnaire is a self-administered, multi-dimensional, patient-based QoL instrument comprising 31 items that describe nine dimensions (activity of daily living, psychological well-being, relationships with friends, symptoms, relationships with family, relationship with the healthcare system, sentimental and sexual life, coping, and rejection)
[<xref ref-type="bibr" rid="B21">21</xref>]. MusiQoL provides a global index score, which is calculated as the mean of the individual dimension scores. The SF-36 is composed of 36 items that are used to calculate the following eight scale scores: physical functioning (PF), social functioning (SF), role–physical (RP), role–emotional (RE), mental health (MH), vitality (Vi), bodily pain (BP), and general health (GH)
[<xref ref-type="bibr" rid="B22">22</xref>]. Two composite summary measures are also calculated: the Physical Component Summary (PCS) and the Mental Component Summary (MCS) scores. The PCS and MCS scores are norm-based, using a linear T-score transformation with a mean (standard deviation [SD]) of 50
[<xref ref-type="bibr" rid="B10">10</xref>]). Both the MusiQoL and SF-36 yield scores on a 0–100 scale, in which 0 represents the lowest and 100 the highest QoL.</p><p>Every 6 months up to month 24, the EDSS and QoL were recorded: at baseline (M0), 6 months (M6), 12 months (M12), 18 months (M18), and 24 months post-inclusion (M24).</p></sec><sec><title>Definition of disability deterioration</title><p>At 24 months, individuals were divided into two ‘disability change’ groups according to the following neurological standards
[<xref ref-type="bibr" rid="B23">23</xref>,<xref ref-type="bibr" rid="B24">24</xref>]: 1. worsened patients experienced clinically meaningful worsening in the EDSS is defined as an increase of one point if the EDSS was less than 5.5, or by half a point if the EDSS was between 5.5 and 7.0, between the baseline and 24-month EDSS scores; 2. not-worsened patients comprised all other cases.</p><p>The not-worsened group was used as a control group in the analysis under the assumption that they were not prone to response shifts in perceived QoL.</p></sec><sec><title>Data analysis</title><sec><title>Classification and regression trees</title><p>The Classification and Regression Trees (CART) method
[<xref ref-type="bibr" rid="B25">25</xref>] is a binary splitting method that recursively partitions the data set into disjoint subgroups, called the leafs. It uses two algorithms. The first algorithm iteratively splits the data set into two sub-samples according to a binary rule such as “PCS < 50”. The splitting rule is based on one of the explanatory variables and on a threshold for this variable. It is chosen in such a way as to minimize the heterogeneity of the obtained subsamples for a continuous outcome. Regression trees are constructed using the “deviance” criterion.</p><p>The two obtained sub-samples are then recursively partitioned in the same way until there are too few observations (usually five) in the obtained samples (other stopping rules are available). This procedure yields a tree that may have too many terminal nodes. The mean value of the output variable is assigned to each leaf, computed over the observations within the corresponding region.</p><p>To avoid overfitting the data when using this tree, a pruning algorithm is used to select an optimal sub-tree.</p></sec><sec><title>The random forest method</title><p>Random Forests
[<xref ref-type="bibr" rid="B11">11</xref>] is an ensemble method that aggregates K trees similar to the ones constructed with CART, each one grown using a bootstrap sample of the original data set. Each tree in the forest uses only a subset of the explanatory variables at each node. The trees are not pruned. The prediction given by an RF is the mean of the predictions given by the K trees in the forest when using regression trees.</p></sec><sec><title>Variable importance</title><p>As the trees in the forest are developed using bootstrap samples of the original data set, the Out-of-Bag (OOB) samples are used as test samples. The performance of each tree is computed over the corresponding OOB sample. The observations of each variable in the OOB sample are randomly permuted, and the trees’ performance is computed over the perturbed OOB samples. A variable's importance (VI) is defined as the mean relative decrease in the trees’ performance when the observations of this variable in the OOB sample are randomly permuted. To obtain more stable assessments of each VI, we run the RF K=300 times and use the average VI over the K runs.</p></sec><sec><title>Detecting response shift reprioritization with random forest</title><p>We investigated the importance of different explanatory variables in the global MusiQoL index forecast. To do this, we calculated the VI by the RF method based on two models.</p><p><disp-formula><mml:math id="M1" name="1471-2288-13-20-i1" overflow="scroll"><mml:mrow><mml:msup><mml:mi>M</mml:mi><mml:mfenced open="(" close=")"><mml:mn>1</mml:mn></mml:mfenced></mml:msup><mml:msub><mml:mtext mathvariant="italic">Global</mml:mtext><mml:mtext mathvariant="italic">Index</mml:mtext></mml:msub><mml:mo>=</mml:mo><mml:mi>f</mml:mi><mml:mfenced open="(" close=")"><mml:mrow><mml:mtext mathvariant="italic">PCS</mml:mtext><mml:mo>,</mml:mo><mml:mtext mathvariant="italic">MCS</mml:mtext><mml:mo>,</mml:mo><mml:mi>X</mml:mi></mml:mrow></mml:mfenced></mml:mrow></mml:math></disp-formula></p><p><disp-formula><mml:math id="M2" name="1471-2288-13-20-i2" overflow="scroll"><mml:mrow><mml:msup><mml:mi>M</mml:mi><mml:mfenced open="(" close=")"><mml:mn>2</mml:mn></mml:mfenced></mml:msup><mml:msub><mml:mtext mathvariant="italic">Global</mml:mtext><mml:mtext mathvariant="italic">Index</mml:mtext></mml:msub><mml:mo>=</mml:mo><mml:mi>f</mml:mi><mml:mfenced open="(" close=")"><mml:mrow><mml:mtext mathvariant="italic">PF</mml:mtext><mml:mo>,</mml:mo><mml:mtext mathvariant="italic">RP</mml:mtext><mml:mo>,</mml:mo><mml:mtext mathvariant="italic">VI</mml:mtext><mml:mo>,</mml:mo><mml:mtext mathvariant="italic">BP</mml:mtext><mml:mo>,</mml:mo><mml:mtext mathvariant="italic">SF</mml:mtext><mml:mo>,</mml:mo><mml:mtext mathvariant="italic">RE</mml:mtext><mml:mo>,</mml:mo><mml:mtext mathvariant="italic">MH</mml:mtext><mml:mo>,</mml:mo><mml:mtext mathvariant="italic">GH</mml:mtext><mml:mo>,</mml:mo><mml:mi>X</mml:mi></mml:mrow></mml:mfenced></mml:mrow></mml:math></disp-formula></p><p>Where</p><p><disp-formula><mml:math id="M3" name="1471-2288-13-20-i3" overflow="scroll"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:mi>X</mml:mi><mml:mo>=</mml:mo><mml:mo>(</mml:mo><mml:mtext mathvariant="italic">Age</mml:mtext><mml:mo>,</mml:mo><mml:mtext mathvariant="italic">Gender</mml:mtext><mml:mo>,</mml:mo><mml:mtext mathvariant="italic">Education</mml:mtext><mml:mspace width="0.5em"></mml:mspace><mml:mtext mathvariant="italic">Level</mml:mtext><mml:mo>,</mml:mo><mml:mtext mathvariant="italic">Marital</mml:mtext><mml:mspace width="0.5em"></mml:mspace><mml:mtext mathvariant="italic">Status</mml:mtext><mml:mo>,</mml:mo></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mspace width="2.2em"></mml:mspace><mml:mtext mathvariant="italic">Employment</mml:mtext><mml:mspace width="0.5em"></mml:mspace><mml:mtext mathvariant="italic">Status</mml:mtext><mml:mo>,</mml:mo><mml:mtext mathvariant="italic">Disease</mml:mtext><mml:mspace width="0.5em"></mml:mspace><mml:mtext mathvariant="italic">Duration</mml:mtext><mml:mo>)</mml:mo><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula></p><p>Model <italic>M</italic><sup><italic>(2)</italic></sup> is more refined than <italic>M</italic><sup><italic>(1)</italic></sup>. We adjusted these two models separately for the worsened group and the not-worsened group at each moment t=0,…,4. In this way, we obtained the average of VI (AVI) that evolved with time for each explanatory variable
<inline-formula><mml:math id="M4" name="1471-2288-13-20-i4" overflow="scroll"><mml:mrow><mml:mover accent="true"><mml:mi>X</mml:mi><mml:mo stretchy="true">˜</mml:mo></mml:mover><mml:mspace width="0.5em"></mml:mspace><mml:mtext mathvariant="italic">AV</mml:mtext><mml:msub><mml:mi>I</mml:mi><mml:mi>t</mml:mi></mml:msub><mml:mfenced open="(" close=")"><mml:mover accent="true"><mml:mi>X</mml:mi><mml:mo stretchy="true">˜</mml:mo></mml:mover></mml:mfenced></mml:mrow></mml:math></inline-formula>. We compared the evolution of AVI for each variable in the two groups. Crossing curves were considered an effect of reprioritization.</p><p>To control the difference in baseline EDSS scores between the worsened and not-worsened groups, supplementary analyses were performed on baseline EDSS score-matched groups (100 worsened patients and 100 not-worsened patients).</p></sec></sec></sec><sec sec-type="results"><title>Results</title><sec><title>Sample characteristics</title><p>The sample included 580 patients enrolled from 12 countries between November 2007 and October 2010. The 24-month EDSS was available for 524 of 536 patients. A total of 417 (79.6%) patients were defined as not-worsened and 107 (20.4%) patients were defined as worsened. Table
<xref ref-type="table" rid="T1">1</xref> shows the baseline demographic and clinical characteristics of the worsened and not-worsened subjects.</p><table-wrap position="float" id="T1"><label>Table 1</label><caption><p>Baseline sociodemographic and clinical patient characteristics</p></caption><table frame="hsides" rules="groups" border="1"><colgroup><col align="left"></col><col align="left"></col><col align="left"></col><col align="left"></col><col align="left"></col><col align="left"></col></colgroup><thead valign="top"><tr><th colspan="2" align="left"> </th><th align="left"><bold>Total sample°</bold><break></break><bold>N=580</bold></th><th align="left"><bold>Worsened patients*</bold><break></break><bold>N=107</bold></th><th align="left"><bold>Not-worsened patients*</bold></th><th align="left"><bold>p</bold></th></tr></thead><tbody valign="top"><tr><td align="left" valign="bottom">Female, n (%)<hr></hr></td><td align="left" valign="bottom"> <hr></hr></td><td align="left" valign="bottom">419 (72.2)<hr></hr></td><td align="left" valign="bottom">75 (70.1)<hr></hr></td><td align="left" valign="bottom">300 (71.9)<hr></hr></td><td align="left" valign="bottom">0.71<hr></hr></td></tr><tr><td align="left" valign="bottom">Age (years)<hr></hr></td><td align="left" valign="bottom">M (SD)<hr></hr></td><td align="left" valign="bottom">41.3 (10.2)<hr></hr></td><td align="left" valign="bottom">43.2 (10.2)<hr></hr></td><td align="left" valign="bottom">40.9 (10.1)<hr></hr></td><td align="left" valign="bottom"><bold>0.03</bold><hr></hr></td></tr><tr><td align="left" valign="bottom"> <hr></hr></td><td align="left" valign="bottom">Min, max<hr></hr></td><td align="left" valign="bottom">18, 71<hr></hr></td><td align="left" valign="bottom">19, 64<hr></hr></td><td align="left" valign="bottom">18, 69<hr></hr></td><td align="left" valign="bottom"> <hr></hr></td></tr><tr><td align="left" valign="bottom">Marital status, n (%)<hr></hr></td><td align="left" valign="bottom">Cohabiting/married<hr></hr></td><td align="left" valign="bottom">393 (67.8)<hr></hr></td><td align="left" valign="bottom">73 (68.2)<hr></hr></td><td align="left" valign="bottom">282 (67.6)<hr></hr></td><td align="left" valign="bottom">0.91<hr></hr></td></tr><tr><td align="left" valign="bottom"> <hr></hr></td><td align="left" valign="bottom">Divorced/separated/single/widowed<hr></hr></td><td align="left" valign="bottom">187 (32.2)<hr></hr></td><td align="left" valign="bottom">34 (31.8)<hr></hr></td><td align="left" valign="bottom">73 (68.2)<hr></hr></td><td align="left" valign="bottom"> <hr></hr></td></tr><tr><td align="left" valign="bottom">Employment status, n (%)<hr></hr></td><td align="left" valign="bottom">Employed<hr></hr></td><td align="left" valign="bottom">335 (57.8)<hr></hr></td><td align="left" valign="bottom">59 (55.1)<hr></hr></td><td align="left" valign="bottom">241 (57.8)<hr></hr></td><td align="left" valign="bottom">0.62<hr></hr></td></tr><tr><td align="left" valign="bottom"> <hr></hr></td><td align="left" valign="bottom">Unemployed/homemaker/retired/student<hr></hr></td><td align="left" valign="bottom">245 (42.2)<hr></hr></td><td align="left" valign="bottom">48 (44.9)<hr></hr></td><td align="left" valign="bottom">176 (42.2)<hr></hr></td><td align="left" valign="bottom"> <hr></hr></td></tr><tr><td rowspan="3" align="left" valign="bottom">Educational level, n (%)<hr></hr></td><td align="left" valign="bottom">Elementary school<hr></hr></td><td align="left" valign="bottom">113 (19.5)<hr></hr></td><td align="left" valign="bottom">31 (28.4)<hr></hr></td><td align="left" valign="bottom">76 (18.2)<hr></hr></td><td rowspan="3" align="left" valign="bottom"><bold>0.03</bold><hr></hr></td></tr><tr><td align="left" valign="bottom">College<hr></hr></td><td align="left" valign="bottom">81 (14.0)<hr></hr></td><td align="left" valign="bottom">9 (8.3)<hr></hr></td><td align="left" valign="bottom">61 (14.6)<hr></hr></td></tr><tr><td align="left" valign="bottom">High school/university<hr></hr></td><td align="left" valign="bottom">386 (66.6)<hr></hr></td><td align="left" valign="bottom">67 (63.3)<hr></hr></td><td align="left" valign="bottom">280 (67.1)<hr></hr></td></tr><tr><td rowspan="3" align="left" valign="bottom">EDSS score<hr></hr></td><td align="left" valign="bottom">M (SD)<hr></hr></td><td align="left" valign="bottom">2.9 (1.9)<hr></hr></td><td align="left" valign="bottom">3.5 (2.2)<hr></hr></td><td align="left" valign="bottom">2.8 (1.8)<hr></hr></td><td rowspan="3" align="left" valign="bottom"><bold><10</bold><sup><bold>-3</bold></sup><hr></hr></td></tr><tr><td align="left" valign="bottom">Median<hr></hr></td><td align="left" valign="bottom">2.5<hr></hr></td><td align="left" valign="bottom">4.0<hr></hr></td><td align="left" valign="bottom">2.0<hr></hr></td></tr><tr><td align="left" valign="bottom">Min, max<hr></hr></td><td align="left" valign="bottom">0.0, 7.5<hr></hr></td><td align="left" valign="bottom">0.0, 7.0<hr></hr></td><td align="left" valign="bottom">0.0, 7.0<hr></hr></td></tr><tr><td rowspan="4" align="left" valign="bottom">MS course, n (%)<hr></hr></td><td align="left" valign="bottom">Relapsing-remitting<hr></hr></td><td align="left" valign="bottom">510 (87.9)<hr></hr></td><td align="left" valign="bottom">79 (73.8)<hr></hr></td><td align="left" valign="bottom">381 (91.4)<hr></hr></td><td rowspan="4" align="left" valign="bottom"><bold><10</bold><sup><bold>-3</bold></sup><hr></hr></td></tr><tr><td align="left" valign="bottom">Secondary progressive<hr></hr></td><td align="left" valign="bottom">53 (9.1)<hr></hr></td><td align="left" valign="bottom">18 (16.8)<hr></hr></td><td align="left" valign="bottom">30 (7.2)<hr></hr></td></tr><tr><td align="left" valign="bottom">Primary progressive<hr></hr></td><td align="left" valign="bottom">12 (2.1)<hr></hr></td><td align="left" valign="bottom">8 (7.5)<hr></hr></td><td align="left" valign="bottom">2 (0.5)<hr></hr></td></tr><tr><td align="left" valign="bottom">Primary relapsing<hr></hr></td><td align="left" valign="bottom">5 (0.9)<hr></hr></td><td align="left" valign="bottom">2 (1.9)<hr></hr></td><td align="left" valign="bottom">4 (1.0)<hr></hr></td></tr><tr><td align="left" valign="bottom">Time since first MS symptom (years)<hr></hr></td><td align="left" valign="bottom">M (SD)<hr></hr></td><td align="left" valign="bottom">10.0 (7.5)<hr></hr></td><td align="left" valign="bottom">10.2 (8.1)<hr></hr></td><td align="left" valign="bottom">9.9 (7.2)<hr></hr></td><td align="left" valign="bottom">0.73<hr></hr></td></tr><tr><td align="left"> </td><td align="left">Min, max</td><td align="left">0, 45</td><td align="left">0, 45</td><td align="left">0.0, 40</td><td align="left"> </td></tr></tbody></table><table-wrap-foot><p>M (SD), mean (standard deviation);</p><p>EDSS, Expanded Disability Status Scale; MS, multiple sclerosis;</p><p>° the 24-month EDSS was not available for 56 individuals.</p><p>* defined as worsened or not-worsened based on change in EDSS score from baseline to month 24 according to the definition of Lublin [Lublin 1996] and Kappos [Kappos 2004];</p><p>Bold values: p-value < 0.05.</p></table-wrap-foot></table-wrap></sec><sec><title>Response shift detection on MusiQoL index</title><p>The results are provided in Figure
<xref ref-type="fig" rid="F1">1</xref> and Figure
<xref ref-type="fig" rid="F2">2</xref>. The proportion of total variance was higher than 55% for each global index model using MCS and PCS variables from M6 to M24, both for worsened and not-worsened individuals (at 24 months, 68% and 66%, respectively). Figure
<xref ref-type="fig" rid="F1">1</xref>a identifies a clear RS in the worsened patients based on the crossing of the MCS and PCS curves over time. In the patients, the MCS and PCS AVI were close at M0, and the MCS AVI was almost one-third higher than the PCS AVI at M12. However, the AVI of PCS was 1.5 times greater than the AVI of MCS at M24. In the worsened patients, the reprioritization RS related specifically to the ‘physical-like’ dimensions of the SF-36 RP and PF dimensions and not the ‘mental-like’ dimensions (Figure
<xref ref-type="fig" rid="F2">2</xref>a). Figure
<xref ref-type="fig" rid="F1">1</xref>b shows the absence of an RS in not-worsened patients with the curves that did not cross over time and with the MCS and PCS AVI progressing symmetrically. In the not-worsened patients, the order of AVI of the SF-36 dimensions (Figure
<xref ref-type="fig" rid="F2">2</xref>b) did not obviously differ between M0 and M24. At M24, the proportion of total variance for the models using the SF-36 dimensions accounted for 71 and 67% for the worsened and not-worsened groups, respectively.</p><fig id="F1" position="float"><label>Figure 1</label><caption><p><bold>Average of variable importance of mental and physical composite scores of SF-36 to MusiQoL index prediction.</bold> Figure <bold>1a</bold>. Worsened individuals (n=107). Figure <bold>1b</bold>. Not-worsened individuals (n=417)</p></caption><graphic xlink:href="1471-2288-13-20-1"></graphic></fig><fig id="F2" position="float"><label>Figure 2</label><caption><p><bold>Average of variable importance of dimensions of SF-36 to MusiQoL index prediction.</bold> Figure <bold>2a</bold>. Worsened individuals (n=107). Figure <bold>2b</bold>. Not-worsened individuals (n=417)</p></caption><graphic xlink:href="1471-2288-13-20-2"></graphic></fig><p>The results of the baseline EDSS-matched groups are detailed in additional figures (Additional file
<xref ref-type="supplementary-material" rid="S2">2</xref>: Figure S1 and Additional file
<xref ref-type="supplementary-material" rid="S3">3</xref>: Figure S2). The findings were globally similar. One discrepancy concerns the not-worsened patients. While the MCS and PCS AVI progressed symmetrically in the entire sample, the 2 curves were close at M12 in the matched groups.</p></sec></sec><sec sec-type="discussion"><title>Discussion</title><p>In longitudinal studies, the fundamental assumption is that the measures are interpretable across time; however, when an RS occurs, this assumption is invalidated because an RS makes change difficult to assess. It is not uncommon for MS patients to report improved mental health status despite severe impairments in physical functioning
[<xref ref-type="bibr" rid="B9">9</xref>]. When an RS is present, conventional statistical analyses might not detect true change in the measures
[<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B27">27</xref>]. It is critical for researchers and clinicians to have access to methods for detecting the presence of RS in their data. While several methods were previously used for this purpose, to our knowledge, this is the first study that assesses RS detection using the RF method. The RF method identified patterns of an RS in a global QoL change score. The reprioritization aspect of the RS was recognized through the qualitative differences of the importance of QoL specific domains that were retained by RF analysis.</p><p>Using the RF method, the RS was well identified in our worsened population. In this group, we observed that the mental composite score became more important during the twelve months following inclusion, while the importance of mental and physical aspects was close at the initial evaluation. This reprioritization effect should reflect a reaction of psychological compensation highlighted by the specific increase of the importance of the mental health dimension over time. The natural evolution of the disease generally includes deterioration and disability. During the second year of follow-up, the order of prioritization was inverted, with the greatest importance given to the physical component. Among the ‘physical-like’ dimensions of the SF-36, we observed a greater importance of physical functioning and role physical dimensions compared to both bodily pain and general health dimensions, for which the scores were relatively stable over time. This finding can be explained by the fact that the disease is not particularly painful and does not affect general health in the short term.</p><p>In the not-worsened population, no crossing of the curves was observed during the 24-month follow-up. The mental composite scores had a greater and, consequently, more important impact on the global quality of life index compared to the physical composite scores from the initial evaluation. In this population, the specific analysis of the ‘mental-like’ dimensions indicated that social functioning was clearly an important dimension, showing higher importance indices than the vitality and role emotional dimensions. In contrast, in the worsened population, the three dimensions showed similar importance, reflecting a lower priority for the social domain of the QoL domain. In our study, the lower importance of social life in this group is independent of marital status, although a relationship between the two parameters was previously reported elsewhere, specifically in MS
[<xref ref-type="bibr" rid="B28">28</xref>]. Considering marital status as an indirect marker of global social interactions, we thus hypothesize that an MS patient with a severe disease course would anticipate a decrease in his/her social interactions. This reaction would result from the patient’s behavior and beliefs related to the disease. On the contrary, the reprioritization phenomenon found for the social dimension in MS individuals presenting with less severe disease may reflect a willingness to adapt to their situation.</p><p>Other methods to detect reprioritization RS have already been developed, specifically in MS populations.</p><p>The design-based approaches, specifically the then-test approach
[<xref ref-type="bibr" rid="B5">5</xref>], assess the self-reported patient quality of life at two different times and calculate the difference between the first time (pre-test) and the last time (then-test). Such methods are sensitive and biased and tend to be restricted to retrospective studies
[<xref ref-type="bibr" rid="B29">29</xref>].</p><p>Structural equation modeling (a model-based approach) tests for a change in the magnitude of factor loadings on a common latent variable over time
[<xref ref-type="bibr" rid="B30">30</xref>,<xref ref-type="bibr" rid="B31">31</xref>]. This approach cannot always be implemented in studies with small sample sizes because the larger number of parameters to estimate may result in a lack of model convergence. The order in which parameters are tested can affect the conclusion. If a substantial portion of the sample has not undergone an RS, the method is more likely to conclude that the RS did not occur.</p><p>More recently, the RS was tested using a recursive partitioning tree analysis that is based on the disease trajectory
[<xref ref-type="bibr" rid="B9">9</xref>,<xref ref-type="bibr" rid="B32">32</xref>]. A tree is created for each disease trajectory group. The order of the disability domain indicates reprioritization. This relatively recent data mining method shows promise for identifying small changes in patient-reported outcomes scores over time.</p><p>The method based on latent trajectory analysis was centered and used to create trajectories
[<xref ref-type="bibr" rid="B33">33</xref>]. An RS was hypothesized to be present when an individual's centered residuals showed a pattern of fluctuation over time. This method does not determine the type of RS that occurred, but it is used to identify subgroups of the population who present an RS.</p><p>Finally, methods based on the item response theory should be tested.</p><p>The RF method presents several advantages. First, the combination of several trees in a forest results in a stronger classification predictor compared to a single tree. Cross-validation procedures to assess the classification performance of the model are unnecessary because they are already built in, as each tree in the forest has its own training and test (OOB) data. Third, RF are non-parametric, non-linear stable models; no assumptions about the form of underlying relationships between the predictor variables and the response are made
[<xref ref-type="bibr" rid="B34">34</xref>]. Fourth, variable importance may be assessed. Finally, the RF algorithm is available in many different open source software packages. Our choice of the RandomForest package
[<xref ref-type="bibr" rid="B35">35</xref>], available as an R implementation of the original RF code
[<xref ref-type="bibr" rid="B36">36</xref>], relied on its wide distribution, ease of use, and the benefit from R data processing functionalities.</p><p>The main drawback of our approach is that it only detects the reprioritization component of RS. The role of reprioritization in the score is not quantified. The random forest variable importance measures may be biased in situations where potential predictor variables vary in their scale of measurement or their number of categories
[<xref ref-type="bibr" rid="B10">10</xref>]. The method does not provide a statistical test for evaluating the assumption of differences between two importance variable scores, making it difficult to give a clear interpretation when the importance measures are close. A test comparing the score curves should provide an objective decision tool for this purpose.</p><sec><title>Strengths and limitations</title><p>This study has several strengths and limitations.</p><p>The RS phenomenon should not be restricted to RS detection. Future research should be developed to address the remaining essential question: Does the RS need to be integrated into the interpretation of QoL score changes, and how can the weight of the RS in the QoL measure be determined when an RS is detected? The need to restore the usefulness and credibility of the QoL assessment has been recently discussed
[<xref ref-type="bibr" rid="B37">37</xref>,<xref ref-type="bibr" rid="B38">38</xref>]; answering this question will contribute to the reintegration of QoL data into clinical practice.</p><p>The nature of the use of the QoL questionnaire should be investigated. Some authors expected that disease-specific measures would be less susceptible to a response shift because they query specific symptoms or functional limitations more than generic measures
[<xref ref-type="bibr" rid="B39">39</xref>]. We do not accept this assumption because we do not consider MusiQoL to be a symptom-function measure. MusiQoL is a well-validated multidimensional instrument assessing physical, mental, and social domains. Nevertheless, our analyses were performed on an index that is not expected to provide the most sensitive score of changes in the MusiQoL
[<xref ref-type="bibr" rid="B21">21</xref>]. This restriction illustrates the results more clearly. Future works should provide data from MusiQoL dimension scores that more accurately demonstrate the RS.</p><p>Our study investigated the RS phenomena in the global MusiQoL index. It would be of interest to analyze the RS in the SF36 scores in order to make comparisons of the RS among different diseases.</p><p>Another important aspect of this study concerns the appraisal process of the RS, which is not directly measured in the present work. In the absence of an external criterion for the RS (pleasure appraisal processes), an RS interpretation of results will remain disputable
[<xref ref-type="bibr" rid="B10">10</xref>,<xref ref-type="bibr" rid="B40">40</xref>]. Future research should measure the RS with direct measures of appraisal.</p><p>Future explorations should be performed to compare the capacity of the RF method for detecting the RS with other usual methods and of the degree of convergence of the isolated phenomena.</p></sec></sec><sec sec-type="conclusions"><title>Conclusion</title><p>Investigation of the response shift in multiple sclerosis is required to establish a strong construct. This work suggests that the random forest method offers a useful statistical approach to response shift detection.</p></sec><sec><title>Abbreviations</title><p>AVI: Average variable importance; CART: Classification and Regression Trees; EDSS: Expanded Disability Status Scale; MusiQoL: Multiple Sclerosis International Quality of Life; MS: Multiple sclerosis; OOB: Out-of-Bag; QoL: Quality of life; RF: Random Forest; RR-MS: Relapsing-remitting multiple sclerosis; RS: Response shift; SEM: Structural equation modeling; SF36: Short Form 36; VI: Variable’s importance; ADL: Activity of daily living; PWB: Psychological well-being; RFr: Relationships with friends; SPT: Symptoms; RFa: Relationships with family; RHCS: Relationships with health care system; SSL: Sentimental and sexual life; COP: Coping; REJ: Rejection; PF: Physical function; SF: Social function; RP: Role physical; RE: Role emotional; MH: Mental health; Vi: Vitality; BP: Bodily pain; GH: General health; PCS: Physical composite score; MCS: Mental composite score.</p></sec><sec><title>Competing interest</title><p>The authors declare that they have no competing interests.</p></sec><sec><title>Authors’ contributions</title><p>Conception and design: MB, BG, PA. Study coordination: JP, BG, PA. Inclusion and clinical data collection: JP. Analysis of data: MB, AL, KB. Interpretation of data: MB, AL, KB, PMF, JP, PA. Drafting and writing of manuscript: MB, KB, BG, PA. Revision of manuscript: MB, AL, KB, PMF, JP, BG, PA. All authors read and approved the final manuscript.</p></sec><sec><title>Pre-publication history</title><p>The pre-publication history for this paper can be accessed here:</p><p><ext-link ext-link-type="uri" xlink:href="http://www.biomedcentral.com/1471-2288/13/20/prepub">http://www.biomedcentral.com/1471-2288/13/20/prepub</ext-link></p></sec><sec sec-type="supplementary-material"><title>Supplementary Material</title><supplementary-material content-type="local-data" id="S1"><caption><title>Additional file 1: Table S1</title><p>Investigators and centers.</p></caption><media xlink:href="1471-2288-13-20-S1.doc"><caption><p>Click here for file</p></caption></media></supplementary-material><supplementary-material content-type="local-data" id="S2"><caption><title>Additional file 2: Figure S1</title><p>Average of variable importance of mental and physical composite scores of SF-36 to MusiQoL index prediction on baseline EDSS score matched groups. Additional Figure 1a. Worsened individuals (n=100). Additional Figure 1b. Not-worsened individuals (n=100).</p></caption><media xlink:href="1471-2288-13-20-S2.pptx"><caption><p>Click here for file</p></caption></media></supplementary-material><supplementary-material content-type="local-data" id="S3"><caption><title>Additional file 3: Figure S2</title><p>Average of variable importance of dimensions of SF-36 to MusiQoL index prediction on baseline EDSS score matched groups. Additional Figure 2a. Worsened individuals (n=100). Additional Figure 2b. Not-worsened individuals (n=100).</p></caption><media xlink:href="1471-2288-13-20-S3.pptx"><caption><p>Click here for file</p></caption></media></supplementary-material></sec></body><back><sec><title>Acknowledgements</title><p>The authors are grateful to all the patients and investigators for their participation in the study.</p><p>This study was supported by institutional grants from the French 2009 Institut de Recherche en Santé Publique (CUD-QV, Concepts, Usages et Déterminants en Qualité de Vie), and by Merck Serono S.A. – Geneva, Switzerland (a branch of Merck Serono S.A., Coinsins, Switzerland, an affiliate of Merck KGaA, Darmstadt, Germany). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The authors retained full control over the content of the manuscript.</p></sec><ref-list><ref id="B1"><mixed-citation publication-type="journal"><name><surname>Mitchell</surname><given-names>AJ</given-names></name><name><surname>Benito-Leon</surname><given-names>J</given-names></name><name><surname>Gonzalez</surname><given-names>JM</given-names></name><name><surname>Rivera-Navarro</surname><given-names>J</given-names></name><article-title>Quality of life and its assessment in multiple sclerosis: integrating physical and psychological components of wellbeing</article-title><source>Lancet Neurol</source><year>2005</year><volume>4</volume><issue>9</issue><fpage>556</fpage><lpage>566</lpage><pub-id pub-id-type="doi">10.1016/S1474-4422(05)70166-6</pub-id><pub-id pub-id-type="pmid">16109362</pub-id></mixed-citation></ref><ref id="B2"><mixed-citation publication-type="journal"><name><surname>Solari</surname><given-names>A</given-names></name><article-title>Role of health-related quality of life measures in the routine care of people with multiple sclerosis</article-title><source>Health Qual Life Outcomes</source><year>2005</year><volume>3</volume><fpage>16</fpage><pub-id pub-id-type="doi">10.1186/1477-7525-3-16</pub-id><pub-id pub-id-type="pmid">15777478</pub-id></mixed-citation></ref><ref id="B3"><mixed-citation publication-type="journal"><name><surname>Miller</surname><given-names>DM</given-names></name><name><surname>Allen</surname><given-names>R</given-names></name><article-title>Quality of life in multiple sclerosis: determinants, measurement, and use in clinical practice</article-title><source>Curr Neurol Neurosci Rep</source><year>2010</year><volume>10</volume><issue>5</issue><fpage>397</fpage><lpage>406</lpage><pub-id pub-id-type="doi">10.1007/s11910-010-0132-4</pub-id><pub-id pub-id-type="pmid">20628835</pub-id></mixed-citation></ref><ref id="B4"><mixed-citation publication-type="journal"><name><surname>Rudick</surname><given-names>RA</given-names></name><name><surname>Miller</surname><given-names>DM</given-names></name><article-title>Health-related quality of life in multiple sclerosis: current evidence, measurement and effects of disease severity and treatment</article-title><source>CNS Drugs</source><year>2008</year><volume>22</volume><issue>10</issue><fpage>827</fpage><lpage>839</lpage><pub-id pub-id-type="doi">10.2165/00023210-200822100-00004</pub-id><pub-id pub-id-type="pmid">18788835</pub-id></mixed-citation></ref><ref id="B5"><mixed-citation publication-type="journal"><name><surname>Sprangers</surname><given-names>MA</given-names></name><name><surname>Schwartz</surname><given-names>CE</given-names></name><article-title>Integrating response shift into health-related quality of life research: a theoretical model</article-title><source>Soc Sci Med</source><year>1999</year><volume>48</volume><issue>11</issue><fpage>1507</fpage><lpage>1515</lpage><pub-id pub-id-type="doi">10.1016/S0277-9536(99)00045-3</pub-id><pub-id pub-id-type="pmid">10400253</pub-id></mixed-citation></ref><ref id="B6"><mixed-citation publication-type="journal"><name><surname>Schwartz</surname><given-names>CE</given-names></name><name><surname>Sprangers</surname><given-names>MA</given-names></name><article-title>Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research</article-title><source>Soc Sci Med</source><year>1999</year><volume>48</volume><issue>11</issue><fpage>1531</fpage><lpage>1548</lpage><pub-id pub-id-type="doi">10.1016/S0277-9536(99)00047-7</pub-id><pub-id pub-id-type="pmid">10400255</pub-id></mixed-citation></ref><ref id="B7"><mixed-citation publication-type="journal"><name><surname>King-Kallimanis</surname><given-names>BL</given-names></name><name><surname>Oort</surname><given-names>FJ</given-names></name><name><surname>Nolte</surname><given-names>S</given-names></name><name><surname>Schwartz</surname><given-names>CE</given-names></name><name><surname>Sprangers</surname><given-names>MA</given-names></name><article-title>Using structural equation modeling to detect response shift in performance and health-related quality of life scores of multiple sclerosis patients</article-title><source>Qual Life Res</source><year>2011</year><volume>20</volume><issue>10</issue><fpage>1527</fpage><lpage>1540</lpage><pub-id pub-id-type="doi">10.1007/s11136-010-9844-9</pub-id><pub-id pub-id-type="pmid">21246289</pub-id></mixed-citation></ref><ref id="B8"><mixed-citation publication-type="journal"><name><surname>Ahmed</surname><given-names>S</given-names></name><name><surname>Mayo</surname><given-names>N</given-names></name><name><surname>Scott</surname><given-names>S</given-names></name><name><surname>Kuspinar</surname><given-names>A</given-names></name><name><surname>Schwartz</surname><given-names>C</given-names></name><article-title>Using latent trajectory analysis of residuals to detect response shift in general health among patients with multiple sclerosis</article-title><source>Qual Life Res</source><year>2011</year><volume>20</volume><issue>10</issue><fpage>1555</fpage><lpage>1560</lpage><pub-id pub-id-type="doi">10.1007/s11136-011-0005-6</pub-id><pub-id pub-id-type="pmid">22016049</pub-id></mixed-citation></ref><ref id="B9"><mixed-citation publication-type="journal"><name><surname>Li</surname><given-names>Y</given-names></name><name><surname>Schwartz</surname><given-names>CE</given-names></name><article-title>Data mining for response shift patterns in multiple sclerosis patients using recursive partitioning tree analysis</article-title><source>Qual Life Res</source><year>2011</year><volume>20</volume><issue>10</issue><fpage>1543</fpage><lpage>1553</lpage><pub-id pub-id-type="doi">10.1007/s11136-011-0004-7</pub-id><pub-id pub-id-type="pmid">21909992</pub-id></mixed-citation></ref><ref id="B10"><mixed-citation publication-type="journal"><name><surname>Schwartz</surname><given-names>CE</given-names></name><name><surname>Sprangers</surname><given-names>MA</given-names></name><name><surname>Oort</surname><given-names>F</given-names></name><name><surname>Ahmed</surname><given-names>S</given-names></name><name><surname>Bode</surname><given-names>R</given-names></name><name><surname>Li</surname><given-names>Y</given-names></name><name><surname>Vollmer</surname><given-names>T</given-names></name><article-title>Response shift in patients with multiple sclerosis: an application of three statistical techniques</article-title><source>Qual Life Res</source><year>2011</year><volume>20</volume><issue>10</issue><fpage>1561</fpage><lpage>1572</lpage><pub-id pub-id-type="doi">10.1007/s11136-011-0056-8</pub-id><pub-id pub-id-type="pmid">22081216</pub-id></mixed-citation></ref><ref id="B11"><mixed-citation publication-type="journal"><name><surname>Breiman</surname><given-names>L</given-names></name><article-title>Random Forests</article-title><source>Mach Learn</source><year>2001</year><volume>45</volume><fpage>5</fpage><lpage>32</lpage><pub-id pub-id-type="doi">10.1023/A:1010933404324</pub-id></mixed-citation></ref><ref id="B12"><mixed-citation publication-type="other"><name><surname>Breiman</surname><given-names>L</given-names></name><name><surname>Cutler</surname><given-names>A</given-names></name><collab>Random Forests</collab><comment><ext-link ext-link-type="uri" xlink:href="http://www.math.usu.edu/">http://www.math.usu.edu/</ext-link>~adele/forests (last access Feb 15 2013)</comment></mixed-citation></ref><ref id="B13"><mixed-citation publication-type="journal"><name><surname>Verikas</surname><given-names>A</given-names></name><name><surname>Gelzinis</surname><given-names>A</given-names></name><name><surname>Bacauskiene</surname><given-names>M</given-names></name><article-title>Mining data with random forests: a survey and results of new tests</article-title><source>Pattern Recognition</source><year>2011</year><volume>44</volume><issue>2</issue><fpage>330</fpage><lpage>349</lpage><pub-id pub-id-type="doi">10.1016/j.patcog.2010.08.011</pub-id></mixed-citation></ref><ref id="B14"><mixed-citation publication-type="other"><name><surname>Touw</surname><given-names>WG</given-names></name><name><surname>Bayjanov</surname><given-names>JR</given-names></name><name><surname>Overmars</surname><given-names>L</given-names></name><name><surname>Backus</surname><given-names>L</given-names></name><name><surname>Boekhorst</surname><given-names>J</given-names></name><name><surname>Wels</surname><given-names>M</given-names></name><name><surname>van Hijum</surname><given-names>SA</given-names></name><article-title>Data mining in the Life Sciences with Random Forest: a walk in the park or lost in the jungle?</article-title><source>Brief Bioinform</source><year>2012</year><pub-id pub-id-type="doi">10.1093/bib/bbs034</pub-id></mixed-citation></ref><ref id="B15"><mixed-citation publication-type="journal"><name><surname>Chen</surname><given-names>X</given-names></name><name><surname>Ishwaran</surname><given-names>H</given-names></name><article-title>Random forests for genomic data analysis</article-title><source>Genomics</source><year>2012</year><volume>99</volume><issue>6</issue><fpage>323</fpage><lpage>329</lpage><pub-id pub-id-type="doi">10.1016/j.ygeno.2012.04.003</pub-id><pub-id pub-id-type="pmid">22546560</pub-id></mixed-citation></ref><ref id="B16"><mixed-citation publication-type="journal"><name><surname>Goldstein</surname><given-names>BA</given-names></name><name><surname>Polley</surname><given-names>EC</given-names></name><name><surname>Briggs</surname><given-names>FBS</given-names></name><article-title>Random forests for genetic association studies</article-title><source>Stat Appl Genet Mol Biol</source><year>2011</year><volume>10</volume><fpage>1</fpage><lpage>34</lpage></mixed-citation></ref><ref id="B17"><mixed-citation publication-type="book"><name><surname>Flachenecker</surname><given-names>P</given-names></name><name><surname>Baumstarck-Barrau</surname><given-names>K</given-names></name><name><surname>Butzkueven</surname><given-names>H</given-names></name><name><surname>Fernández</surname><given-names>O</given-names></name><name><surname>Idiman</surname><given-names>E</given-names></name><name><surname>Pelletier</surname><given-names>J</given-names></name><name><surname>Stecchi</surname><given-names>S</given-names></name><name><surname>Verdun di Cantogno</surname><given-names>E</given-names></name><name><surname>Milner</surname><given-names>A</given-names></name><name><surname>Auquier</surname><given-names>P</given-names></name><article-title>and the MusiQoL Responsiveness study group. MusiQoL responsiveness exploratory analyses</article-title><source>5th Joint Triennial Congress of the European and Americas Committees for Treatment and Research in Multiple Sclerosis (ECTRIMS/ACTRIMS)</source><year>2011</year><publisher-name>Amsterdam, The Netherlands: </publisher-name></mixed-citation></ref><ref id="B18"><mixed-citation publication-type="journal"><name><surname>McDonald</surname><given-names>WI</given-names></name><name><surname>Compston</surname><given-names>A</given-names></name><name><surname>Edan</surname><given-names>G</given-names></name><name><surname>Goodkin</surname><given-names>D</given-names></name><name><surname>Hartung</surname><given-names>HP</given-names></name><name><surname>Lublin</surname><given-names>FD</given-names></name><name><surname>McFarland</surname><given-names>HF</given-names></name><name><surname>Paty</surname><given-names>DW</given-names></name><name><surname>Polman</surname><given-names>CH</given-names></name><name><surname>Reingold</surname><given-names>SC</given-names></name><article-title>Recommended diagnostic criteria for multiple sclerosis: guidelines from the International Panel on the diagnosis of multiple sclerosis</article-title><source>Ann Neurol</source><year>2001</year><volume>50</volume><issue>1</issue><fpage>121</fpage><lpage>127</lpage><pub-id pub-id-type="doi">10.1002/ana.1032</pub-id><pub-id pub-id-type="pmid">11456302</pub-id></mixed-citation></ref><ref id="B19"><mixed-citation publication-type="journal"><name><surname>Polman</surname><given-names>CH</given-names></name><name><surname>Wolinsky</surname><given-names>JS</given-names></name><name><surname>Reingold</surname><given-names>SC</given-names></name><article-title>Multiple sclerosis diagnostic criteria: three years later</article-title><source>Mult Scler</source><year>2005</year><volume>11</volume><issue>1</issue><fpage>5</fpage><lpage>12</lpage><pub-id pub-id-type="doi">10.1191/1352458505ms1135oa</pub-id><pub-id pub-id-type="pmid">15732260</pub-id></mixed-citation></ref><ref id="B20"><mixed-citation publication-type="journal"><name><surname>Kurtzke</surname><given-names>JF</given-names></name><article-title>Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS)</article-title><source>Neurology</source><year>1983</year><volume>33</volume><issue>11</issue><fpage>1444</fpage><lpage>1452</lpage><pub-id pub-id-type="doi">10.1212/WNL.33.11.1444</pub-id><pub-id pub-id-type="pmid">6685237</pub-id></mixed-citation></ref><ref id="B21"><mixed-citation publication-type="journal"><name><surname>Simeoni</surname><given-names>M</given-names></name><name><surname>Auquier</surname><given-names>P</given-names></name><name><surname>Fernandez</surname><given-names>O</given-names></name><name><surname>Flachenecker</surname><given-names>P</given-names></name><name><surname>Stecchi</surname><given-names>S</given-names></name><name><surname>Constantinescu</surname><given-names>C</given-names></name><name><surname>Idiman</surname><given-names>E</given-names></name><name><surname>Boyko</surname><given-names>A</given-names></name><name><surname>Beiske</surname><given-names>A</given-names></name><name><surname>Vollmer</surname><given-names>T</given-names></name><article-title>Validation of the Multiple Sclerosis International Quality of Life questionnaire</article-title><source>Mult Scler</source><year>2008</year><volume>14</volume><issue>2</issue><fpage>219</fpage><lpage>230</lpage><pub-id pub-id-type="pmid">17942521</pub-id></mixed-citation></ref><ref id="B22"><mixed-citation publication-type="journal"><name><surname>Ware</surname><given-names>JE</given-names><suffix>Jr</suffix></name><name><surname>Sherbourne</surname><given-names>CD</given-names></name><article-title>The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection</article-title><source>Med Care</source><year>1992</year><volume>30</volume><issue>6</issue><fpage>473</fpage><lpage>483</lpage><pub-id pub-id-type="doi">10.1097/00005650-199206000-00002</pub-id><pub-id pub-id-type="pmid">1593914</pub-id></mixed-citation></ref><ref id="B23"><mixed-citation publication-type="journal"><name><surname>Amato</surname><given-names>MP</given-names></name><name><surname>Grimaud</surname><given-names>J</given-names></name><name><surname>Achiti</surname><given-names>I</given-names></name><name><surname>Bartolozzi</surname><given-names>ML</given-names></name><name><surname>Adeleine</surname><given-names>P</given-names></name><name><surname>Hartung</surname><given-names>HP</given-names></name><name><surname>Kappos</surname><given-names>L</given-names></name><name><surname>Thompson</surname><given-names>A</given-names></name><name><surname>Trojano</surname><given-names>M</given-names></name><name><surname>Vukusic</surname><given-names>S</given-names></name><article-title>European validation of a standardized clinical description of multiple sclerosis</article-title><source>J Neurol</source><year>2004</year><volume>251</volume><issue>12</issue><fpage>1472</fpage><lpage>1480</lpage><pub-id pub-id-type="doi">10.1007/s00415-004-0567-0</pub-id><pub-id pub-id-type="pmid">15645346</pub-id></mixed-citation></ref><ref id="B24"><mixed-citation publication-type="journal"><name><surname>Goodkin</surname><given-names>DE</given-names></name><article-title>EDSS reliability</article-title><source>Neurology</source><year>1991</year><volume>41</volume><issue>(2 Pt 1)</issue><fpage>332</fpage><pub-id pub-id-type="pmid">1992392</pub-id></mixed-citation></ref><ref id="B25"><mixed-citation publication-type="book"><name><surname>Breiman</surname><given-names>L</given-names></name><name><surname>Friedman</surname><given-names>JH</given-names></name><name><surname>Olshen</surname><given-names>RA</given-names></name><name><surname>Stone</surname><given-names>CJ</given-names></name><source>Classification and regression trees</source><year>1984</year><publisher-name>Monterey,USA: Wadsworth, Inc</publisher-name></mixed-citation></ref><ref id="B26"><mixed-citation publication-type="journal"><name><surname>Dempster</surname><given-names>M</given-names></name><name><surname>Carney</surname><given-names>R</given-names></name><name><surname>McClements</surname><given-names>R</given-names></name><article-title>Response shift in the assessment of quality of life among people attending cardiac rehabilitation</article-title><source>Br J Health Psychol</source><year>2010</year><volume>15</volume><issue>Pt 2</issue><fpage>307</fpage><lpage>319</lpage><pub-id pub-id-type="pmid">19594987</pub-id></mixed-citation></ref><ref id="B27"><mixed-citation publication-type="journal"><name><surname>Ring</surname><given-names>L</given-names></name><name><surname>Hofer</surname><given-names>S</given-names></name><name><surname>Heuston</surname><given-names>F</given-names></name><name><surname>Harris</surname><given-names>D</given-names></name><name><surname>O'Boyle</surname><given-names>CA</given-names></name><article-title>Response shift masks the treatment impact on patient reported outcomes (PROs): the example of individual quality of life in edentulous patients</article-title><source>Health Qual Life Outcomes</source><year>2005</year><volume>3</volume><fpage>55</fpage><pub-id pub-id-type="doi">10.1186/1477-7525-3-55</pub-id><pub-id pub-id-type="pmid">16146573</pub-id></mixed-citation></ref><ref id="B28"><mixed-citation publication-type="journal"><name><surname>Fernandez</surname><given-names>O</given-names></name><name><surname>Baumstarck-Barrau</surname><given-names>K</given-names></name><name><surname>Simeoni</surname><given-names>MC</given-names></name><name><surname>Auquier</surname><given-names>P</given-names></name><article-title>Patient characteristics and determinants of quality of life in an international population with multiple sclerosis: Assessment using the MusiQoL and SF-36 questionnaires</article-title><source>Mult Scler</source><year>2011</year><volume>17</volume><issue>10</issue><fpage>1238</fpage><lpage>1249</lpage><pub-id pub-id-type="doi">10.1177/1352458511407951</pub-id><pub-id pub-id-type="pmid">21669936</pub-id></mixed-citation></ref><ref id="B29"><mixed-citation publication-type="journal"><name><surname>Norman</surname><given-names>G</given-names></name><article-title>Hi! How are you? Response shift, implicit theories and differing epistemologies</article-title><source>Qual Life Res</source><year>2003</year><volume>12</volume><issue>3</issue><fpage>239</fpage><lpage>249</lpage><pub-id pub-id-type="doi">10.1023/A:1023211129926</pub-id><pub-id pub-id-type="pmid">12769136</pub-id></mixed-citation></ref><ref id="B30"><mixed-citation publication-type="journal"><name><surname>Oort</surname><given-names>FJ</given-names></name><article-title>Using structural equation modeling to detect response shifts and true change</article-title><source>Qual Life Res</source><year>2005</year><volume>14</volume><issue>3</issue><fpage>587</fpage><lpage>598</lpage><pub-id pub-id-type="doi">10.1007/s11136-004-0830-y</pub-id><pub-id pub-id-type="pmid">16022054</pub-id></mixed-citation></ref><ref id="B31"><mixed-citation publication-type="journal"><name><surname>Oort</surname><given-names>FJ</given-names></name><name><surname>Visser</surname><given-names>MR</given-names></name><name><surname>Sprangers</surname><given-names>MA</given-names></name><article-title>An application of structural equation modeling to detect response shifts and true change in quality of life data from cancer patients undergoing invasive surgery</article-title><source>Qual Life Res</source><year>2005</year><volume>14</volume><issue>3</issue><fpage>599</fpage><lpage>609</lpage><pub-id pub-id-type="doi">10.1007/s11136-004-0831-x</pub-id><pub-id pub-id-type="pmid">16022055</pub-id></mixed-citation></ref><ref id="B32"><mixed-citation publication-type="journal"><name><surname>Li</surname><given-names>Y</given-names></name><name><surname>Rapkin</surname><given-names>B</given-names></name><article-title>Classification and regression tree uncovered hierarchy of psychosocial determinants underlying quality-of-life response shift in HIV/AIDS</article-title><source>J Clin Epidemiol</source><year>2009</year><volume>62</volume><issue>11</issue><fpage>1138</fpage><lpage>1147</lpage><pub-id pub-id-type="doi">10.1016/j.jclinepi.2009.03.021</pub-id><pub-id pub-id-type="pmid">19595576</pub-id></mixed-citation></ref><ref id="B33"><mixed-citation publication-type="journal"><name><surname>Mayo</surname><given-names>NE</given-names></name><name><surname>Scott</surname><given-names>SC</given-names></name><name><surname>Dendukuri</surname><given-names>N</given-names></name><name><surname>Ahmed</surname><given-names>S</given-names></name><name><surname>Wood-Dauphinee</surname><given-names>S</given-names></name><article-title>Identifying response shift statistically at the individual level</article-title><source>Qual Life Res</source><year>2008</year><volume>17</volume><issue>4</issue><fpage>627</fpage><lpage>639</lpage><pub-id pub-id-type="doi">10.1007/s11136-008-9329-2</pub-id><pub-id pub-id-type="pmid">18386161</pub-id></mixed-citation></ref><ref id="B34"><mixed-citation publication-type="journal"><name><surname>Lunetta</surname><given-names>KL</given-names></name><name><surname>Hayward</surname><given-names>LB</given-names></name><name><surname>Segal</surname><given-names>J</given-names></name><name><surname>Van Eerdewegh</surname><given-names>P</given-names></name><article-title>Screening large-scale association study data: exploiting interactions using random forests</article-title><source>BMC Genet</source><year>2004</year><volume>5</volume><issue>1</issue><fpage>32</fpage><pub-id pub-id-type="doi">10.1186/1471-2156-5-32</pub-id><pub-id pub-id-type="pmid">15588316</pub-id></mixed-citation></ref><ref id="B35"><mixed-citation publication-type="other"><collab>The R Development Core Team</collab><source>R: A Language and Environment for Statistical Computing Version 2.11.1 (2010-05-31) Reference Index</source><year>2012</year><comment><ext-link ext-link-type="uri" xlink:href="http://www.lsw.uni-heidelberg.de/users/christlieb/teaching/UKStaSS10/R-refman.pdf">http://www.lsw.uni-heidelberg.de/users/christlieb/teaching/UKStaSS10/R-refman.pdf</ext-link></comment></mixed-citation></ref><ref id="B36"><mixed-citation publication-type="journal"><name><surname>Liaw</surname><given-names>A</given-names></name><name><surname>Wiener</surname><given-names>M</given-names></name><article-title>Classification and regression by random Forest</article-title><source>R News</source><year>2002</year><volume>2</volume><fpage>18</fpage><lpage>22</lpage></mixed-citation></ref><ref id="B37"><mixed-citation publication-type="journal"><name><surname>Boyer</surname><given-names>L</given-names></name><name><surname>Auquier</surname><given-names>P</given-names></name><article-title>The lack of impact of quality-of-life measures in schizophrenia: a shared responsibility?</article-title><source>PharmacoEconomics</source><year>2012</year><volume>30</volume><issue>6</issue><fpage>531</fpage><lpage>532</lpage><comment>author reply 532–533</comment><pub-id pub-id-type="doi">10.2165/11633640-000000000-00000</pub-id><pub-id pub-id-type="pmid">22551037</pub-id></mixed-citation></ref><ref id="B38"><mixed-citation publication-type="journal"><name><surname>Awad</surname><given-names>AG</given-names></name><article-title>Quality-of-life assessment in schizophrenia: the unfulfilled promise</article-title><source>Expert Rev Pharmacoecon Outcomes Res</source><year>2011</year><volume>11</volume><issue>5</issue><fpage>491</fpage><lpage>493</lpage><pub-id pub-id-type="doi">10.1586/erp.11.61</pub-id><pub-id pub-id-type="pmid">21958091</pub-id></mixed-citation></ref><ref id="B39"><mixed-citation publication-type="journal"><name><surname>Schwartz</surname><given-names>CE</given-names></name><name><surname>Rapkin</surname><given-names>BD</given-names></name><article-title>Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal</article-title><source>Health Qual Life Outcomes</source><year>2004</year><volume>2</volume><fpage>16</fpage><pub-id pub-id-type="doi">10.1186/1477-7525-2-16</pub-id><pub-id pub-id-type="pmid">15038830</pub-id></mixed-citation></ref><ref id="B40"><mixed-citation publication-type="journal"><name><surname>Rapkin</surname><given-names>BD</given-names></name><name><surname>Schwartz</surname><given-names>CE</given-names></name><article-title>Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift</article-title><source>Health Qual Life Outcomes</source><year>2004</year><volume>15</volume><issue>2</issue><fpage>14</fpage><pub-id pub-id-type="pmid">15023229</pub-id></mixed-citation></ref></ref-list></back></pmc></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Santé/explor/EdenteV2/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 002168 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 002168 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Santé
|area= EdenteV2
|flux= Pmc
|étape= Corpus
|type= RBID
|clé= PMC:3626785
|texte= Using the random forest method to detect a response shift in the quality of life of multiple sclerosis patients: a cohort study
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/RBID.i -Sk "pubmed:23414459" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd \
| NlmPubMed2Wicri -a EdenteV2
| This area was generated with Dilib version V0.6.32. |  |