Rater Training for a Multi-Site, International Clinical Trial: What Mood Symptoms may be most Difficult to Rate?
Identifieur interne : 001C23 ( Pmc/Corpus ); précédent : 001C22; suivant : 001C24Rater Training for a Multi-Site, International Clinical Trial: What Mood Symptoms may be most Difficult to Rate?
Auteurs : Martha Sajatovic ; Richa Gaur ; Curtis Tatsuoka ; Susan De Santi ; Nathan Lee ; Judith Laredo ; Sulabh TripathiSource :
- Psychopharmacology Bulletin [ 0048-5764 ] ; 2011.
Abstract
Given resource constraints in conducting clinical trials, it is critical that rater training focuses on scale items wherein standardization is most challenging. This analysis examined mood disorder symptom ratings submitted in an online rater training program conducted preparatory to the initiation of a multi-site, international mood disorder treatment trial. Ratings were entered online and analyzed for consistency and variability, and compared to established standards (Gold Consensus Ratings/ GCRs).
Raters participated in web-based rater training on the Hamilton Depression Rating Scale (HAM-D), Montgomery Asberg Rating Scale (MADRS), and Young Mania Rating Scale (YMRS). Training included integration of didactic materials and videos of two bipolar depressed patients interviewed by two U.S. clinicians. Raters viewed the videos and rated the mood scales. Inter-rater agreement was assessed using Kappa statistics. Ratings between the raters and the GCRs for individual scale items were assessed using McNemar test for paired binomial proportions.
194 raters from 16 countries, 80 sites and speaking 20 different languages participated. Interrater agreement on videos ratings ranged from substantial to moderate (HAM-D, Kappa video A = 0.72, video B = 0.65, p < 0.001), (MADRS, Kappa = 0.65 and 0.47, p < 0.001), (YMRS, Kappa = 0.75, and 0.64, p < 0.001). There was no significant difference on agreement based upon on English proficiency, clinical experience, or by country. Scale items that differed from the GCR on the HAM-D were depressed mood, delayed insomnia, retardation, and anxiety (psychic). Items that differed on the MADRS were apparent sadness, inner tension, concentration difficulties, lassitude and inability to feel. Items that differed on the YMRS were irritability and disruptive behavior.
Identification of specific rating scale items in which rater variability is greatest may facilitate training approaches that target these areas for more efficient training in international clinical trials.
Url:
PubMed: 27738359
PubMed Central: 5044548
Links to Exploration step
PMC:5044548Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Rater Training for a Multi-Site, International Clinical Trial: What Mood Symptoms may be most Difficult to Rate?</title><author><name sortKey="Sajatovic, Martha" sort="Sajatovic, Martha" uniqKey="Sajatovic M" first="Martha" last="Sajatovic">Martha Sajatovic</name></author><author><name sortKey="Gaur, Richa" sort="Gaur, Richa" uniqKey="Gaur R" first="Richa" last="Gaur">Richa Gaur</name></author><author><name sortKey="Tatsuoka, Curtis" sort="Tatsuoka, Curtis" uniqKey="Tatsuoka C" first="Curtis" last="Tatsuoka">Curtis Tatsuoka</name></author><author><name sortKey="De Santi, Susan" sort="De Santi, Susan" uniqKey="De Santi S" first="Susan" last="De Santi">Susan De Santi</name></author><author><name sortKey="Lee, Nathan" sort="Lee, Nathan" uniqKey="Lee N" first="Nathan" last="Lee">Nathan Lee</name></author><author><name sortKey="Laredo, Judith" sort="Laredo, Judith" uniqKey="Laredo J" first="Judith" last="Laredo">Judith Laredo</name></author><author><name sortKey="Tripathi, Sulabh" sort="Tripathi, Sulabh" uniqKey="Tripathi S" first="Sulabh" last="Tripathi">Sulabh Tripathi</name></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">27738359</idno><idno type="pmc">5044548</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5044548</idno><idno type="RBID">PMC:5044548</idno><date when="2011">2011</date><idno type="wicri:Area/Pmc/Corpus">001C23</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Corpus" wicri:corpus="PMC">001C23</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Rater Training for a Multi-Site, International Clinical Trial: What Mood Symptoms may be most Difficult to Rate?</title><author><name sortKey="Sajatovic, Martha" sort="Sajatovic, Martha" uniqKey="Sajatovic M" first="Martha" last="Sajatovic">Martha Sajatovic</name></author><author><name sortKey="Gaur, Richa" sort="Gaur, Richa" uniqKey="Gaur R" first="Richa" last="Gaur">Richa Gaur</name></author><author><name sortKey="Tatsuoka, Curtis" sort="Tatsuoka, Curtis" uniqKey="Tatsuoka C" first="Curtis" last="Tatsuoka">Curtis Tatsuoka</name></author><author><name sortKey="De Santi, Susan" sort="De Santi, Susan" uniqKey="De Santi S" first="Susan" last="De Santi">Susan De Santi</name></author><author><name sortKey="Lee, Nathan" sort="Lee, Nathan" uniqKey="Lee N" first="Nathan" last="Lee">Nathan Lee</name></author><author><name sortKey="Laredo, Judith" sort="Laredo, Judith" uniqKey="Laredo J" first="Judith" last="Laredo">Judith Laredo</name></author><author><name sortKey="Tripathi, Sulabh" sort="Tripathi, Sulabh" uniqKey="Tripathi S" first="Sulabh" last="Tripathi">Sulabh Tripathi</name></author></analytic><series><title level="j">Psychopharmacology Bulletin</title><idno type="ISSN">0048-5764</idno><idno type="eISSN">2472-2448</idno><imprint><date when="2011">2011</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><sec id="S1"><title>Aims</title><p id="P1">Given resource constraints in conducting clinical trials, it is critical that rater training focuses on scale items wherein standardization is most challenging. This analysis examined mood disorder symptom ratings submitted in an online rater training program conducted preparatory to the initiation of a multi-site, international mood disorder treatment trial. Ratings were entered online and analyzed for consistency and variability, and compared to established standards (Gold Consensus Ratings/ GCRs).</p></sec><sec id="S2"><title>Methods</title><p id="P2">Raters participated in web-based rater training on the Hamilton Depression Rating Scale (HAM-D), Montgomery Asberg Rating Scale (MADRS), and Young Mania Rating Scale (YMRS). Training included integration of didactic materials and videos of two bipolar depressed patients interviewed by two U.S. clinicians. Raters viewed the videos and rated the mood scales. Inter-rater agreement was assessed using Kappa statistics. Ratings between the raters and the GCRs for individual scale items were assessed using McNemar test for paired binomial proportions.</p></sec><sec id="S3"><title>Results</title><p id="P3">194 raters from 16 countries, 80 sites and speaking 20 different languages participated. Interrater agreement on videos ratings ranged from substantial to moderate (HAM-D, Kappa video A = 0.72, video B = 0.65, p < 0.001), (MADRS, Kappa = 0.65 and 0.47, p < 0.001), (YMRS, Kappa = 0.75, and 0.64, p < 0.001). There was no significant difference on agreement based upon on English proficiency, clinical experience, or by country. Scale items that differed from the GCR on the HAM-D were depressed mood, delayed insomnia, retardation, and anxiety (psychic). Items that differed on the MADRS were apparent sadness, inner tension, concentration difficulties, lassitude and inability to feel. Items that differed on the YMRS were irritability and disruptive behavior.</p></sec><sec id="S4"><title>Conclusions</title><p id="P4">Identification of specific rating scale items in which rater variability is greatest may facilitate training approaches that target these areas for more efficient training in international clinical trials.</p></sec></div></front></TEI><pmc article-type="research-article"><pmc-comment>The publisher of this article does not allow downloading of the full text in XML form.</pmc-comment>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Psychopharmacol Bull</journal-id><journal-id journal-id-type="iso-abbrev">Psychopharmacol Bull</journal-id><journal-title-group><journal-title>Psychopharmacology Bulletin</journal-title></journal-title-group><issn pub-type="ppub">0048-5764</issn><issn pub-type="epub">2472-2448</issn><publisher><publisher-name>MedWorks Media Global</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">27738359</article-id><article-id pub-id-type="pmc">5044548</article-id><article-id pub-id-type="publisher-manuscript">PB-44-3-5</article-id><article-categories><subj-group subj-group-type="heading"><subject>Original Research</subject></subj-group></article-categories><title-group><article-title>Rater Training for a Multi-Site, International Clinical Trial: What Mood Symptoms may be most Difficult to Rate?</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Sajatovic</surname><given-names>Martha</given-names></name></contrib><contrib contrib-type="author"><name><surname>Gaur</surname><given-names>Richa</given-names></name></contrib><contrib contrib-type="author"><name><surname>Tatsuoka</surname><given-names>Curtis</given-names></name></contrib><contrib contrib-type="author"><name><surname>De Santi</surname><given-names>Susan</given-names></name></contrib><contrib contrib-type="author"><name><surname>Lee</surname><given-names>Nathan</given-names></name></contrib><contrib contrib-type="author"><name><surname>Laredo</surname><given-names>Judith</given-names></name></contrib><contrib contrib-type="author"><name><surname>Tripathi</surname><given-names>Sulabh</given-names></name></contrib><aff>Dr. Sajatovic, MD, Department of Psychiatry and of Neurology, Case Western Reserve University School of Medicine, Cleveland, OH. Dr. Gaur, PhD, Associate Director, Rater Training Services, PharmaNet/i3, Sydney, Australia. Dr. Tatsuoka, PhD, Department of Neurology, Case Western Reserve University School of Medicine, Cleveland, OH. Dr. De Santi, PhD, Department of Psychiatry, NYU Langone Medical Center, New York, NY, Global Medical Director, PET at G.E. Healthcare, Princeton, NJ. Mr. Lee, MSc, Director of Strategic Operations, The Cognition Group, London, UK. Dr. Laredo, PhD, Head of Department, Institut de Recherches Servier (IRIS), Suresnes, France. Dr. Tripathi, BDS, PGDHHM, PMP- Project Manager, The Cognition Group, New Delhi, India</aff></contrib-group><author-notes><corresp id="FN1">To whom correspondence should be addressed: Dr. Martha Sajatovic, MD, Department of Psychiatry, University Hospitals Case Medical Center, 10524 Euclid Avenue, Cleveland, OH 44106. Phone: 216-844-2808; Fax: 216-844-2742; E-mail: <email xlink:href="mailto:martha.sajatovic@uhhospitals.org">martha.sajatovic@uhhospitals.org</email></corresp></author-notes><pub-date pub-type="ppub"><day>15</day><month>9</month><year>2011</year></pub-date><volume>44</volume><issue>3</issue><fpage>5</fpage><lpage>14</lpage><permissions><copyright-statement>Copyright © by MedWorks MediaGlobal, LLC., Los Angeles, CA All rights reserved. Printed in the United States.</copyright-statement><copyright-year>2011</copyright-year></permissions><abstract><sec id="S1"><title>Aims</title><p id="P1">Given resource constraints in conducting clinical trials, it is critical that rater training focuses on scale items wherein standardization is most challenging. This analysis examined mood disorder symptom ratings submitted in an online rater training program conducted preparatory to the initiation of a multi-site, international mood disorder treatment trial. Ratings were entered online and analyzed for consistency and variability, and compared to established standards (Gold Consensus Ratings/ GCRs).</p></sec><sec id="S2"><title>Methods</title><p id="P2">Raters participated in web-based rater training on the Hamilton Depression Rating Scale (HAM-D), Montgomery Asberg Rating Scale (MADRS), and Young Mania Rating Scale (YMRS). Training included integration of didactic materials and videos of two bipolar depressed patients interviewed by two U.S. clinicians. Raters viewed the videos and rated the mood scales. Inter-rater agreement was assessed using Kappa statistics. Ratings between the raters and the GCRs for individual scale items were assessed using McNemar test for paired binomial proportions.</p></sec><sec id="S3"><title>Results</title><p id="P3">194 raters from 16 countries, 80 sites and speaking 20 different languages participated. Interrater agreement on videos ratings ranged from substantial to moderate (HAM-D, Kappa video A = 0.72, video B = 0.65, p < 0.001), (MADRS, Kappa = 0.65 and 0.47, p < 0.001), (YMRS, Kappa = 0.75, and 0.64, p < 0.001). There was no significant difference on agreement based upon on English proficiency, clinical experience, or by country. Scale items that differed from the GCR on the HAM-D were depressed mood, delayed insomnia, retardation, and anxiety (psychic). Items that differed on the MADRS were apparent sadness, inner tension, concentration difficulties, lassitude and inability to feel. Items that differed on the YMRS were irritability and disruptive behavior.</p></sec><sec id="S4"><title>Conclusions</title><p id="P4">Identification of specific rating scale items in which rater variability is greatest may facilitate training approaches that target these areas for more efficient training in international clinical trials.</p></sec></abstract><kwd-group><kwd>rating scales</kwd><kwd>clinical trials</kwd><kwd>depression</kwd><kwd>bipolar disorder</kwd></kwd-group></article-meta></front></pmc></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Asie/explor/AustralieFrV1/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 001C23 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 001C23 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Asie
|area= AustralieFrV1
|flux= Pmc
|étape= Corpus
|type= RBID
|clé= PMC:5044548
|texte= Rater Training for a Multi-Site, International Clinical Trial: What Mood Symptoms may be most Difficult to Rate?
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/RBID.i -Sk "pubmed:27738359" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd \
| NlmPubMed2Wicri -a AustralieFrV1
| This area was generated with Dilib version V0.6.33. |  |