Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes
Identifieur interne : 000123 ( Istex/Corpus ); précédent : 000122; suivant : 000124Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes
Auteurs : Lutz Bornmann ; Hermann Schier ; Werner Marx ; Hans-Dieter DanielSource :
- Journal of the American Society for Information Science and Technology [ 1532-2882 ] ; 2011-01.
Abstract
In a comprehensive research project, we investigated the predictive validity of selection decisions and reviewers' ratings at the open access journal Atmospheric Chemistry and Physics (ACP). ACP is a high‐impact journal publishing papers on the Earth's atmosphere and the underlying chemical and physical processes. Scientific journals have to deal with the following question concerning the predictive validity: Are in fact the “best” scientific works selected from the manuscripts submitted? In this study we examined whether selecting the “best” manuscripts means selecting papers that after publication show top citation performance as compared to other papers in this research area. First, we appraised the citation impact of later published manuscripts based on the percentile citedness rank classes of the population distribution (scaling in a specific subfield). Second, we analyzed the association between the decisions (n = 677 accepted or rejected, but published elsewhere manuscripts) or ratings (reviewers' ratings for n = 315 manuscripts), respectively, and the citation impact classes of the manuscripts. The results confirm the predictive validity of the ACP peer review system.
Url:
DOI: 10.1002/asi.21418
Links to Exploration step
ISTEX:D9ECE9818C88B5676665107C8841C4E90F0936CELe document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes</title><author><name sortKey="Bornmann, Lutz" sort="Bornmann, Lutz" uniqKey="Bornmann L" first="Lutz" last="Bornmann">Lutz Bornmann</name><affiliation><mods:affiliation>Max Planck Society, Office of Research Analysis and Foresight, Hofgartenstr. 8, D‐80539 Munich</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: bornmann@gv.mpg.de</mods:affiliation></affiliation></author><author><name sortKey="Schier, Hermann" sort="Schier, Hermann" uniqKey="Schier H" first="Hermann" last="Schier">Hermann Schier</name><affiliation><mods:affiliation>Max Planck Institute for Solid State Research, Heisenbergstraße 1, D‐70569 Stuttgart, Germany</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: h.schier@fkf.mpg.de</mods:affiliation></affiliation></author><author><name sortKey="Marx, Werner" sort="Marx, Werner" uniqKey="Marx W" first="Werner" last="Marx">Werner Marx</name><affiliation><mods:affiliation>Max Planck Institute for Solid State Research, Heisenbergstraße 1, D‐70569 Stuttgart, Germany</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: w.marx@fkf.mpg.de</mods:affiliation></affiliation></author><author><name sortKey="Daniel, Hans Ieter" sort="Daniel, Hans Ieter" uniqKey="Daniel H" first="Hans-Dieter" last="Daniel">Hans-Dieter Daniel</name><affiliation><mods:affiliation>ETH Zurich, Professorship for Social Psychology and Research on Higher Education, Zähringerstr. 24, CH‐8092 Zurich; University of Zurich, Evaluation Office, Mühlegasse 21, CH‐8001 Zurich, Switzerland</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: daniel@evaluation.uzh.ch</mods:affiliation></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:D9ECE9818C88B5676665107C8841C4E90F0936CE</idno><date when="2011" year="2011">2011</date><idno type="doi">10.1002/asi.21418</idno><idno type="url">https://api.istex.fr/document/D9ECE9818C88B5676665107C8841C4E90F0936CE/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">000123</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes</title><author><name sortKey="Bornmann, Lutz" sort="Bornmann, Lutz" uniqKey="Bornmann L" first="Lutz" last="Bornmann">Lutz Bornmann</name><affiliation><mods:affiliation>Max Planck Society, Office of Research Analysis and Foresight, Hofgartenstr. 8, D‐80539 Munich</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: bornmann@gv.mpg.de</mods:affiliation></affiliation></author><author><name sortKey="Schier, Hermann" sort="Schier, Hermann" uniqKey="Schier H" first="Hermann" last="Schier">Hermann Schier</name><affiliation><mods:affiliation>Max Planck Institute for Solid State Research, Heisenbergstraße 1, D‐70569 Stuttgart, Germany</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: h.schier@fkf.mpg.de</mods:affiliation></affiliation></author><author><name sortKey="Marx, Werner" sort="Marx, Werner" uniqKey="Marx W" first="Werner" last="Marx">Werner Marx</name><affiliation><mods:affiliation>Max Planck Institute for Solid State Research, Heisenbergstraße 1, D‐70569 Stuttgart, Germany</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: w.marx@fkf.mpg.de</mods:affiliation></affiliation></author><author><name sortKey="Daniel, Hans Ieter" sort="Daniel, Hans Ieter" uniqKey="Daniel H" first="Hans-Dieter" last="Daniel">Hans-Dieter Daniel</name><affiliation><mods:affiliation>ETH Zurich, Professorship for Social Psychology and Research on Higher Education, Zähringerstr. 24, CH‐8092 Zurich; University of Zurich, Evaluation Office, Mühlegasse 21, CH‐8001 Zurich, Switzerland</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: daniel@evaluation.uzh.ch</mods:affiliation></affiliation></author></analytic><monogr></monogr><series><title level="j">Journal of the American Society for Information Science and Technology</title><title level="j" type="abbrev">J. Am. Soc. Inf. Sci.</title><idno type="ISSN">1532-2882</idno><idno type="eISSN">1532-2890</idno><imprint><publisher>Wiley Subscription Services, Inc., A Wiley Company</publisher><pubPlace>Hoboken</pubPlace><date type="published" when="2011-01">2011-01</date><biblScope unit="volume">62</biblScope><biblScope unit="issue">1</biblScope><biblScope unit="page" from="61">61</biblScope><biblScope unit="page" to="71">71</biblScope></imprint><idno type="ISSN">1532-2882</idno></series><idno type="istex">D9ECE9818C88B5676665107C8841C4E90F0936CE</idno><idno type="DOI">10.1002/asi.21418</idno><idno type="ArticleID">ASI21418</idno></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">1532-2882</idno></seriesStmt></fileDesc><profileDesc><textClass></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">In a comprehensive research project, we investigated the predictive validity of selection decisions and reviewers' ratings at the open access journal Atmospheric Chemistry and Physics (ACP). ACP is a high‐impact journal publishing papers on the Earth's atmosphere and the underlying chemical and physical processes. Scientific journals have to deal with the following question concerning the predictive validity: Are in fact the “best” scientific works selected from the manuscripts submitted? In this study we examined whether selecting the “best” manuscripts means selecting papers that after publication show top citation performance as compared to other papers in this research area. First, we appraised the citation impact of later published manuscripts based on the percentile citedness rank classes of the population distribution (scaling in a specific subfield). Second, we analyzed the association between the decisions (n = 677 accepted or rejected, but published elsewhere manuscripts) or ratings (reviewers' ratings for n = 315 manuscripts), respectively, and the citation impact classes of the manuscripts. The results confirm the predictive validity of the ACP peer review system.</div></front></TEI><istex><corpusName>wiley</corpusName><author><json:item><name>Lutz Bornmann</name><affiliations><json:string>Max Planck Society, Office of Research Analysis and Foresight, Hofgartenstr. 8, D‐80539 Munich</json:string><json:string>E-mail: bornmann@gv.mpg.de</json:string></affiliations></json:item><json:item><name>Hermann Schier</name><affiliations><json:string>Max Planck Institute for Solid State Research, Heisenbergstraße 1, D‐70569 Stuttgart, Germany</json:string><json:string>E-mail: h.schier@fkf.mpg.de</json:string></affiliations></json:item><json:item><name>Werner Marx</name><affiliations><json:string>Max Planck Institute for Solid State Research, Heisenbergstraße 1, D‐70569 Stuttgart, Germany</json:string><json:string>E-mail: w.marx@fkf.mpg.de</json:string></affiliations></json:item><json:item><name>Hans‐Dieter Daniel</name><affiliations><json:string>ETH Zurich, Professorship for Social Psychology and Research on Higher Education, Zähringerstr. 24, CH‐8092 Zurich; University of Zurich, Evaluation Office, Mühlegasse 21, CH‐8001 Zurich, Switzerland</json:string><json:string>E-mail: daniel@evaluation.uzh.ch</json:string></affiliations></json:item></author><articleId><json:string>ASI21418</json:string></articleId><language><json:string>eng</json:string></language><originalGenre><json:string>article</json:string></originalGenre><abstract>In a comprehensive research project, we investigated the predictive validity of selection decisions and reviewers' ratings at the open access journal Atmospheric Chemistry and Physics (ACP). ACP is a high‐impact journal publishing papers on the Earth's atmosphere and the underlying chemical and physical processes. Scientific journals have to deal with the following question concerning the predictive validity: Are in fact the “best” scientific works selected from the manuscripts submitted? In this study we examined whether selecting the “best” manuscripts means selecting papers that after publication show top citation performance as compared to other papers in this research area. First, we appraised the citation impact of later published manuscripts based on the percentile citedness rank classes of the population distribution (scaling in a specific subfield). Second, we analyzed the association between the decisions (n = 677 accepted or rejected, but published elsewhere manuscripts) or ratings (reviewers' ratings for n = 315 manuscripts), respectively, and the citation impact classes of the manuscripts. The results confirm the predictive validity of the ACP peer review system.</abstract><qualityIndicators><score>7.064</score><pdfVersion>1.3</pdfVersion><pdfPageSize>612 x 792 pts (letter)</pdfPageSize><refBibsNative>true</refBibsNative><keywordCount>0</keywordCount><abstractCharCount>1194</abstractCharCount><pdfWordCount>8229</pdfWordCount><pdfCharCount>52612</pdfCharCount><pdfPageCount>11</pdfPageCount><abstractWordCount>172</abstractWordCount></qualityIndicators><title>Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes</title><genre><json:string>article</json:string></genre><host><volume>62</volume><publisherId><json:string>ASI</json:string></publisherId><pages><total>11</total><last>71</last><first>61</first></pages><issn><json:string>1532-2882</json:string></issn><issue>1</issue><subject><json:item><value>open access publications</value></json:item><json:item><value>refereeing</value></json:item><json:item><value>manuscripts</value></json:item><json:item><value>selection</value></json:item><json:item><value>scientometrics</value></json:item><json:item><value>Research Article</value></json:item></subject><genre><json:string>journal</json:string></genre><language><json:string>unknown</json:string></language><eissn><json:string>1532-2890</json:string></eissn><title>Journal of the American Society for Information Science and Technology</title><doi><json:string>10.1002/(ISSN)1532-2890</json:string></doi></host><publicationDate>2011</publicationDate><copyrightDate>2011</copyrightDate><doi><json:string>10.1002/asi.21418</json:string></doi><id>D9ECE9818C88B5676665107C8841C4E90F0936CE</id><score>0.381097</score><fulltext><json:item><original>true</original><mimetype>application/pdf</mimetype><extension>pdf</extension><uri>https://api.istex.fr/document/D9ECE9818C88B5676665107C8841C4E90F0936CE/fulltext/pdf</uri></json:item><json:item><original>false</original><mimetype>application/zip</mimetype><extension>zip</extension><uri>https://api.istex.fr/document/D9ECE9818C88B5676665107C8841C4E90F0936CE/fulltext/zip</uri></json:item><istex:fulltextTEI uri="https://api.istex.fr/document/D9ECE9818C88B5676665107C8841C4E90F0936CE/fulltext/tei"><teiHeader><fileDesc><titleStmt><title level="a" type="main" xml:lang="en">Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes</title></titleStmt><publicationStmt><authority>ISTEX</authority><publisher>Wiley Subscription Services, Inc., A Wiley Company</publisher><pubPlace>Hoboken</pubPlace><availability><p>© 2010 ASIS&T</p></availability><date>2011</date></publicationStmt><sourceDesc><biblStruct type="inbook"><analytic><title level="a" type="main" xml:lang="en">Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes</title><author xml:id="author-1"><persName><forename type="first">Lutz</forename><surname>Bornmann</surname></persName><email>bornmann@gv.mpg.de</email><affiliation>Max Planck Society, Office of Research Analysis and Foresight, Hofgartenstr. 8, D‐80539 Munich</affiliation></author><author xml:id="author-2"><persName><forename type="first">Hermann</forename><surname>Schier</surname></persName><email>h.schier@fkf.mpg.de</email><affiliation>Max Planck Institute for Solid State Research, Heisenbergstraße 1, D‐70569 Stuttgart, Germany</affiliation></author><author xml:id="author-3"><persName><forename type="first">Werner</forename><surname>Marx</surname></persName><email>w.marx@fkf.mpg.de</email><affiliation>Max Planck Institute for Solid State Research, Heisenbergstraße 1, D‐70569 Stuttgart, Germany</affiliation></author><author xml:id="author-4"><persName><forename type="first">Hans‐Dieter</forename><surname>Daniel</surname></persName><email>daniel@evaluation.uzh.ch</email><affiliation>ETH Zurich, Professorship for Social Psychology and Research on Higher Education, Zähringerstr. 24, CH‐8092 Zurich; University of Zurich, Evaluation Office, Mühlegasse 21, CH‐8001 Zurich, Switzerland</affiliation></author></analytic><monogr><title level="j">Journal of the American Society for Information Science and Technology</title><title level="j" type="abbrev">J. Am. Soc. Inf. Sci.</title><idno type="pISSN">1532-2882</idno><idno type="eISSN">1532-2890</idno><idno type="DOI">10.1002/(ISSN)1532-2890</idno><imprint><publisher>Wiley Subscription Services, Inc., A Wiley Company</publisher><pubPlace>Hoboken</pubPlace><date type="published" when="2011-01"></date><biblScope unit="volume">62</biblScope><biblScope unit="issue">1</biblScope><biblScope unit="page" from="61">61</biblScope><biblScope unit="page" to="71">71</biblScope></imprint></monogr><idno type="istex">D9ECE9818C88B5676665107C8841C4E90F0936CE</idno><idno type="DOI">10.1002/asi.21418</idno><idno type="ArticleID">ASI21418</idno></biblStruct></sourceDesc></fileDesc><profileDesc><creation><date>2011</date></creation><langUsage><language ident="en">en</language></langUsage><abstract xml:lang="en"><p>In a comprehensive research project, we investigated the predictive validity of selection decisions and reviewers' ratings at the open access journal Atmospheric Chemistry and Physics (ACP). ACP is a high‐impact journal publishing papers on the Earth's atmosphere and the underlying chemical and physical processes. Scientific journals have to deal with the following question concerning the predictive validity: Are in fact the “best” scientific works selected from the manuscripts submitted? In this study we examined whether selecting the “best” manuscripts means selecting papers that after publication show top citation performance as compared to other papers in this research area. First, we appraised the citation impact of later published manuscripts based on the percentile citedness rank classes of the population distribution (scaling in a specific subfield). Second, we analyzed the association between the decisions (n = 677 accepted or rejected, but published elsewhere manuscripts) or ratings (reviewers' ratings for n = 315 manuscripts), respectively, and the citation impact classes of the manuscripts. The results confirm the predictive validity of the ACP peer review system.</p></abstract><textClass><keywords scheme="Journal Subject"><list><head>index-terms</head><item><term>open access publications</term></item><item><term>refereeing</term></item><item><term>manuscripts</term></item><item><term>selection</term></item><item><term>scientometrics</term></item></list></keywords></textClass><textClass><keywords scheme="Journal Subject"><list><head>article-category</head><item><term>Research Article</term></item></list></keywords></textClass></profileDesc><revisionDesc><change when="2010-06-15">Received</change><change when="2010-07-09">Registration</change><change when="2011-01">Published</change></revisionDesc></teiHeader></istex:fulltextTEI><json:item><original>false</original><mimetype>text/plain</mimetype><extension>txt</extension><uri>https://api.istex.fr/document/D9ECE9818C88B5676665107C8841C4E90F0936CE/fulltext/txt</uri></json:item></fulltext><metadata><istex:metadataXml wicri:clean="Wiley, elements deleted: body"><istex:xmlDeclaration>version="1.0" encoding="UTF-8" standalone="yes"</istex:xmlDeclaration><istex:document><component version="2.0" type="serialArticle" xml:lang="en"><header><publicationMeta level="product"><publisherInfo><publisherName>Wiley Subscription Services, Inc., A Wiley Company</publisherName><publisherLoc>Hoboken</publisherLoc></publisherInfo><doi registered="yes">10.1002/(ISSN)1532-2890</doi><issn type="print">1532-2882</issn><issn type="electronic">1532-2890</issn><idGroup><id type="product" value="ASI"></id></idGroup><titleGroup><title type="main" xml:lang="en" sort="JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY">Journal of the American Society for Information Science and Technology</title><title type="short">J. Am. Soc. Inf. Sci.</title></titleGroup><selfCitationGroup><citation type="ancestor" xml:id="cit1"><journalTitle>Journal of the American Society for Information Science</journalTitle><accessionId ref="info:x-wiley/issn/00028231">0002-8231</accessionId><accessionId ref="info:x-wiley/issn/10974571">1097-4571</accessionId><pubYear year="2000">2000</pubYear><vol>51</vol><issue>14</issue></citation></selfCitationGroup></publicationMeta><publicationMeta level="part" position="10"><doi origin="wiley" registered="yes">10.1002/asi.v62.1</doi><numberingGroup><numbering type="journalVolume" number="62">62</numbering><numbering type="journalIssue">1</numbering></numberingGroup><coverDate startDate="2011-01">January 2011</coverDate></publicationMeta><publicationMeta level="unit" type="article" position="5" status="forIssue"><doi origin="wiley" registered="yes">10.1002/asi.21418</doi><idGroup><id type="unit" value="ASI21418"></id></idGroup><countGroup><count type="pageTotal" number="11"></count></countGroup><titleGroup><title type="articleCategory">Research Article</title><title type="tocHeading1">Research Articles</title></titleGroup><copyright ownership="publisher">© 2010 ASIS&T</copyright><eventGroup><event type="manuscriptReceived" date="2010-06-15"></event><event type="manuscriptRevised" date="2010-07-09"></event><event type="manuscriptAccepted" date="2010-07-09"></event><event type="xmlConverted" agent="Converter:JWSART34_TO_WML3G version:2.3.27 mode:FullText mathml2tex" date="2010-12-07"></event><event type="publishedOnlineEarlyUnpaginated" date="2010-10-06"></event><event type="firstOnline" date="2010-10-06"></event><event type="publishedOnlineFinalForm" date="2010-12-07"></event><event type="xmlConverted" agent="Converter:WILEY_ML3G_TO_WILEY_ML3GV2 version:3.8.8" date="2014-01-06"></event><event type="xmlConverted" agent="Converter:WML3G_To_WML3G version:4.1.7 mode:FullText,remove_FC" date="2014-10-30"></event></eventGroup><numberingGroup><numbering type="pageFirst">61</numbering><numbering type="pageLast">71</numbering></numberingGroup><subjectInfo><subject href="psi.asis.org/digital/open+access+publications">open access publications</subject><subject href="psi.asis.org/digital/refereeing">refereeing</subject><subject href="psi.asis.org/digital/manuscripts">manuscripts</subject><subject href="psi.asis.org/digital/selection">selection</subject><subject href="psi.asis.org/digital/scientometrics">scientometrics</subject></subjectInfo><linkGroup><link type="toTypesetVersion" href="file:ASI.ASI21418.pdf"></link></linkGroup></publicationMeta><contentMeta><countGroup><count type="figureTotal" number="0"></count><count type="tableTotal" number="3"></count><count type="referenceTotal" number="74"></count></countGroup><titleGroup><title type="main" xml:lang="en">Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of <i>Atmospheric Chemistry and Physics</i> by using percentile rank classes</title></titleGroup><creators><creator xml:id="au1" creatorRole="author" affiliationRef="#af1"><personName><givenNames>Lutz</givenNames><familyName>Bornmann</familyName></personName><contactDetails><email>bornmann@gv.mpg.de</email></contactDetails></creator><creator xml:id="au2" creatorRole="author" affiliationRef="#af2"><personName><givenNames>Hermann</givenNames><familyName>Schier</familyName></personName><contactDetails><email>h.schier@fkf.mpg.de</email></contactDetails></creator><creator xml:id="au3" creatorRole="author" affiliationRef="#af2"><personName><givenNames>Werner</givenNames><familyName>Marx</familyName></personName><contactDetails><email>w.marx@fkf.mpg.de</email></contactDetails></creator><creator xml:id="au4" creatorRole="author" affiliationRef="#af3"><personName><givenNames>Hans‐Dieter</givenNames><familyName>Daniel</familyName></personName><contactDetails><email>daniel@evaluation.uzh.ch</email></contactDetails></creator></creators><affiliationGroup><affiliation xml:id="af1" countryCode="DE" type="organization"><unparsedAffiliation>Max Planck Society, Office of Research Analysis and Foresight, Hofgartenstr. 8, D‐80539 Munich</unparsedAffiliation></affiliation><affiliation xml:id="af2" countryCode="DE" type="organization"><unparsedAffiliation>Max Planck Institute for Solid State Research, Heisenbergstraße 1, D‐70569 Stuttgart, Germany</unparsedAffiliation></affiliation><affiliation xml:id="af3" countryCode="CH" type="organization"><unparsedAffiliation>ETH Zurich, Professorship for Social Psychology and Research on Higher Education, Zähringerstr. 24, CH‐8092 Zurich; University of Zurich, Evaluation Office, Mühlegasse 21, CH‐8001 Zurich, Switzerland</unparsedAffiliation></affiliation></affiliationGroup><abstractGroup><abstract type="main" xml:lang="en"><title type="main">Abstract</title><p>In a comprehensive research project, we investigated the predictive validity of selection decisions and reviewers' ratings at the open access journal <i>Atmospheric Chemistry and Physics</i> (ACP). ACP is a high‐impact journal publishing papers on the Earth's atmosphere and the underlying chemical and physical processes. Scientific journals have to deal with the following question concerning the predictive validity: Are in fact the “best” scientific works selected from the manuscripts submitted? In this study we examined whether selecting the “best” manuscripts means selecting papers that after publication show top citation performance as compared to other papers in this research area. First, we appraised the citation impact of later published manuscripts based on the percentile citedness rank classes of the population distribution (scaling in a specific subfield). Second, we analyzed the association between the decisions (<i>n</i> = 677 accepted or rejected, but published elsewhere manuscripts) or ratings (reviewers' ratings for <i>n</i> = 315 manuscripts), respectively, and the citation impact classes of the manuscripts. The results confirm the predictive validity of the ACP peer review system.</p></abstract></abstractGroup></contentMeta></header></component></istex:document></istex:metadataXml><mods version="3.6"><titleInfo lang="en"><title>Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes</title></titleInfo><titleInfo type="alternative" contentType="CDATA" lang="en"><title>Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes</title></titleInfo><name type="personal"><namePart type="given">Lutz</namePart><namePart type="family">Bornmann</namePart><affiliation>Max Planck Society, Office of Research Analysis and Foresight, Hofgartenstr. 8, D‐80539 Munich</affiliation><affiliation>E-mail: bornmann@gv.mpg.de</affiliation><role><roleTerm type="text">author</roleTerm></role></name><name type="personal"><namePart type="given">Hermann</namePart><namePart type="family">Schier</namePart><affiliation>Max Planck Institute for Solid State Research, Heisenbergstraße 1, D‐70569 Stuttgart, Germany</affiliation><affiliation>E-mail: h.schier@fkf.mpg.de</affiliation><role><roleTerm type="text">author</roleTerm></role></name><name type="personal"><namePart type="given">Werner</namePart><namePart type="family">Marx</namePart><affiliation>Max Planck Institute for Solid State Research, Heisenbergstraße 1, D‐70569 Stuttgart, Germany</affiliation><affiliation>E-mail: w.marx@fkf.mpg.de</affiliation><role><roleTerm type="text">author</roleTerm></role></name><name type="personal"><namePart type="given">Hans‐Dieter</namePart><namePart type="family">Daniel</namePart><affiliation>ETH Zurich, Professorship for Social Psychology and Research on Higher Education, Zähringerstr. 24, CH‐8092 Zurich; University of Zurich, Evaluation Office, Mühlegasse 21, CH‐8001 Zurich, Switzerland</affiliation><affiliation>E-mail: daniel@evaluation.uzh.ch</affiliation><role><roleTerm type="text">author</roleTerm></role></name><typeOfResource>text</typeOfResource><genre type="article" displayLabel="article"></genre><originInfo><publisher>Wiley Subscription Services, Inc., A Wiley Company</publisher><place><placeTerm type="text">Hoboken</placeTerm></place><dateIssued encoding="w3cdtf">2011-01</dateIssued><dateCaptured encoding="w3cdtf">2010-06-15</dateCaptured><dateValid encoding="w3cdtf">2010-07-09</dateValid><copyrightDate encoding="w3cdtf">2011</copyrightDate></originInfo><language><languageTerm type="code" authority="rfc3066">en</languageTerm><languageTerm type="code" authority="iso639-2b">eng</languageTerm></language><physicalDescription><internetMediaType>text/html</internetMediaType><extent unit="tables">3</extent><extent unit="references">74</extent></physicalDescription><abstract lang="en">In a comprehensive research project, we investigated the predictive validity of selection decisions and reviewers' ratings at the open access journal Atmospheric Chemistry and Physics (ACP). ACP is a high‐impact journal publishing papers on the Earth's atmosphere and the underlying chemical and physical processes. Scientific journals have to deal with the following question concerning the predictive validity: Are in fact the “best” scientific works selected from the manuscripts submitted? In this study we examined whether selecting the “best” manuscripts means selecting papers that after publication show top citation performance as compared to other papers in this research area. First, we appraised the citation impact of later published manuscripts based on the percentile citedness rank classes of the population distribution (scaling in a specific subfield). Second, we analyzed the association between the decisions (n = 677 accepted or rejected, but published elsewhere manuscripts) or ratings (reviewers' ratings for n = 315 manuscripts), respectively, and the citation impact classes of the manuscripts. The results confirm the predictive validity of the ACP peer review system.</abstract><relatedItem type="host"><titleInfo><title>Journal of the American Society for Information Science and Technology</title></titleInfo><titleInfo type="abbreviated"><title>J. Am. Soc. Inf. Sci.</title></titleInfo><genre type="journal">journal</genre><subject><genre>index-terms</genre><topic authorityURI="psi.asis.org/digital/open+access+publications">open access publications</topic><topic authorityURI="psi.asis.org/digital/refereeing">refereeing</topic><topic authorityURI="psi.asis.org/digital/manuscripts">manuscripts</topic><topic authorityURI="psi.asis.org/digital/selection">selection</topic><topic authorityURI="psi.asis.org/digital/scientometrics">scientometrics</topic></subject><subject><genre>article-category</genre><topic>Research Article</topic></subject><identifier type="ISSN">1532-2882</identifier><identifier type="eISSN">1532-2890</identifier><identifier type="DOI">10.1002/(ISSN)1532-2890</identifier><identifier type="PublisherID">ASI</identifier><part><date>2011</date><detail type="volume"><caption>vol.</caption><number>62</number></detail><detail type="issue"><caption>no.</caption><number>1</number></detail><extent unit="pages"><start>61</start><end>71</end><total>11</total></extent></part></relatedItem><relatedItem type="preceding"><titleInfo><title>Journal of the American Society for Information Science</title></titleInfo><identifier type="ISSN">0002-8231</identifier><identifier type="ISSN">1097-4571</identifier><part><date point="end">2000</date><detail type="volume"><caption>last vol.</caption><number>51</number></detail><detail type="issue"><caption>last no.</caption><number>14</number></detail></part></relatedItem><identifier type="istex">D9ECE9818C88B5676665107C8841C4E90F0936CE</identifier><identifier type="DOI">10.1002/asi.21418</identifier><identifier type="ArticleID">ASI21418</identifier><accessCondition type="use and reproduction" contentType="copyright">© 2010 ASIS&T</accessCondition><recordInfo><recordContentSource>WILEY</recordContentSource><recordOrigin>Wiley Subscription Services, Inc., A Wiley Company</recordOrigin></recordInfo></mods></metadata><enrichments><json:item><type>multicat</type><uri>https://api.istex.fr/document/D9ECE9818C88B5676665107C8841C4E90F0936CE/enrichments/multicat</uri></json:item></enrichments><serie></serie></istex></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Belgique/explor/OpenAccessBelV2/Data/Istex/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000123 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Istex/Corpus/biblio.hfd -nk 000123 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Belgique
|area= OpenAccessBelV2
|flux= Istex
|étape= Corpus
|type= RBID
|clé= ISTEX:D9ECE9818C88B5676665107C8841C4E90F0936CE
|texte= Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes
}}
| This area was generated with Dilib version V0.6.25. |  |