Links to Exploration step
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">The academic, economic and societal impacts of Open Access: an evidence-based review</title><author><name sortKey="Tennant, Jonathan P" sort="Tennant, Jonathan P" uniqKey="Tennant J" first="Jonathan P." last="Tennant">Jonathan P. Tennant</name><affiliation><nlm:aff id="a1">Department of Earth Science and Engineering, Imperial College London, London, UK</nlm:aff></affiliation></author><author><name sortKey="Waldner, Francois" sort="Waldner, Francois" uniqKey="Waldner F" first="François" last="Waldner">François Waldner</name><affiliation><nlm:aff id="a2">Earth and Life Institute, Université catholique de Louvain, Louvain-la-Neuve, Belgium</nlm:aff></affiliation></author><author><name sortKey="Jacques, Damien C" sort="Jacques, Damien C" uniqKey="Jacques D" first="Damien C." last="Jacques">Damien C. Jacques</name><affiliation><nlm:aff id="a2">Earth and Life Institute, Université catholique de Louvain, Louvain-la-Neuve, Belgium</nlm:aff></affiliation></author><author><name sortKey="Masuzzo, Paola" sort="Masuzzo, Paola" uniqKey="Masuzzo P" first="Paola" last="Masuzzo">Paola Masuzzo</name><affiliation><nlm:aff id="a3">Medical Biotechnology Center, VIB, Ghent, Belgium</nlm:aff></affiliation><affiliation><nlm:aff id="a4">Department of Biochemistry, Ghent University, Ghent, Belgium</nlm:aff></affiliation></author><author><name sortKey="Collister, Lauren B" sort="Collister, Lauren B" uniqKey="Collister L" first="Lauren B." last="Collister">Lauren B. Collister</name><affiliation><nlm:aff id="a5">University Library System, University of Pittsburgh, Pittsburgh, PA, USA</nlm:aff></affiliation></author><author><name sortKey="Hartgerink, Chris H J" sort="Hartgerink, Chris H J" uniqKey="Hartgerink C" first="Chris. H. J." last="Hartgerink">Chris. H. J. Hartgerink</name><affiliation><nlm:aff id="a6">Department of Methodology and Statistics, Tilburg University, Tilburg, Netherlands</nlm:aff></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">27158456</idno><idno type="pmc">4837983</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4837983</idno><idno type="RBID">PMC:4837983</idno><idno type="doi">10.12688/f1000research.8460.3</idno><date when="2016">2016</date><idno type="wicri:Area/Pmc/Corpus">000463</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">The academic, economic and societal impacts of Open Access: an evidence-based review</title><author><name sortKey="Tennant, Jonathan P" sort="Tennant, Jonathan P" uniqKey="Tennant J" first="Jonathan P." last="Tennant">Jonathan P. Tennant</name><affiliation><nlm:aff id="a1">Department of Earth Science and Engineering, Imperial College London, London, UK</nlm:aff></affiliation></author><author><name sortKey="Waldner, Francois" sort="Waldner, Francois" uniqKey="Waldner F" first="François" last="Waldner">François Waldner</name><affiliation><nlm:aff id="a2">Earth and Life Institute, Université catholique de Louvain, Louvain-la-Neuve, Belgium</nlm:aff></affiliation></author><author><name sortKey="Jacques, Damien C" sort="Jacques, Damien C" uniqKey="Jacques D" first="Damien C." last="Jacques">Damien C. Jacques</name><affiliation><nlm:aff id="a2">Earth and Life Institute, Université catholique de Louvain, Louvain-la-Neuve, Belgium</nlm:aff></affiliation></author><author><name sortKey="Masuzzo, Paola" sort="Masuzzo, Paola" uniqKey="Masuzzo P" first="Paola" last="Masuzzo">Paola Masuzzo</name><affiliation><nlm:aff id="a3">Medical Biotechnology Center, VIB, Ghent, Belgium</nlm:aff></affiliation><affiliation><nlm:aff id="a4">Department of Biochemistry, Ghent University, Ghent, Belgium</nlm:aff></affiliation></author><author><name sortKey="Collister, Lauren B" sort="Collister, Lauren B" uniqKey="Collister L" first="Lauren B." last="Collister">Lauren B. Collister</name><affiliation><nlm:aff id="a5">University Library System, University of Pittsburgh, Pittsburgh, PA, USA</nlm:aff></affiliation></author><author><name sortKey="Hartgerink, Chris H J" sort="Hartgerink, Chris H J" uniqKey="Hartgerink C" first="Chris. H. J." last="Hartgerink">Chris. H. J. Hartgerink</name><affiliation><nlm:aff id="a6">Department of Methodology and Statistics, Tilburg University, Tilburg, Netherlands</nlm:aff></affiliation></author></analytic><series><title level="j">F1000Research</title><idno type="eISSN">2046-1402</idno><imprint><date when="2016">2016</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>Ongoing debates surrounding Open Access to the scholarly literature are multifaceted and complicated by disparate and often polarised viewpoints from engaged stakeholders. At the current stage, Open Access has become such a global issue that it is critical for all involved in scholarly publishing, including policymakers, publishers, research funders, governments, learned societies, librarians, and academic communities, to be well-informed on the history, benefits, and pitfalls of Open Access. In spite of this, there is a general lack of consensus regarding the potential pros and cons of Open Access at multiple levels. This review aims to be a resource for current knowledge on the impacts of Open Access by synthesizing important research in three major areas: academic, economic and societal. While there is clearly much scope for additional research, several key trends are identified, including a broad citation advantage for researchers who publish openly, as well as additional benefits to the non-academic dissemination of their work. The economic impact of Open Access is less well-understood, although it is clear that access to the research literature is key for innovative enterprises, and a range of governmental and non-governmental services. Furthermore, Open Access has the potential to save both publishers and research funders considerable amounts of financial resources, and can provide some economic benefits to traditionally subscription-based journals. The societal impact of Open Access is strong, in particular for advancing citizen science initiatives, and leveling the playing field for researchers in developing countries. Open Access supersedes all potential alternative modes of access to the scholarly literature through enabling unrestricted re-use, and long-term stability independent of financial constraints of traditional publishers that impede knowledge sharing. However, Open Access has the potential to become unsustainable for research communities if high-cost options are allowed to continue to prevail in a widely unregulated scholarly publishing market. Open Access remains only one of the multiple challenges that the scholarly publishing system is currently facing. Yet, it provides one foundation for increasing engagement with researchers regarding ethical standards of publishing and the broader implications of 'Open Research'.</p></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Abbott, Bp" uniqKey="Abbott B">BP Abbott</name></author><author><name sortKey="Abbott, R" uniqKey="Abbott R">R Abbott</name></author><author><name sortKey="Abbott, Td" uniqKey="Abbott T">TD Abbott</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Adcock, J" uniqKey="Adcock J">J Adcock</name></author><author><name sortKey="Fottrell, E" uniqKey="Fottrell E">E Fottrell</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Adie, E" uniqKey="Adie E">E Adie</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Allen, Hg" uniqKey="Allen H">HG Allen</name></author><author><name sortKey="Stanton, Tr" uniqKey="Stanton T">TR Stanton</name></author><author><name sortKey="Di Pietro, F" uniqKey="Di Pietro F">F Di Pietro</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Alonso Gamboa, Jo" uniqKey="Alonso Gamboa J">JO Alonso-Gamboa</name></author><author><name sortKey="Russell, Jm" uniqKey="Russell J">JM Russell</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Alperin, Jp" uniqKey="Alperin J">JP Alperin</name></author><author><name sortKey="Fischman, Ge" uniqKey="Fischman G">GE Fischman</name></author><author><name sortKey="Willinsky, J" uniqKey="Willinsky J">J Willinsky</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Aman, V" uniqKey="Aman V">V Aman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Anderson, B" uniqKey="Anderson B">B Anderson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Anderson, C" uniqKey="Anderson C">C Anderson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Antelman, K" uniqKey="Antelman K">K Antelman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Arzberger, P" uniqKey="Arzberger P">P Arzberger</name></author><author><name sortKey="Schroeder, P" uniqKey="Schroeder P">P Schroeder</name></author><author><name sortKey="Beaulieu, A" uniqKey="Beaulieu A">A Beaulieu</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Atchison, A" uniqKey="Atchison A">A Atchison</name></author><author><name sortKey="Bull, J" uniqKey="Bull J">J Bull</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Beagrie, N" uniqKey="Beagrie N">N Beagrie</name></author><author><name sortKey="Houghton, Jw" uniqKey="Houghton J">JW Houghton</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Beall, J" uniqKey="Beall J">J Beall</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Beall, J" uniqKey="Beall J">J Beall</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Beall, J" uniqKey="Beall J">J Beall</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Benos, Dj" uniqKey="Benos D">DJ Benos</name></author><author><name sortKey="Bashari, E" uniqKey="Bashari E">E Bashari</name></author><author><name sortKey="Chaves, Jm" uniqKey="Chaves J">JM Chaves</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bergstrom, Tc" uniqKey="Bergstrom T">TC Bergstrom</name></author><author><name sortKey="Courant, Pn" uniqKey="Courant P">PN Courant</name></author><author><name sortKey="Mcafee, Rp" uniqKey="Mcafee R">RP McAfee</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Berman, Hm" uniqKey="Berman H">HM Berman</name></author><author><name sortKey="Westbrook, J" uniqKey="Westbrook J">J Westbrook</name></author><author><name sortKey="Feng, Z" uniqKey="Feng Z">Z Feng</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Berners Lee, T" uniqKey="Berners Lee T">T Berners-Lee</name></author><author><name sortKey="De Roure, D" uniqKey="De Roure D">D De Roure</name></author><author><name sortKey="Harnad, S" uniqKey="Harnad S">S Harnad</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bernius, S" uniqKey="Bernius S">S Bernius</name></author><author><name sortKey="Hanauske, M" uniqKey="Hanauske M">M Hanauske</name></author><author><name sortKey="Dugall, B" uniqKey="Dugall B">B Dugall</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Birukou, A" uniqKey="Birukou A">A Birukou</name></author><author><name sortKey="Wakeling, Jr" uniqKey="Wakeling J">JR Wakeling</name></author><author><name sortKey="Bartolini, C" uniqKey="Bartolini C">C Bartolini</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bjork, Bc" uniqKey="Bjork B">BC Björk</name></author><author><name sortKey="Laakso, M" uniqKey="Laakso M">M Laakso</name></author><author><name sortKey="Welling, P" uniqKey="Welling P">P Welling</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bjork, Bc" uniqKey="Bjork B">BC Bjork</name></author><author><name sortKey="Roos, A" uniqKey="Roos A">A Roos</name></author><author><name sortKey="Lauri, M" uniqKey="Lauri M">M Lauri</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bloudoff Indelicato, M" uniqKey="Bloudoff Indelicato M">M Bloudoff-Indelicato</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bogich, T" uniqKey="Bogich T">T Bogich</name></author><author><name sortKey="Ballesteros, S" uniqKey="Ballesteros S">S Ballesteros</name></author><author><name sortKey="Berjon, R" uniqKey="Berjon R">R Berjon</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bohannon, J" uniqKey="Bohannon J">J Bohannon</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bohannon, J" uniqKey="Bohannon J">J Bohannon</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bowman, Jd" uniqKey="Bowman J">JD Bowman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Brembs, B" uniqKey="Brembs B">B Brembs</name></author><author><name sortKey="Button, K" uniqKey="Button K">K Button</name></author><author><name sortKey="Munaf, M" uniqKey="Munaf M">M Munafò</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Brembs, B" uniqKey="Brembs B">B Brembs</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Buttliere, Bt" uniqKey="Buttliere B">BT Buttliere</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Carp, J" uniqKey="Carp J">J Carp</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Carr, L" uniqKey="Carr L">L Carr</name></author><author><name sortKey="Harnad, S" uniqKey="Harnad S">S Harnad</name></author><author><name sortKey="Swan, A" uniqKey="Swan A">A Swan</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Chamberlain, S" uniqKey="Chamberlain S">S Chamberlain</name></author><author><name sortKey="Boettiger, C" uniqKey="Boettiger C">C Boettiger</name></author><author><name sortKey="Ram, K" uniqKey="Ram K">K Ram</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Chan, L" uniqKey="Chan L">L Chan</name></author><author><name sortKey="Kirsop, B" uniqKey="Kirsop B">B Kirsop</name></author><author><name sortKey="Arunachalam, S" uniqKey="Arunachalam S">S Arunachalam</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Chatterjee, P" uniqKey="Chatterjee P">P Chatterjee</name></author><author><name sortKey="Biswas, T" uniqKey="Biswas T">T Biswas</name></author><author><name sortKey="Mishra, V" uniqKey="Mishra V">V Mishra</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cheng, W" uniqKey="Cheng W">W Cheng</name></author><author><name sortKey="Ren, S" uniqKey="Ren S">S Ren</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Colomb, J" uniqKey="Colomb J">J Colomb</name></author><author><name sortKey="Brembs, B" uniqKey="Brembs B">B Brembs</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Costas, R" uniqKey="Costas R">R Costas</name></author><author><name sortKey="Zahedi, Z" uniqKey="Zahedi Z">Z Zahedi</name></author><author><name sortKey="Wouters, P" uniqKey="Wouters P">P Wouters</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Crawford, W" uniqKey="Crawford W">W Crawford</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Dallmeier Tiessen, S" uniqKey="Dallmeier Tiessen S">S Dallmeier-Tiessen</name></author><author><name sortKey="Darby, R" uniqKey="Darby R">R Darby</name></author><author><name sortKey="Goerner, B" uniqKey="Goerner B">B Goerner</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Davis, P" uniqKey="Davis P">P Davis</name></author><author><name sortKey="Fromerth, M" uniqKey="Fromerth M">M Fromerth</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Davis, Pm" uniqKey="Davis P">PM Davis</name></author><author><name sortKey="Lewenstein, Bv" uniqKey="Lewenstein B">BV Lewenstein</name></author><author><name sortKey="Simon, Dh" uniqKey="Simon D">DH Simon</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Davis, Pm" uniqKey="Davis P">PM Davis</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Denicola, R" uniqKey="Denicola R">R Denicola</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Denker, Sp" uniqKey="Denker S">SP Denker</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Derrida, J" uniqKey="Derrida J">J Derrida</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Djuric, D" uniqKey="Djuric D">D Djuric</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Dorch, Sbf" uniqKey="Dorch S">SBF Dorch</name></author><author><name sortKey="Drachen, Tm" uniqKey="Drachen T">TM Drachen</name></author><author><name sortKey="Ellegaard, O" uniqKey="Ellegaard O">O Ellegaard</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Eger, T" uniqKey="Eger T">T Eger</name></author><author><name sortKey="Scheufen, M" uniqKey="Scheufen M">M Scheufen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Elbakyan, A" uniqKey="Elbakyan A">A Elbakyan</name></author><author><name sortKey="Bohannon, J" uniqKey="Bohannon J">J Bohannon</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Evans, Ja" uniqKey="Evans J">JA Evans</name></author><author><name sortKey="Reimer, J" uniqKey="Reimer J">J Reimer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Eysenbach, G" uniqKey="Eysenbach G">G Eysenbach</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Eysenbach, G" uniqKey="Eysenbach G">G Eysenbach</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Flynn, S" uniqKey="Flynn S">S Flynn</name></author><author><name sortKey="Hollis, A" uniqKey="Hollis A">A Hollis</name></author><author><name sortKey="Palmedo, M" uniqKey="Palmedo M">M Palmedo</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Frandsen, Tf" uniqKey="Frandsen T">TF Frandsen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gargouri, Y" uniqKey="Gargouri Y">Y Gargouri</name></author><author><name sortKey="Hajjem, C" uniqKey="Hajjem C">C Hajjem</name></author><author><name sortKey="Lariviere, V" uniqKey="Lariviere V">V Larivière</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gargouri, Y" uniqKey="Gargouri Y">Y Gargouri</name></author><author><name sortKey="Lariviere, V" uniqKey="Lariviere V">V Larivière</name></author><author><name sortKey="Gingras, Y" uniqKey="Gingras Y">Y Gingras</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gaule, P" uniqKey="Gaule P">P Gaule</name></author><author><name sortKey="Maystre, N" uniqKey="Maystre N">N Maystre</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gentil Beccot, A" uniqKey="Gentil Beccot A">A Gentil-Beccot</name></author><author><name sortKey="Mele, S" uniqKey="Mele S">S Mele</name></author><author><name sortKey="Brooks, T" uniqKey="Brooks T">T Brooks</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ghosh, Ss" uniqKey="Ghosh S">SS Ghosh</name></author><author><name sortKey="Klein, A" uniqKey="Klein A">A Klein</name></author><author><name sortKey="Avants, B" uniqKey="Avants B">B Avants</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Glenisson, P" uniqKey="Glenisson P">P Glenisson</name></author><author><name sortKey="Gl Nzel, W" uniqKey="Gl Nzel W">W Glänzel</name></author><author><name sortKey="Janssens, F" uniqKey="Janssens F">F Janssens</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Glover, M" uniqKey="Glover M">M Glover</name></author><author><name sortKey="Buxton, M" uniqKey="Buxton M">M Buxton</name></author><author><name sortKey="Guthrie, S" uniqKey="Guthrie S">S Guthrie</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gonzalez, Gh" uniqKey="Gonzalez G">GH Gonzalez</name></author><author><name sortKey="Tahsin, T" uniqKey="Tahsin T">T Tahsin</name></author><author><name sortKey="Goodale, Bc" uniqKey="Goodale B">BC Goodale</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hajjem, C" uniqKey="Hajjem C">C Hajjem</name></author><author><name sortKey="Harnad, S" uniqKey="Harnad S">S Harnad</name></author><author><name sortKey="Gingras, Y" uniqKey="Gingras Y">Y Gingras</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Handke, C" uniqKey="Handke C">C Handke</name></author><author><name sortKey="Guibault, L" uniqKey="Guibault L">L Guibault</name></author><author><name sortKey="Vallbe, Jj" uniqKey="Vallbe J">JJ Vallbé</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Harmston, N" uniqKey="Harmston N">N Harmston</name></author><author><name sortKey="Filsell, W" uniqKey="Filsell W">W Filsell</name></author><author><name sortKey="Stumpf, Mp" uniqKey="Stumpf M">MP Stumpf</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Harnad, S" uniqKey="Harnad S">S Harnad</name></author><author><name sortKey="Brody, T" uniqKey="Brody T">T Brody</name></author><author><name sortKey="Vallieres, F" uniqKey="Vallieres F">F Vallieres</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Harnad, S" uniqKey="Harnad S">S Harnad</name></author><author><name sortKey="Brody, T" uniqKey="Brody T">T Brody</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Harnad, S" uniqKey="Harnad S">S Harnad</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Henneken, Ea" uniqKey="Henneken E">EA Henneken</name></author><author><name sortKey="Kurtz, Mj" uniqKey="Kurtz M">MJ Kurtz</name></author><author><name sortKey="Eichhorn, G" uniqKey="Eichhorn G">G Eichhorn</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hitchcock, S" uniqKey="Hitchcock S">S Hitchcock</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hoorn, E" uniqKey="Hoorn E">E Hoorn</name></author><author><name sortKey="Van Der Graaf, M" uniqKey="Van Der Graaf M">M van der Graaf</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Houghton, Jw" uniqKey="Houghton J">JW Houghton</name></author><author><name sortKey="Oppenheim, C" uniqKey="Oppenheim C">C Oppenheim</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ioannidis, Jp" uniqKey="Ioannidis J">JP Ioannidis</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ioannidis, Jp" uniqKey="Ioannidis J">JP Ioannidis</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ioannidis, Jp" uniqKey="Ioannidis J">JP Ioannidis</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="John, Lk" uniqKey="John L">LK John</name></author><author><name sortKey="Loewenstein, G" uniqKey="Loewenstein G">G Loewenstein</name></author><author><name sortKey="Prelec, D" uniqKey="Prelec D">D Prelec</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Khabsa, M" uniqKey="Khabsa M">M Khabsa</name></author><author><name sortKey="Giles, Cl" uniqKey="Giles C">CL Giles</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kmietowicz, Z" uniqKey="Kmietowicz Z">Z Kmietowicz</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Knobloch, J" uniqKey="Knobloch J">J Knobloch</name></author><author><name sortKey="Albiez, Ej" uniqKey="Albiez E">EJ Albiez</name></author><author><name sortKey="Schmitz, H" uniqKey="Schmitz H">H Schmitz</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kousha, K" uniqKey="Kousha K">K Kousha</name></author><author><name sortKey="Abdoli, M" uniqKey="Abdoli M">M Abdoli</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kriegeskorte, N" uniqKey="Kriegeskorte N">N Kriegeskorte</name></author><author><name sortKey="Walther, A" uniqKey="Walther A">A Walther</name></author><author><name sortKey="Deca, D" uniqKey="Deca D">D Deca</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kurtz, Mj" uniqKey="Kurtz M">MJ Kurtz</name></author><author><name sortKey="Eichhorn, G" uniqKey="Eichhorn G">G Eichhorn</name></author><author><name sortKey="Accomazzi, A" uniqKey="Accomazzi A">A Accomazzi</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kurtz, Mj" uniqKey="Kurtz M">MJ Kurtz</name></author><author><name sortKey="Henneken, Ea" uniqKey="Henneken E">EA Henneken</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Laakso, M" uniqKey="Laakso M">M Laakso</name></author><author><name sortKey="Bjork, Bc" uniqKey="Bjork B">BC Björk</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Laakso, M" uniqKey="Laakso M">M Laakso</name></author><author><name sortKey="Welling, P" uniqKey="Welling P">P Welling</name></author><author><name sortKey="Bukvova, H" uniqKey="Bukvova H">H Bukvova</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lansingh, Vc" uniqKey="Lansingh V">VC Lansingh</name></author><author><name sortKey="Carter, Mj" uniqKey="Carter M">MJ Carter</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lariviere, V" uniqKey="Lariviere V">V Larivière</name></author><author><name sortKey="Haustein, S" uniqKey="Haustein S">S Haustein</name></author><author><name sortKey="Mongeon, P" uniqKey="Mongeon P">P Mongeon</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lawrence, S" uniqKey="Lawrence S">S Lawrence</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lawson, S" uniqKey="Lawson S">S Lawson</name></author><author><name sortKey="Meghreblian, B" uniqKey="Meghreblian B">B Meghreblian</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Lawson, S" uniqKey="Lawson S">S Lawson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Leek, Jt" uniqKey="Leek J">JT Leek</name></author><author><name sortKey="Taub, Ma" uniqKey="Taub M">MA Taub</name></author><author><name sortKey="Pineda, Fj" uniqKey="Pineda F">FJ Pineda</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Leitner, F" uniqKey="Leitner F">F Leitner</name></author><author><name sortKey="Valencia, A" uniqKey="Valencia A">A Valencia</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Liang, X" uniqKey="Liang X">X Liang</name></author><author><name sortKey="Su, Ly" uniqKey="Su L">LY Su</name></author><author><name sortKey="Yeo, Sk" uniqKey="Yeo S">SK Yeo</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mackie Mason, J" uniqKey="Mackie Mason J">J MacKie-Mason</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Malhotra, A" uniqKey="Malhotra A">A Malhotra</name></author><author><name sortKey="Younesi, E" uniqKey="Younesi E">E Younesi</name></author><author><name sortKey="Gurulingappa, H" uniqKey="Gurulingappa H">H Gurulingappa</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Manyika, J" uniqKey="Manyika J">J Manyika</name></author><author><name sortKey="Chui, M" uniqKey="Chui M">M Chui</name></author><author><name sortKey="Groves, P" uniqKey="Groves P">P Groves</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Martone, M" uniqKey="Martone M">M Martone</name></author><author><name sortKey="Murray Rust, P" uniqKey="Murray Rust P">P Murray-Rust</name></author><author><name sortKey="Molloy, J" uniqKey="Molloy J">J Molloy</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Matheka, Dm" uniqKey="Matheka D">DM Matheka</name></author><author><name sortKey="Nderitu, J" uniqKey="Nderitu J">J Nderitu</name></author><author><name sortKey="Mutonga, D" uniqKey="Mutonga D">D Mutonga</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mazzucato, M" uniqKey="Mazzucato M">M Mazzucato</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mccabe, M" uniqKey="Mccabe M">M McCabe</name></author><author><name sortKey="Snyder, Cm" uniqKey="Snyder C">CM Snyder</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mcglynn, T" uniqKey="Mcglynn T">T McGlynn</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mcguigan, Gs" uniqKey="Mcguigan G">GS McGuigan</name></author><author><name sortKey="Russel, Rd" uniqKey="Russel R">RD Russel</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mckiernan, E" uniqKey="Mckiernan E">E McKiernan</name></author><author><name sortKey="Bourne, Pe" uniqKey="Bourne P">PE Bourne</name></author><author><name sortKey="Brown, Ct" uniqKey="Brown C">CT Brown</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mcveigh, Me" uniqKey="Mcveigh M">ME McVeigh</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Metcalfe, Ts" uniqKey="Metcalfe T">TS Metcalfe</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Metcalfe, Ts" uniqKey="Metcalfe T">TS Metcalfe</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Moed, H" uniqKey="Moed H">H Moed</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mohammadi, E" uniqKey="Mohammadi E">E Mohammadi</name></author><author><name sortKey="Thelwall, M" uniqKey="Thelwall M">M Thelwall</name></author><author><name sortKey="Haustein, S" uniqKey="Haustein S">S Haustein</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Muller Langer, F" uniqKey="Muller Langer F">F Müller-Langer</name></author><author><name sortKey="Watt, R" uniqKey="Watt R">R Watt</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Natarajan, J" uniqKey="Natarajan J">J Natarajan</name></author><author><name sortKey="Berrar, D" uniqKey="Berrar D">D Berrar</name></author><author><name sortKey="Dubitzky, W" uniqKey="Dubitzky W">W Dubitzky</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Neto, Sc" uniqKey="Neto S">SC Neto</name></author><author><name sortKey="Willinsky, J" uniqKey="Willinsky J">J Willinsky</name></author><author><name sortKey="Alperin, J" uniqKey="Alperin J">J Alperin</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Norris, M" uniqKey="Norris M">M Norris</name></author><author><name sortKey="Oppenheim, C" uniqKey="Oppenheim C">C Oppenheim</name></author><author><name sortKey="Rowland, F" uniqKey="Rowland F">F Rowland</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Nosek, Ba" uniqKey="Nosek B">BA Nosek</name></author><author><name sortKey="Bar Anan, Y" uniqKey="Bar Anan Y">Y Bar-Anan</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Nuijten, Mb" uniqKey="Nuijten M">MB Nuijten</name></author><author><name sortKey="Hartgerink, Ch" uniqKey="Hartgerink C">CH Hartgerink</name></author><author><name sortKey="Van Assen, Ma" uniqKey="Van Assen M">MA van Assen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Odlyzko, A" uniqKey="Odlyzko A">A Odlyzko</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Odlyzko, Am" uniqKey="Odlyzko A">AM Odlyzko</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Okerson, A" uniqKey="Okerson A">A Okerson</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Packer, Al" uniqKey="Packer A">AL Packer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Piwowar, H" uniqKey="Piwowar H">H Piwowar</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Piwowar, Ha" uniqKey="Piwowar H">HA Piwowar</name></author><author><name sortKey="Day, Rs" uniqKey="Day R">RS Day</name></author><author><name sortKey="Fridsma, Db" uniqKey="Fridsma D">DB Fridsma</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Piwowar, Ha" uniqKey="Piwowar H">HA Piwowar</name></author><author><name sortKey="Vision, Tj" uniqKey="Vision T">TJ Vision</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pomerantz, J" uniqKey="Pomerantz J">J Pomerantz</name></author><author><name sortKey="Peek, R" uniqKey="Peek R">R Peek</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Porter, Al" uniqKey="Porter A">AL Porter</name></author><author><name sortKey="Kongthon, A" uniqKey="Kongthon A">A Kongthon</name></author><author><name sortKey="Lu, Jc" uniqKey="Lu J">JC Lu</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Poschl, U" uniqKey="Poschl U">U Pöschl</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Rosenwald, Ms" uniqKey="Rosenwald M">MS Rosenwald</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sahu, Dk" uniqKey="Sahu D">DK Sahu</name></author><author><name sortKey="Gogtay, Nj" uniqKey="Gogtay N">NJ Gogtay</name></author><author><name sortKey="Bavdekar, Sb" uniqKey="Bavdekar S">SB Bavdekar</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Satyanarayana, K" uniqKey="Satyanarayana K">K Satyanarayana</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Scheufen, M" uniqKey="Scheufen M">M Scheufen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schimmer, R" uniqKey="Schimmer R">R Schimmer</name></author><author><name sortKey="Geschuhn, Kk" uniqKey="Geschuhn K">KK Geschuhn</name></author><author><name sortKey="Vogler, A" uniqKey="Vogler A">A Vogler</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schimmer, R" uniqKey="Schimmer R">R Schimmer</name></author><author><name sortKey="Geschuhn, Kk" uniqKey="Geschuhn K">KK Geschuhn</name></author><author><name sortKey="Vogler, A" uniqKey="Vogler A">A Vogler</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schroter, S" uniqKey="Schroter S">S Schroter</name></author><author><name sortKey="Tite, L" uniqKey="Tite L">L Tite</name></author><author><name sortKey="Smith, R" uniqKey="Smith R">R Smith</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schroter, S" uniqKey="Schroter S">S Schroter</name></author><author><name sortKey="Tite, L" uniqKey="Tite L">L Tite</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schwarz, Gj" uniqKey="Schwarz G">GJ Schwarz</name></author><author><name sortKey="Kennicutt, Rc" uniqKey="Kennicutt R">RC Kennicutt</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Shatkay, H" uniqKey="Shatkay H">H Shatkay</name></author><author><name sortKey="Pan, F" uniqKey="Pan F">F Pan</name></author><author><name sortKey="Rzhetsky, A" uniqKey="Rzhetsky A">A Rzhetsky</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Shavell, S" uniqKey="Shavell S">S Shavell</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Shen, C" uniqKey="Shen C">C Shen</name></author><author><name sortKey="Bjork, Bc" uniqKey="Bjork B">BC Björk</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Shieber, S" uniqKey="Shieber S">S Shieber</name></author><author><name sortKey="Suber, P" uniqKey="Suber P">P Suber</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Simmons, Jp" uniqKey="Simmons J">JP Simmons</name></author><author><name sortKey="Nelson, Ld" uniqKey="Nelson L">LD Nelson</name></author><author><name sortKey="Simonsohn, U" uniqKey="Simonsohn U">U Simonsohn</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Solomon, Dj" uniqKey="Solomon D">DJ Solomon</name></author><author><name sortKey="Bjork, Bc" uniqKey="Bjork B">BC Björk</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Solomon, Dj" uniqKey="Solomon D">DJ Solomon</name></author><author><name sortKey="Bjork, Bc" uniqKey="Bjork B">BC Björk</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stodden, V" uniqKey="Stodden V">V Stodden</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stott, A" uniqKey="Stott A">A Stott</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Suber, P" uniqKey="Suber P">P Suber</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sutton, C" uniqKey="Sutton C">C Sutton</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Swan, A" uniqKey="Swan A">A Swan</name></author><author><name sortKey="Brown, S" uniqKey="Brown S">S Brown</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Swan, A" uniqKey="Swan A">A Swan</name></author><author><name sortKey="Brown, S" uniqKey="Brown S">S Brown</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Swan, A" uniqKey="Swan A">A Swan</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Swanson, Dr" uniqKey="Swanson D">DR Swanson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Tate, D" uniqKey="Tate D">D Tate</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Turner, Ja" uniqKey="Turner J">JA Turner</name></author><author><name sortKey="Laird, Ar" uniqKey="Laird A">AR Laird</name></author></analytic></biblStruct><biblStruct></biblStruct><biblStruct><analytic><author><name sortKey="Van Assen, Ma" uniqKey="Van Assen M">MA van Assen</name></author><author><name sortKey="Van Aert, Rc" uniqKey="Van Aert R">RC van Aert</name></author><author><name sortKey="Nuijten, Mb" uniqKey="Nuijten M">MB Nuijten</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Van Noorden, R" uniqKey="Van Noorden R">R Van Noorden</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Van Noorden, R" uniqKey="Van Noorden R">R Van Noorden</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Van Noorden, R" uniqKey="Van Noorden R">R Van Noorden</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Van Rooyen, S" uniqKey="Van Rooyen S">S van Rooyen</name></author><author><name sortKey="Godlee, F" uniqKey="Godlee F">F Godlee</name></author><author><name sortKey="Evans, S" uniqKey="Evans S">S Evans</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Vanclay, Jk" uniqKey="Vanclay J">JK Vanclay</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Veletsianos, G" uniqKey="Veletsianos G">G Veletsianos</name></author><author><name sortKey="Kimmons, R" uniqKey="Kimmons R">R Kimmons</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Vickery, G" uniqKey="Vickery G">G Vickery</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Vincent Lamarre, P" uniqKey="Vincent Lamarre P">P Vincent-Lamarre</name></author><author><name sortKey="Boivin, J" uniqKey="Boivin J">J Boivin</name></author><author><name sortKey="Gargouri, Y" uniqKey="Gargouri Y">Y Gargouri</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wagenmakers, Ej" uniqKey="Wagenmakers E">EJ Wagenmakers</name></author><author><name sortKey="Wetzels, R" uniqKey="Wetzels R">R Wetzels</name></author><author><name sortKey="Borsboom, D" uniqKey="Borsboom D">D Borsboom</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wagner, B" uniqKey="Wagner B">B Wagner</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Walters, Wh" uniqKey="Walters W">WH Walters</name></author><author><name sortKey="Linvill, A" uniqKey="Linvill A">A Linvill</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wang, X" uniqKey="Wang X">X Wang</name></author><author><name sortKey="Liu, C" uniqKey="Liu C">C Liu</name></author><author><name sortKey="Mao, W" uniqKey="Mao W">W Mao</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Watson, M" uniqKey="Watson M">M Watson</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wicherts, Jm" uniqKey="Wicherts J">JM Wicherts</name></author><author><name sortKey="Bakker, M" uniqKey="Bakker M">M Bakker</name></author><author><name sortKey="Molenaar, D" uniqKey="Molenaar D">D Molenaar</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wicherts, Jm" uniqKey="Wicherts J">JM Wicherts</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Willinsky, J" uniqKey="Willinsky J">J Willinsky</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Willinsky, J" uniqKey="Willinsky J">J Willinsky</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wohlrabe, K" uniqKey="Wohlrabe K">K Wohlrabe</name></author><author><name sortKey="Birkmeier, D" uniqKey="Birkmeier D">D Birkmeier</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Xia, J" uniqKey="Xia J">J Xia</name></author><author><name sortKey="Harmon, Jl" uniqKey="Harmon J">JL Harmon</name></author><author><name sortKey="Connolly, Kg" uniqKey="Connolly K">KG Connolly</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Xia, J" uniqKey="Xia J">J Xia</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Xu, L" uniqKey="Xu L">L Xu</name></author><author><name sortKey="Liu, J" uniqKey="Liu J">J Liu</name></author><author><name sortKey="Fang, Q" uniqKey="Fang Q">Q Fang</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Zhang, Y" uniqKey="Zhang Y">Y Zhang</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Zhao, D" uniqKey="Zhao D">D Zhao</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Zuccala, A" uniqKey="Zuccala A">A Zuccala</name></author></analytic></biblStruct></listBibl></div1></back></TEI><pmc article-type="review-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">F1000Res</journal-id><journal-id journal-id-type="iso-abbrev">F1000Res</journal-id><journal-id journal-id-type="pmc">F1000Research</journal-id><journal-title-group><journal-title>F1000Research</journal-title></journal-title-group><issn pub-type="epub">2046-1402</issn><publisher><publisher-name>F1000Research</publisher-name><publisher-loc>London, UK</publisher-loc></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">27158456</article-id><article-id pub-id-type="pmc">4837983</article-id><article-id pub-id-type="doi">10.12688/f1000research.8460.3</article-id><article-categories><subj-group subj-group-type="heading"><subject>Review</subject></subj-group><subj-group><subject>Articles</subject><subj-group><subject>Data Sharing</subject></subj-group><subj-group><subject>Publishing & Peer Review</subject></subj-group></subj-group></article-categories><title-group><article-title>The academic, economic and societal impacts of Open Access: an evidence-based review</article-title><fn-group content-type="pub-status"><fn><p>[version 3; referees: 3 approved</p></fn></fn-group></title-group><contrib-group><contrib contrib-type="author"><name><surname>Tennant</surname><given-names>Jonathan P.</given-names></name><xref ref-type="corresp" rid="c1">a</xref><xref ref-type="aff" rid="a1">1</xref></contrib><contrib contrib-type="author"><name><surname>Waldner</surname><given-names>François</given-names></name><xref ref-type="aff" rid="a2">2</xref></contrib><contrib contrib-type="author"><name><surname>Jacques</surname><given-names>Damien C.</given-names></name><xref ref-type="aff" rid="a2">2</xref></contrib><contrib contrib-type="author"><name><surname>Masuzzo</surname><given-names>Paola</given-names></name><xref ref-type="aff" rid="a3">3</xref><xref ref-type="aff" rid="a4">4</xref></contrib><contrib contrib-type="author"><name><surname>Collister</surname><given-names>Lauren B.</given-names></name><xref ref-type="aff" rid="a5">5</xref></contrib><contrib contrib-type="author"><name><surname>Hartgerink</surname><given-names>Chris. H. J.</given-names></name><xref ref-type="aff" rid="a6">6</xref></contrib><aff id="a1"><label>1</label>Department of Earth Science and Engineering, Imperial College London, London, UK</aff><aff id="a2"><label>2</label>Earth and Life Institute, Université catholique de Louvain, Louvain-la-Neuve, Belgium</aff><aff id="a3"><label>3</label>Medical Biotechnology Center, VIB, Ghent, Belgium</aff><aff id="a4"><label>4</label>Department of Biochemistry, Ghent University, Ghent, Belgium</aff><aff id="a5"><label>5</label>University Library System, University of Pittsburgh, Pittsburgh, PA, USA</aff><aff id="a6"><label>6</label>Department of Methodology and Statistics, Tilburg University, Tilburg, Netherlands</aff></contrib-group><author-notes><corresp id="c1"><label>a</label><email xlink:href="mailto:jon.tennant.2@gmail.com">jon.tennant.2@gmail.com</email></corresp><fn fn-type="con"><p>All authors contributed equally to the writing of this manuscript using the Overleaf collaborative writing platform.</p></fn><fn fn-type="COI-statement"><p><bold>Competing interests: </bold>JPT currently blogs for the PLOS Paleo Community, and works for ScienceOpen. CHJH is a Center for Open Science ambassador. DCJ and FW are members of the Open Access Working Group of EURODOC. PM is a Research Data Alliance member. LBC works for the University of Pittsburgh, which has an Open Access library publishing department. All views presented here are strictly personal.</p></fn></author-notes><pub-date pub-type="epub"><day>21</day><month>9</month><year>2016</year></pub-date><pub-date pub-type="collection"><year>2016</year></pub-date><volume>5</volume><elocation-id>632</elocation-id><history><date date-type="accepted"><day>20</day><month>9</month><year>2016</year></date></history><permissions><copyright-statement>Copyright: © 2016 Tennant JP et al.</copyright-statement><copyright-year>2016</copyright-year><license xlink:href="http://creativecommons.org/licenses/by/4.0/"><license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p></license></permissions><self-uri content-type="pdf" xlink:type="simple" xlink:href="f1000research-5-10376.pdf"></self-uri><abstract><p>Ongoing debates surrounding Open Access to the scholarly literature are multifaceted and complicated by disparate and often polarised viewpoints from engaged stakeholders. At the current stage, Open Access has become such a global issue that it is critical for all involved in scholarly publishing, including policymakers, publishers, research funders, governments, learned societies, librarians, and academic communities, to be well-informed on the history, benefits, and pitfalls of Open Access. In spite of this, there is a general lack of consensus regarding the potential pros and cons of Open Access at multiple levels. This review aims to be a resource for current knowledge on the impacts of Open Access by synthesizing important research in three major areas: academic, economic and societal. While there is clearly much scope for additional research, several key trends are identified, including a broad citation advantage for researchers who publish openly, as well as additional benefits to the non-academic dissemination of their work. The economic impact of Open Access is less well-understood, although it is clear that access to the research literature is key for innovative enterprises, and a range of governmental and non-governmental services. Furthermore, Open Access has the potential to save both publishers and research funders considerable amounts of financial resources, and can provide some economic benefits to traditionally subscription-based journals. The societal impact of Open Access is strong, in particular for advancing citizen science initiatives, and leveling the playing field for researchers in developing countries. Open Access supersedes all potential alternative modes of access to the scholarly literature through enabling unrestricted re-use, and long-term stability independent of financial constraints of traditional publishers that impede knowledge sharing. However, Open Access has the potential to become unsustainable for research communities if high-cost options are allowed to continue to prevail in a widely unregulated scholarly publishing market. Open Access remains only one of the multiple challenges that the scholarly publishing system is currently facing. Yet, it provides one foundation for increasing engagement with researchers regarding ethical standards of publishing and the broader implications of 'Open Research'.</p></abstract><kwd-group kwd-group-type="author"><kwd>Open Citation Advantage</kwd><kwd>Altmetrics</kwd><kwd>Open Access</kwd><kwd>Publishing</kwd><kwd>Copyright</kwd><kwd>Incentive System</kwd><kwd>Open Science, Text and Data Mining</kwd></kwd-group><funding-group><award-group id="fund-1"><funding-source>European Commission Horizon 2020 Programme</funding-source><award-id>634107 (PHC32-2014) ‘MULTIMOT’</award-id></award-group><funding-statement>This research was partly funded by the Belgian National Fund for Scientific Research through a FRIA grant. PM acknowledges support from the European Commission Horizon 2020 Programme under Grant Agreement 634107 (PHC32-2014) ‘MULTIMOT’.</funding-statement><funding-statement><italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic></funding-statement></funding-group></article-meta><notes><sec sec-type="version-changes"><label>Revised</label><title>Amendments from Version 2</title><p>The final version of this manuscript includes minor edits reflected in the last review by Peter Suber, as well as stylistic edits noted by other commenters. We hope that this paper will continue to be shared and discussed, and that it helps with future developments in Open Access.</p></sec></notes></front><body><sec sec-type="intro"><title>Introduction</title><p>Open Access (OA) refers to the removal of major obstacles to accessing, sharing and re-using the outputs of scholarly research. The rationale is that the research process is facilitated by ensuring rapid and widespread access to research findings such that all communities have the opportunity to build upon them and participate in scholarly conversations. As such, the major drivers behind OA relate to within- and between-community equality (
<xref rid="ref-167" ref-type="bibr">Veletsianos & Kimmons, 2012</xref>), as well as bridging the global North-South research divide (
<xref rid="ref-2" ref-type="bibr">Adcock & Fottrell, 2008</xref>). Reflecting this ambition, there are currently over 700 OA policies and mandates recorded worldwide from a range of research institutes and funding bodies (
<ext-link ext-link-type="uri" xlink:href="http://roarmap.eprints.org">roarmap.eprints.org</ext-link>). OA pertains to documents made available via two main pathways: the Gold route and the Green route (
<xref rid="ref-72" ref-type="bibr">Harnad
<italic>et al.</italic>, 2008</xref>). The Gold route refers to freely accessible research articles at the point of publication. This route is often, although not always, accompanied by article processing charges (APCs). The Green route refers to author self-archiving, in which peer-reviewed articles and/or not peer-reviewed pre-prints are posted online to an institutional and/or subject repository, or to a personal website. This route is often dependent on journal or publisher policies on self-archiving (
<ext-link ext-link-type="uri" xlink:href="http://sherpa.ac.uk/romeo">sherpa.ac.uk/romeo</ext-link>). Some publishers require an embargo period before deposition in public repositories is allowed. These embargoes are applied in order to avoid putative reductions in subscription income due to such self-archiving, although there is little evidence to support the existence of such embargoes (
<xref rid="ref-20" ref-type="bibr">Berners-Lee
<italic>et al.</italic>, 2005</xref>;
<xref rid="ref-21" ref-type="bibr">Bernius
<italic>et al.</italic>, 2013</xref>;
<xref rid="ref-75" ref-type="bibr">Henneken
<italic>et al.</italic>, 2006</xref>;
<xref rid="ref-78" ref-type="bibr">Houghton & Oppenheim, 2010</xref>;
<xref rid="ref-155" ref-type="bibr">Swan & Brown, 2005</xref>). The Green route is also enabled through author rights retention, in which authors pre-emptively grant non-exclusive rights to their institutions before publishing any works. The institution then has the ability to make articles by these authors OA without seeking permission from the publishers (e.g., this is the case of the Dutch Taverne amendment that has declared self-archival of research after ‘a reasonable period of time’ a legal right (
<xref rid="ref-124" ref-type="bibr">Open Access NL, 2015</xref>)). Through these dual pathways, almost 25% of all scholarly documents archived on the Web are now obtainable via OA somewhere on the Internet (
<xref rid="ref-83" ref-type="bibr">Khabsa & Giles, 2014</xref>).</p><p>A core issue remains: universal or even marginal access to approximately 75% of articles is not directly possible unless one either is in a privileged position to work at an institute that has subscription access to these articles, or has enough money to pay on a per-article basis (given that journals provide this feature; some do not). Subscriptions to all peer-reviewed journals is not affordable for any single individual, research institute or university (
<xref rid="ref-121" ref-type="bibr">Odlyzko, 2006</xref>;
<xref rid="ref-152" ref-type="bibr">Suber, 2012</xref>). Consequently, the potential impact of research articles is never fully realized, impeding scientific progress by a lack of use, while simultaneously negatively affecting the recognition of individual researchers (
<xref rid="ref-76" ref-type="bibr">Hitchcock, 2013</xref>) and the funders who support their work.</p><p>Because of these issues, free and unrestricted access to primary research literature has become a global goal of the OA movement. The steady increase in OA over the past two decades has required careful negotiations between a range of stakeholders (e.g., librarians, funders, academics). Much of the driving force behind this global change has been through a combination of direct, grassroots advocacy initiatives and policy reforms from universities, funders and governments. The debates regarding the benefits of OA over subscription-based access often hinge on the increased value to academics. However, increased access has broader benefits to research through enhanced visibility, facilitating innovation by businesses and decreasing financial pressure on academic/research libraries (known more broadly as the ‘serials crisis’ (
<xref rid="ref-108" ref-type="bibr">McGuigan & Russel, 2008</xref>)). Additionally, increased access to scholarly outputs might help foster a culture of greater scientific education and literacy, which in turn could have a direct impact on public policy (
<xref rid="ref-55" ref-type="bibr">European Commission, 2012</xref>;
<xref rid="ref-185" ref-type="bibr">Zuccala, 2010</xref>), particularly in domains such as climate change and global health, as well as increasing public engagement in scientific research (
<xref rid="ref-150" ref-type="bibr">Stodden, 2010</xref>). OA also includes a moral aspect, where access to scientific knowledge and information is regarded as a fundamental feature of global human equality. For example, Article 27 of the United Nations Declaration of Human Rights states that "
<italic>Everyone has the right to freely participate in the cultural life of the community, to enjoy the arts and to share in scientific advancement and its benefits.</italic>" (
<xref rid="ref-160" ref-type="bibr">United Nations, 1948</xref>).</p><p>This review aims to provide information on the various impacts of OA to scholarly research. We consider the impact of OA from the academic, economic, and societal perspective. In addition, we shortly consider the broader implications of OA on Open Data, a closely related aspect united under a general theme of Open Research or Open Science. By aggregating evidence from a range of primary sources, this review should be useful to those broadly interested in the impact of open scholarly research, as well as policymakers and others involved in implementing OA policies and strategies. We refrain from making predictions about the future of OA publishing or policy recommendations, as these are both beyond the scope of this work.</p></sec><sec><title>A brief history of Open Access</title><p>The OA movement is intrinsically tied to the development of the Internet and how it redefined communication and publishing (
<xref rid="ref-91" ref-type="bibr">Laakso
<italic>et al.</italic>, 2011</xref>). With increased availability of Internet bandwidth, print articles have become virtually redundant, and sharing of information has never been cheaper. As a consequence, the costs per research article should have potentially decreased as a result of not investing material resources in publications printing and distribution. Therefore, widespread dissatisfaction with the expensive traditional publishing model has increased, resulting in the OA movement and concomitant innovations in scholarly publishing. A comprehensive timeline of the OA movement is provided as part of the Open Access Directory (
<ext-link ext-link-type="uri" xlink:href="http://oad.simmons.edu/oadwiki/Timeline">oad.simmons.edu/oadwiki/Timeline</ext-link>).</p><p>Interest in using the Internet for facilitating access to scientific research coalesced throughout the 1990s, culminating with the 2001 conference on "Free Online Scholarship" by the Open Society Institute in Budapest. The result of this conference was the release of the Budapest Open Access Initiative (BOAI), which is recognized as one of the defining points of the OA movement. The BOAI was the first initiative to use the term "Open Access" and articulated the following definition:</p><list list-type="simple"><list-item><label></label><p><italic>By "open access" to [peer-reviewed research literature], we mean its free availability on the public internet, permitting any users to read, download, copy, distribute, print, search, or link to the full texts of these articles, crawl them for indexing, pass them as data to software, or use them for any other lawful purpose, without financial, legal, or technical barriers other than those inseparable from gaining access to the internet itself. The only constraint on reproduction and distribution, and the only role for copyright in this domain, should be to give authors control over the integrity of their work and the right to be properly acknowledged and cited.</italic></p></list-item></list><p>This definition is broadly equivalent to the Creative Commons Attribution license (CC-BY), which is widely considered to be a standard for OA (
<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/">creativecommons.org/licenses/</ext-link>). One result of the growing OA movement is the rise of OA-only publishers, who publish exclusively digital content and have demonstrated that such a business model is financially feasible (but does not necessarily sustain the current journal ecosystem). Some of these publishers are for-profit and some are non-profit. For example, pioneer OA publishers BioMed Central (for-profit) and the Public Library of Science (PLOS) (non-profit) were founded in the early 2000s and remain successful OA publishing businesses to date. More recently, OA publishing has gained increasing momentum among researchers, funders, and governments. This has led to a proliferation of innovative approaches to publishing (e.g.,
<italic>PeerJ</italic>,
<ext-link ext-link-type="uri" xlink:href="http://peerj.com">peerj.com</ext-link>;
<italic>F1000Research</italic>,
<ext-link ext-link-type="uri" xlink:href="http://f1000research.com">f1000research.com</ext-link>;
<italic>Open Library of Humanities</italic>,
<ext-link ext-link-type="uri" xlink:href="http://openlibhums.org">openlibhums.org</ext-link>) and a range of different policies from research funders and institutes mandating OA. All of these different policies and new business models, combined with traditional publishers launching their own OA titles and programs, have made the overall OA ecosystem quite complex.</p><p>Even with this growing prevalence of publishers that facilitate OA to the scholarly literature, OA is still hardly ubiquitous.
<xref rid="ref-24" ref-type="bibr">Bjork
<italic>et al.</italic> (2009)</xref> estimated that the total number of published articles in 2006 was approximately 1,350,000. Of these, 4.6% became immediately accessible and an additional 3.5% became accessible after an embargo period of typically one year. Furthermore, usable copies of 11.3% could be found in repositories or on the author’s home pages. Since the U.S. National Institutes of Health (NIH) mandated archival of articles in the public PubMed Central repository in 2008, the cumulative number of OA articles in PMC has increased more than the number of non-OA articles (see
<xref ref-type="fig" rid="f1">Figure 1</xref>). In 2013, the total percentage of OA articles available was estimated at 24% of English-language scholarly documents accessible on the Web (
<xref rid="ref-83" ref-type="bibr">Khabsa & Giles, 2014</xref>).</p><fig fig-type="figure" id="f1" orientation="portrait" position="float"><label>Figure 1. </label><caption><title>Percentage increase in research articles in PubMed Central, relative to 2000.</title><p>Since 2004, the growth rate of OA articles is significantly higher than that of non-OA articles.</p></caption><graphic xlink:href="f1000research-5-10376-g0000"></graphic></fig><p>Although these estimates show OA is on the rise, the full potential of OA is far from achieved.
<xref rid="ref-23" ref-type="bibr">Björk
<italic>et al.</italic> (2014)</xref> pointed out that 62% of journals (from the top 100 journal publishers indexed by SCOPUS) endorse immediate Green OA self-archiving by their authors, 4% impose a 6-month embargo, and 13% impose a 12-month embargo. As such, 79% of articles published in any recent year could already be OA within 12 months after publication via Green OA, 62% of them immediately if authors were actually self-archiving properly (
<xref rid="ref-61" ref-type="bibr">Gargouri
<italic>et al.</italic>, 2010</xref>;
<xref rid="ref-62" ref-type="bibr">Gargouri
<italic>et al.</italic>, 2012</xref>). The disconnect between practice and what is allowed has three potential explanations: (i) researchers are unsure whether they have the legal right to self-archive, (ii) they fear that it might put their article’s acceptance for publication at risk, and (iii) they believe that self-archiving may be a lot of work (
<xref rid="ref-74" ref-type="bibr">Harnad, 2006</xref>). Research funders and institutions worldwide are now beginning to realize that they need to alter their conditions to make OA
<italic>mandatory</italic> (
<xref rid="ref-169" ref-type="bibr">Vincent-Lamarre
<italic>et al.</italic>, 2016</xref>) in order to counteract these misconceptions of self-archiving (
<xref rid="ref-35" ref-type="bibr">Carr
<italic>et al.</italic>, 2007</xref>;
<xref rid="ref-155" ref-type="bibr">Swan & Brown, 2005</xref>).
<xref rid="ref-155" ref-type="bibr">Swan & Brown (2005)</xref> have indicated that the vast majority of researchers (81%) would comply with mandatory OA if it were a condition of funding. On the other hand, it is worth mentioning that ensuring compliance with OA policies set by research institutions is rather difficult. Some tools, such as the
<italic>Open Access Monitor</italic> (
<ext-link ext-link-type="uri" xlink:href="http://symplectic.co.uk/elements-updates/introducing-open-access-monitor">http://symplectic.co.uk/elements-updates/introducing-open-access-monitor</ext-link>), help institutions to track compliance with their OA policy.</p><p><xref ref-type="table" rid="T1">Table 1</xref> shows a non-exhaustive summary of the developments in the advancement of scholarly publishing and the OA movement. Included are the founding of major institutions in the movement as well as policy and legal developments. Several controversial moments are included, because they have spurred action or generated awareness for the movement. One of them is the suicide of Aaron Swartz, who was arrested for downloading JSTOR articles on the grounds that he allegedly intended to make these publicly available. Another ongoing controversy is scholarly piracy; this includes the Sci-Hub and LibGen projects, which have created an online repository of pirated scholarly papers (around 50 million at the time of writing). Both projects gained increased attention after becoming the target of a lawsuit by the publisher Elsevier. There have been mixed responses to these kinds of activities, polarising the view that illegal acts regress or weaken the case for OA, while some hail the development as the ‘Napster moment’ (i.e., a change inducing disruption;
<xref rid="ref-134" ref-type="bibr">Rosenwald, 2016</xref>) for the OA movement, which will force the established industry to change. Regardless of the legality of it, Sci-Hub is used by a large number of people from all over the world to access research articles (
<xref rid="ref-28" ref-type="bibr">Bohannon, 2016</xref>;
<xref rid="ref-54" ref-type="bibr">Elbakyan & Bohannon, 2016</xref>).</p><table-wrap id="T1" orientation="portrait" position="anchor"><label>Table 1. </label><caption><title>Major historical milestones in the progress of Open Access publishing.</title></caption><table frame="hsides" rules="groups" content-type="article-table"><thead><tr><th align="left" rowspan="1" colspan="1">Y
<sc>ear</sc></th><th align="left" rowspan="1" colspan="1">M
<sc>ilestone</sc></th></tr></thead><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1">1454</td><td align="left" valign="top" rowspan="1" colspan="1">Invention of
<bold>printing</bold></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">1665</td><td align="left" valign="top" rowspan="1" colspan="1">January 5: First issue of The
<italic><bold>Journal des sçavans</bold></italic> (later spelled
<italic>Journal des savants</italic>), the earliest academic journal published
<break></break>in Europe and established by Denis de Sallo.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">1807</td><td align="left" valign="top" rowspan="1" colspan="1">25-year-old
<bold>Charles Wiley</bold> opens a small printing shop at 6 Reade Street in lower Manhattan.
</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">1842</td><td align="left" valign="top" rowspan="1" colspan="1">May 10:
<bold>Julius Springer</bold> founded what is now Springer Science+Business Media in Berlin.
</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">1848</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>John Wiley</bold> (son of Charles Wiley) gradually started shifting his focus away from literature toward scientific, technical, medical,
<break></break>and other types of nonfiction publishing.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">1880</td><td align="left" valign="top" rowspan="1" colspan="1">Foundation of
<bold>Elsevier</bold>.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">1936</td><td align="left" valign="top" rowspan="1" colspan="1">First scientific book published by
<bold>Elsevier</bold>.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">1990</td><td align="left" valign="top" rowspan="1" colspan="1">First
<bold>web page</bold>.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">1991</td><td align="left" valign="top" rowspan="1" colspan="1">An online repository of electronic preprints, known as e-prints, of scientific papers is founded in Los Alamos by the American
<break></break>physicist Paul Ginsparg. It was renamed to
<bold>ArXiv.org</bold> in 1999. The total number of submissions by May 11st, 2016 (after 24.8
<break></break>years) is 1,143,129 (
<ext-link ext-link-type="uri" xlink:href="http://arxiv.org/stats/monthly_submissions">arxiv.org/stats/monthly_submissions</ext-link>).</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">1993</td><td align="left" valign="top" rowspan="1" colspan="1">Creation of the
<bold>Open Society Institute</bold> (renamed to the Open Society Foundations [OSF] since 2001) by the progressive
<break></break>liberal business magnate George Soros. The OSF financially supports civil society groups around the world, with a stated aim
<break></break>of advancing justice, education, public health and independent media.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">1997</td><td align="left" valign="top" rowspan="1" colspan="1">Launch of
<bold>SciELO</bold> in Brazil. There are currently 14 countries in the SciELO network and its journal collections: Argentina,
<break></break>Bolivia, Brazil, Chile, Colombia, Costa Rica, Cuba, Mexico, Peru, Portugal, South Africa, Spain, Uruguay, and Venezuela.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">1998</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>Public Knowledge Project</bold> (PKP) is founded by John Willinsky in the Faculty of Education at UBC, with Pacific Press
<break></break>Professorship endowment, dedicated to improving the scholarly and public quality of research.</td></tr><tr><td rowspan="1" colspan="1"></td><td align="left" valign="top" rowspan="1" colspan="1">PKP has created the
<bold>Open Conference Systems</bold> (2000),
<bold>Open Journal Systems</bold> (2001),
<bold>Open Harvester Systems</bold> (2002)
<break></break>and the
<bold>Open Monograph Press</bold> (2013).</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2000</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>BioMed Central</bold>, the self-described first and largest OA science publisher and
<bold>PubMed Central</bold>, a free digital repository for
<break></break>biomedical and life sciences journal, is founded. In 2008, Springer announces the acquisition of BioMed Central, making it, in
<break></break>effect, the world’s largest open access publisher.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2001</td><td align="left" valign="top" rowspan="1" colspan="1">An online petition calling for all scientists to pledge that from September 2001 they would discontinue submission of papers
<break></break>to journals which did not make the full-text of their papers available to all, free and unfettered, either immediately or after a
<break></break>delay of several months is released. The petition collected 34,000 signatures but publishers took no strong response to the
<break></break>demands. Shortly thereafter, the
<bold>Public Library of Science</bold> (PLOS) was founded as an alternative to traditional publishing.
<break></break><italic>PLOS ONE</italic> is currently the world’s largest journal by number of papers published (about 30,000 a year in 2015).</td></tr><tr><td rowspan="1" colspan="1"></td><td align="left" valign="top" rowspan="1" colspan="1">December 1–2:
<bold>Conference convened in Budapest</bold> by the Open Society Institute to promote open access – at the time also
<break></break>known as Free Online Scholarship. Where the Budapest Open Access Initiative (BOAI) was born.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2002</td><td align="left" valign="top" rowspan="1" colspan="1">February 14th: Release of the
<bold>Budapest Open Access Initiative</bold> (BOAI), a public statement of principles relating to OA to the
<break></break>research literature. This small gathering of individuals is recognised as one of the major defining events of the OA movement.
<break></break>On the occasion of the 10th anniversary of the initiative, it was reaffirmed in 2012 and supplemented with a set of concrete
<break></break>recommendations for achieving "the new goal that within the next ten years, Open Access will become the default method for
<break></break>distributing new peer-reviewed research in every field and country."</td></tr><tr><td rowspan="1" colspan="1"></td><td align="left" valign="top" rowspan="1" colspan="1">Start of the Research in Health -
<bold>HINARI</bold> programme of the World Health Organization and major publishers to enable
<break></break>developing countries to access collections of biomedical and health literature online at reduced subscription costs. Together
<break></break>with Research in Agriculture -
<bold>AGORA</bold>, Research in the Environment -
<bold>OARE</bold> and Research for Development and
<break></break> Innovation -
<bold>ARDI</bold> programmes, it currently forms
<bold>Research4Life</bold> that provides developing countries with free or low cost access to
<break></break>academic and professional peer-reviewed content online.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2008</td><td align="left" valign="top" rowspan="1" colspan="1">The
<bold>National Institutes of Health</bold> (NIH) Public Access Policy, an OA mandate requiring that research papers resulting
<break></break>from NIH funding must be freely and publicly available through PubMed Central within 12 months of publication, is officially
<break></break>recorded.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2009</td><td align="left" valign="top" rowspan="1" colspan="1">The
<bold>Fair Copyright in Research Works Act</bold> (Bill H.R 801 IH, also known as the "Conyers Bill") is submitted as a direct
<break></break>response to the National Institutes of Health (NIH) Public Access Policy; intending to reverse it. The bill’s alternate name relates
<break></break>it to U.S Representative John Conyers (D-MI), who introduced it at the 111th United States Congress on February 3, 2009.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2011</td><td align="left" valign="top" rowspan="1" colspan="1">Arrest of
<bold>Aaron Swartz</bold> after he systematically downloaded articles from JSTOR, for alleged copyright infringement.</td></tr><tr><td rowspan="1" colspan="1"></td><td align="left" valign="top" rowspan="1" colspan="1">In reaction to the high cost of research papers behind paywalls,
<bold>Sci-Hub</bold>, the first known website to provide automatic
<break></break>and free, but illegal, access to paywalled academic papers on a massive scale, is founded by Alexandra Elbakyan from
<break></break>Kazakhstan.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2012</td><td align="left" valign="top" rowspan="1" colspan="1">Start of the
<bold>Academic Spring</bold>, a trend wherein academics and researchers began to oppose restrictive copyright in traditional
<break></break>academic journals and to promote free online access to scholarly articles.</td></tr><tr><td rowspan="1" colspan="1"></td><td align="left" valign="top" rowspan="1" colspan="1">Start of the
<bold>Cost of Knowledge</bold> campaign which specifically targeted Elsevier. It was initiated by a group of prominent
<break></break>mathematicians who each made a commitment to not participate in publishing in Elsevier’s journals, and currently has over
<break></break>15,933 co-signatories.</td></tr><tr><td rowspan="1" colspan="1"></td><td align="left" valign="top" rowspan="1" colspan="1">Start of the United States-based campaign
<bold>Access2Research</bold> in which open access advocates (Michael W. Carroll, Heather
<break></break>Joseph, Mike Rossner, and John Wilbanks) appealed to the United States government to require that taxpayer-funded
<break></break>research be made available to the public under open licensing. This campaign was widely successful, and the directive and
<break></break>FASTR (the Fair Access to Science and Technology Research Act) have become defining pieces in the progress of OA in the
<break></break>USA at the federal level.</td></tr><tr><td rowspan="1" colspan="1"></td><td align="left" valign="top" rowspan="1" colspan="1">Launch of
<italic><bold>PeerJ</bold></italic>, an OA journal that charges publication fees through researcher memberships, not on a per-article basis,
<break></break>resulting in what has been called "a flat fee for ’all you can publish’". Note that as of October 2015
<italic>PeerJ</italic> also have a flat rate
<break></break>APC of $695.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2013</td><td align="left" valign="top" rowspan="1" colspan="1">January: The suicide of
<bold>Aaron Swartz</bold> draws new international attention for the Open Access movement.</td></tr><tr><td rowspan="1" colspan="1"></td><td align="left" valign="top" rowspan="1" colspan="1">November:
<bold>Berlin 11 Satellite Conference</bold> for students and early career researchers, which brought together more than 70
<break></break>participants from 35 countries to engage on Open Access to scientific and scholarly research.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2014</td><td align="left" valign="top" rowspan="1" colspan="1">First
<bold>OpenCon</bold> in Washington DC, an annual conference for students and early career researchers on Open Access, Open
<break></break>Data, and Open Educational resources.</td></tr><tr><td rowspan="1" colspan="1"></td><td align="left" valign="top" rowspan="1" colspan="1">Open Access is embedded the European Commission’s
<bold>Horizon 2020</bold> Research and Innovation programme.</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2015</td><td align="left" valign="top" rowspan="1" colspan="1">Academic publisher
<bold>Elsevier</bold> makes a complaint in New York City for copyright infringement by
<bold>Sci-Hub</bold>. Sci-Hub is found
<break></break>guilty and ordered to shut down. The website re-emerges under a different domain name as a consequence. A second
<break></break>hearing in March 2016 is delayed due to failure of the defendant to appear in court, and to gather more evidence for the
<break></break>prosecution.</td></tr></tbody></table></table-wrap></sec><sec><title>The effect of Open Access upon academia</title><p>The two main ways in which OA affects academia are (i) through association with a higher documented impact of scholarly articles, as a result of availability and re-use, and (ii) through the possibility of non-restrictively allowing researchers to use automated tools to mine the scholarly literature. For the former, major arguments in favor of OA include the evidence that work that is openly available generates more academic citations, but also has more societal impact. In addition, appropriately-licensed OA works play a major role in academic education, including re-use in classes and for dissertations. The latter major argument involves non-restrictive access to the scholarly literature through appropriate licensing, making it possible to use automated tools to collect and analyze the entire body of scholarly literature in a legally sound framework and irrespective of copyright laws. The following sections cover these two effects of OA.</p><sec><title>The potential impact advantage</title><p><bold><italic>Academic impact.</italic></bold> Academic impact is frequently measured through citation counts, and these remain fundamental as the ‘currency units’ for researchers, research groups, institutes and universities.
<xref rid="ref-94" ref-type="bibr">Lawrence (2001)</xref> was the first to propose that OA would have a citation advantage. The utility and consistency of the citation advantage across different research fields has been intensively debated because its magnitude substantially varies depending on the discipline (
<xref ref-type="table" rid="T2">Table 2</xref>). However, the general tendency identified by studies to date indicates that there is at least some association between OA publishing and increased citation counts across most disciplines (
<xref rid="ref-69" ref-type="bibr">Hajjem
<italic>et al.</italic>, 2006</xref>;
<xref rid="ref-10" ref-type="bibr">Antelman, 2004</xref>) (
<xref ref-type="fig" rid="f2">Figure 2</xref> and
<xref ref-type="table" rid="T2">Table 2</xref>). A comprehensive and annotated bibliography of studies documenting potential citation impacts was created by Steve Hitchcock (
<ext-link ext-link-type="uri" xlink:href="http://eprints.soton.ac.uk/354006/1/oacitation-biblio-snapshot0613.html">eprints.soton.ac.uk/354006/1/oacitation-biblio-snapshot0613.html</ext-link>) and has been managed by SPARC Europe since 2013 (
<ext-link ext-link-type="uri" xlink:href="http://sparceurope.org/oaca/">sparceurope.org/oaca/</ext-link>).</p><table-wrap id="T2" orientation="portrait" position="anchor"><label>Table 2. </label><caption><title>Main scientific papers that have investigated and quantified the citation advantage as well as its origin.</title></caption><table frame="hsides" rules="groups" content-type="article-table"><thead><tr><th align="left" rowspan="1" colspan="1">R
<sc>eference</sc></th><th align="left" rowspan="1" colspan="1">D
<sc>iscipline</sc></th><th align="left" rowspan="1" colspan="1">C
<sc>itation advantage</sc></th><th align="left" rowspan="1" colspan="1">O
<sc>rigin</sc></th></tr></thead><tbody><tr><td rowspan="1" colspan="1"><xref rid="ref-10" ref-type="bibr">Antelman (2004)</xref></td><td rowspan="1" colspan="1">Mathematics, Electrical Engineering, Political
<break></break>Science, Philosophy</td><td rowspan="1" colspan="1">+91%, +51%, +86%, +45%
<break></break>per discipline respectively</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-12" ref-type="bibr">Atchison & Bull (2015)</xref></td><td rowspan="1" colspan="1">Political Science</td><td rowspan="1" colspan="1">Statistically significant
<break></break>citation advantage</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-39" ref-type="bibr">Cheng & Ren (2008)</xref></td><td rowspan="1" colspan="1">Medicine, Biology, Agricultural Sciences,
<break></break>Chemistry and University Journals</td><td rowspan="1" colspan="1">+200%</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-44" ref-type="bibr">Davis & Fromerth (2007)</xref></td><td rowspan="1" colspan="1">Mathematics</td><td rowspan="1" colspan="1">+35%</td><td rowspan="1" colspan="1">Quality advantage,
<break></break>no evidence of early
<break></break>advantage</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-45" ref-type="bibr">Davis
<italic>et al.</italic> (2008)</xref></td><td rowspan="1" colspan="1">Physiology</td><td rowspan="1" colspan="1">-5%</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-46" ref-type="bibr">Davis (2011)</xref></td><td rowspan="1" colspan="1">Sciences, Social Sciences, and Humanities</td><td rowspan="1" colspan="1">+1% but statistically
<break></break>indistinguishable</td><td rowspan="1" colspan="1">No evidence of an early
<break></break>advantage</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-56" ref-type="bibr">Evans & Reimer (2009)</xref></td><td rowspan="1" colspan="1">All</td><td rowspan="1" colspan="1">+8% for newly published
<break></break>articles; +16% for citations
<break></break>from developing countries</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-58" ref-type="bibr">Eysenbach (2006)</xref></td><td rowspan="1" colspan="1">Natural Sciences</td><td rowspan="1" colspan="1">+210 up to +290%</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-60" ref-type="bibr">Frandsen (2009)</xref></td><td rowspan="1" colspan="1">Biology, Mathematics, Pharmacy and
<break></break>Pharmacology</td><td rowspan="1" colspan="1">No clear tendency towards
<break></break>an increase in impact</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-61" ref-type="bibr">Gargouri
<italic>et al.</italic> (2010)</xref></td><td rowspan="1" colspan="1">Engineering, Biology, Biomedicine, Chemistry,
<break></break>Psychology, Mathematics, Clinical Medicine,
<break></break>Health, Physics, Social Science, Earth Sciences</td><td rowspan="1" colspan="1">+?% to ?% depending on the
<break></break>discipline</td><td rowspan="1" colspan="1">Quality advantage is
<break></break>confirmed no evidence
<break></break>for selection bias</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-63" ref-type="bibr">Gaule & Maystre (2011)</xref></td><td rowspan="1" colspan="1">Biology</td><td rowspan="1" colspan="1">No evidence of citation
<break></break>advantage</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-64" ref-type="bibr">Gentil-Beccot
<italic>et al.</italic> (2010)</xref></td><td rowspan="1" colspan="1">High Energy Physics</td><td rowspan="1" colspan="1">+200%</td><td rowspan="1" colspan="1">Early advantage
<break></break>confirmed</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-69" ref-type="bibr">Hajjem
<italic>et al.</italic> (2006)</xref></td><td rowspan="1" colspan="1">Biology, Psychology, Sociology, Health, Political
<break></break>Science, Economics, Education, Law, Business,
<break></break>Management</td><td rowspan="1" colspan="1">+36% to 172%</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-73" ref-type="bibr">Harnad & Brody (2004)</xref></td><td rowspan="1" colspan="1">Physics</td><td rowspan="1" colspan="1">+250% to 580%</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-75" ref-type="bibr">Henneken
<italic>et al.</italic> (2006)</xref></td><td rowspan="1" colspan="1">Astronomy and Physics</td><td rowspan="1" colspan="1">+200%</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-86" ref-type="bibr">Kousha & Abdoli (2010)</xref></td><td rowspan="1" colspan="1">Agricultural Science</td><td rowspan="1" colspan="1">+621% but not to every
<break></break>journal</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-88" ref-type="bibr">Kurtz
<italic>et al.</italic> (2005)</xref></td><td rowspan="1" colspan="1">Astronomy</td><td rowspan="1" colspan="1">None</td><td rowspan="1" colspan="1">Selection bias and early
<break></break>advantage</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-89" ref-type="bibr">Kurtz & Henneken (2007)</xref></td><td rowspan="1" colspan="1">Astronomy</td><td rowspan="1" colspan="1">+200%</td><td rowspan="1" colspan="1">Early advantage
<break></break>confirmed</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-92" ref-type="bibr">Lansingh & Carter (2009)</xref></td><td rowspan="1" colspan="1">Opthalmology</td><td rowspan="1" colspan="1">No</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-94" ref-type="bibr">Lawrence (2001)</xref></td><td rowspan="1" colspan="1">Computer Science</td><td rowspan="1" colspan="1">+157% up to +284% for top
<break></break>publication</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-106" ref-type="bibr">McCabe & Snyder (2014)</xref></td><td rowspan="1" colspan="1">Ecology, Botany, Multidisciplinary Science and
<break></break>Biology</td><td rowspan="1" colspan="1">+8%</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-110" ref-type="bibr">McVeigh (2004)</xref></td><td rowspan="1" colspan="1">Natural Sciences</td><td rowspan="1" colspan="1">0-+50% in 2003 depending
<break></break>on field, negative citation
<break></break>advantage in 2000</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-112" ref-type="bibr">Metcalfe (2005)</xref></td><td rowspan="1" colspan="1">Astronomy</td><td rowspan="1" colspan="1">+200%</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-111" ref-type="bibr">Metcalfe (2006)</xref></td><td rowspan="1" colspan="1">Solar Physics</td><td rowspan="1" colspan="1">+170% and +260%
<break></break>depending on the online
<break></break>repository</td><td rowspan="1" colspan="1">No evidence for
<break></break>selection bias</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-113" ref-type="bibr">Moed (2006)</xref></td><td rowspan="1" colspan="1">Condensed Matter Physics</td><td rowspan="1" colspan="1">NA</td><td rowspan="1" colspan="1">Confirm early access
<break></break>advantage and
<break></break>selection bias but no
<break></break>OA effect</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-118" ref-type="bibr">Norris
<italic>et al.</italic> (2008)</xref></td><td rowspan="1" colspan="1">Ecology, Applied Mathematics, Sociology and
<break></break>Economics</td><td rowspan="1" colspan="1">+157%</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-135" ref-type="bibr">Sahu
<italic>et al.</italic> (2005)</xref></td><td rowspan="1" colspan="1">Medicine</td><td rowspan="1" colspan="1">+300% up to +450%</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-142" ref-type="bibr">Schwarz & Kennicutt Jr</xref><break></break><xref rid="ref-142" ref-type="bibr">(2004)</xref></td><td rowspan="1" colspan="1">Astronomy</td><td rowspan="1" colspan="1">+200%</td><td rowspan="1" colspan="1">Early advantage</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-166" ref-type="bibr">Vanclay (2013)</xref></td><td rowspan="1" colspan="1">Environmental Science</td><td rowspan="1" colspan="1">Not significant</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-173" ref-type="bibr">Wang
<italic>et al.</italic> (2015)</xref></td><td rowspan="1" colspan="1">All</td><td rowspan="1" colspan="1">+111% up to 152%</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-179" ref-type="bibr">Wohlrabe & Birkmeier</xref><break></break><xref rid="ref-179" ref-type="bibr">(2014)</xref></td><td rowspan="1" colspan="1">Economics</td><td rowspan="1" colspan="1">+35% up to 64% depending on
<break></break>the database used</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-182" ref-type="bibr">Xu
<italic>et al.</italic> (2011)</xref></td><td rowspan="1" colspan="1">Humanities, Life Sciences, Mathematics & Physical
<break></break>Science, Medicine, Social Sciences</td><td rowspan="1" colspan="1">-49.24%-+87.73%</td><td rowspan="1" colspan="1">NA</td></tr><tr><td rowspan="1" colspan="1"><xref rid="ref-183" ref-type="bibr">Zhang (2006)</xref></td><td rowspan="1" colspan="1">Communication Studies</td><td rowspan="1" colspan="1">+200%</td><td rowspan="1" colspan="1">NA</td></tr></tbody></table></table-wrap><fig fig-type="figure" id="f2" orientation="portrait" position="float"><label>Figure 2. </label><caption><title>Studies that investigated the citation advantage grouped by their conclusion.</title><p>The majority concluded that there is a significant citation advantage for Open Access articles. Source: Data from The Open Access Citation Advantage Service, SPARC Europe, accessed March 2016.</p></caption><graphic xlink:href="f1000research-5-10376-g0001"></graphic></fig><p>Estimates for the open citation advantage range from +36% (Biology) to +600% (Agricultural Sciences) (
<xref rid="ref-156" ref-type="bibr">Swan, 2010</xref>;
<xref rid="ref-171" ref-type="bibr">Wagner, 2010</xref>). In a longitudinal study,
<xref rid="ref-58" ref-type="bibr">Eysenbach (2006)</xref> compared the bibliometric impact of a cohort of articles from a multi-disciplinary journal (
<italic>Proceedings of the National Academy of Sciences</italic>) that offers both OA and non-OA publishing options. After adjusting for potentially confounding variables, the results indicated that non-OA papers were twice as likely to remain uncited six months after publication when compared to OA articles. Additionally, the average number of citations for OA articles was more than double than that of the non-OA articles. The study also differentiated the type of OA article, namely the self-archived (i.e., Green OA) and the publisher version of record (VOR) that is freely available (i.e., Gold OA). Gold OA was found to have a higher overall academic impact than Green OA.</p><p>Despite strong evidence for a citation advantage, the magnitude of this advantage remains variable. The substantial heterogeneity in observed citation advantages can be due to different academic cultures or could simply be spurious. For example, self-archiving prior to publication is a community standard in fields such as high energy physics or mathematics, but has yet to be widely adopted among the life sciences. Such ‘pre-prints’ have also been associated with an overall increase in the average number of citations, the total number of citations, and the speed of citation accumulation (
<xref rid="ref-7" ref-type="bibr">Aman, 2014</xref>;
<xref rid="ref-64" ref-type="bibr">Gentil-Beccot
<italic>et al.</italic>, 2010</xref>). Other studies could only replicate immense citation advantages (+600%) if relevant predictors were omitted (
<xref rid="ref-106" ref-type="bibr">McCabe & Snyder, 2014</xref>), which indicates a potential spurious effect. When taking into account these relevant predictors, the citation advantage became much smaller (+8%). When the citation advantage is low or non-existent, this could suggest that in those research fields there is a sufficient level of access to the literature such that OA confers no localised access advantage, or that adoption of OA has not yet reached a level where any such advantage has become statistically evident.</p><p>One alternative explanation for the existence of citation advantages could be that researchers choose to publish OA when a finding is more impactful, but empirical evidence contradicts this selection effect.
<xref rid="ref-61" ref-type="bibr">Gargouri
<italic>et al.</italic> (2010)</xref> compared citation counts for articles which were self-selected as OA or mandated as OA (e.g., by funders). The study concluded that both were cited significantly more than non-OA articles and showed no differences in citation rates. As such, these findings rule out a selection bias from authors as the cause for the citation advantage (
<xref rid="ref-61" ref-type="bibr">Gargouri
<italic>et al.</italic>, 2010</xref>). However, research that is selected to merit funding by funding agencies may, in itself, be perceived to be more impactful than research that is not funded. Additionally, as no single OA mandate is ever 100% effective, it might be the simple case that authors are more likely to comply with a mandate for the research they perceive to be of higher impact. In a study of articles in the field of psychology,
<xref rid="ref-8" ref-type="bibr">Anderson (2013a)</xref> found that publications with funding sources reported in the text were found to be more highly cited and connected to other highly-cited publications (this type of publication is called "generative" in the study) than publications with no reported funding sources. Furthermore, research that was privately funded was found to be more generative than publicly funded research. In a similar study in the Library and Information Sciences field done by
<xref rid="ref-184" ref-type="bibr">Zhao (2010)</xref>, the citation counts for grant-funded publications were "substantially higher" than publications without grant funding. Although these studies indicate that grant funding is correlated with increased citation rates, the openness of articles was not addressed in either study. Future research will be required to demarcate the potential causality and to determine the conditions under which we could see whether or not OA has an effect on citation counts. For example, this could be conducted through a randomised controlled trial in which research articles from a particular funder are randomly assigned to OA and non-OA routes, with the citation counts assessed after a certain time.</p><p>In sum, evidence indicates that OA is broadly related to increased academic impact in terms of citations (
<xref ref-type="fig" rid="f2">Figure 2</xref>; see also
<xref rid="ref-109" ref-type="bibr">McKiernan
<italic>et al.</italic> (2016)</xref>), but given the large variability in results, further research should aim to synthesize these findings in a meta-analysis and try to explain the cause of this variability.</p><p><bold><italic>Broader societal impact.</italic></bold> Scholarly articles also have a societal impact, such as when they are covered in news media or are discussed in social media channels; alternative metrics, or altmetrics, can be used as a guide to measure this mode of impact (
<xref rid="ref-99" ref-type="bibr">Liang
<italic>et al.</italic>, 2014</xref>). Information such as social media usage, Mendeley readership, and media attention (
<xref rid="ref-127" ref-type="bibr">Piwowar, 2013</xref>) can be tracked by various altmetrics providers (e.g. ImpactStory, Plum Analytics, and Altmetric.com). As such, when an article generates discussions outside of the academic literature, altmetrics are capable of tracking this. Despite limitations (such as academics discussing their own research on platforms like Twitter), altmetrics provide a general view of the wider societal impact of research articles. Considering the increased pressure on researchers and research institutes to communicate research findings to the public, altmetrics can provide additional insight into which research drives public interest. A working group established by NISO is investigating the future role of altmetrics in research communication and assessment (
<ext-link ext-link-type="uri" xlink:href="http://www.niso.org/topics/tl/altmetrics_initiative/">www.niso.org/topics/tl/altmetrics_initiative/</ext-link>).</p><p>OA articles would be expected to have an altmetrics advantage compared to the non-OA literature; if an article has fewer restrictions for journalists, citizens, businesses, and policy-makers, it seems logical that this would enable the research to be publicly re-used. Furthermore, those parties may be more likely to promote articles which are publicly accessible into different communication channels. In other words, increased access removes barriers to widespread societal engagement, whereas a relative lack of article access discourages engagement.</p><p>There is research showing evidence for an altmetrics advantage for OA articles, but this does not reflect itself in the most impactful articles.
<xref rid="ref-173" ref-type="bibr">Wang
<italic>et al.</italic> (2015)</xref> found evidence that OA articles receive more attention through social media. The authors compared social media attention (Twitter and Facebook) between OA and non-OA articles at
<italic>Nature Communications</italic> and found that OA articles get 1.2–1.48 times as much social media attention as compared to non-OA articles (see also
<xref rid="ref-3" ref-type="bibr">Adie, 2014</xref>). Nonetheless, of the top 100 articles of 2015 as presented by Altmetric.com, only 42 articles were OA (
<ext-link ext-link-type="uri" xlink:href="http://www.altmetric.com/top100/2015/">www.altmetric.com/top100/2015/</ext-link>). This 42% is larger than the overall proportion of OA articles in the literature, which indicates that OA contributes relatively more impact per paper. However, it also indicates that the open impact advantage can be overshadowed by the intrinsic nature of the research published or by the traditionally prestigious journals with a larger and dedicated media apparatus (e.g., Nature, Science;
<xref rid="ref-30" ref-type="bibr">Brembs
<italic>et al.</italic>, 2013</xref>).</p><p><xref rid="ref-4" ref-type="bibr">Allen
<italic>et al.</italic> (2013)</xref> found that a social media announcement of the release of a research article increases the number of users who view or download that article, but does not translate to increases in the citation count in the field of clinical pain research.
<xref rid="ref-41" ref-type="bibr">Costas
<italic>et al.</italic> (2015)</xref> found a relatively weak correlation between social media activity and citation counts for the articles in their sample (over 1.5 million article records), while
<xref rid="ref-114" ref-type="bibr">Mohammadi
<italic>et al.</italic> (2015)</xref> found that the number of Mendeley readers with a status of graduate student or faculty correlated with citation counts. When OA to the articles is factored into an analysis, there is a potential recursive relation between citation counts and altmetrics due to OA.
<xref rid="ref-57" ref-type="bibr">Eysenbach (2011)</xref> indicated that there is a moderate correlation (0.42–0.72) between the tweets and citations of articles from an OA journal (
<italic>Journal of Medical Internet Research</italic>). Highly tweeted articles were eleven times more likely to be highly cited than less-tweeted articles, or vice versa (75% of highly tweeted articles were highly cited; 7% of less-tweeted articles were highly cited). However, it is difficult to assess causality in these cases: do research papers that have more academic impact make their way more frequently into societal discussions, or does online discourse increase their potential citation rates? Overall, this evidence implies that there is a general media advantage with OA (see also
<xref rid="ref-109" ref-type="bibr">McKiernan
<italic>et al.</italic> (2016)</xref>), which can be used as a proxy or pathway to indicate greater societal impact.</p><p>Altmetrics themselves should not be conflated with citations when it comes to assessing impact, even though some providers such as Altmetric.com supply a single score that can be used to rank an article in a similar way to a journal’s Impact Factor. Each measure of altmetrics tells a different story about the impact of research, and a careful understanding of the altmetrics landscape in conjunction with citation-based metrics can lead to a clearer picture of societal impact of scientific research.</p></sec><sec><title>Open Access and text- and data-mining</title><p>Traditionally, in order to publish a paper, researchers hand over their copyright via a Copyright Transfer Agreement. Copyright transfer as the default has far-reaching consequences on the ability of both the authors and others to re-use that published research, and many authors are not aware of the impact of these transfers on their ownership of the work. Academics frequently give the copyright to the publishers in exchange for the perceived prestige of publishing in one of their venues (e.g.,
<xref rid="ref-115" ref-type="bibr">Müller-Langer & Watt, 2010</xref>). In some cases, institutes adopt rights-retention OA policies that grant authors non-exclusive rights to their institutes before signing copyright agreements with publishers, which enables them to make articles OA without requiring permission from publishers (
<ext-link ext-link-type="uri" xlink:href="http://cyber.law.harvard.edu/hoap/Good_practices_for_university_open-access_policies">cyber.law.harvard.edu/hoap/Good_practices_for_university_open-access_policies</ext-link>). Essentially, copyright is a pre-digital tool wielded by traditional publishers to maintain revenues rather than fostering creativity, innovation, or protecting authors (
<xref rid="ref-123" ref-type="bibr">Okerson, 1991</xref>;
<xref rid="ref-177" ref-type="bibr">Willinsky, 2002</xref>). For example, the Author’s Guild sued Google Books for copyright infringement because they provided freely available digital copies; the court rejected this suit in 2016, stating that Google Books served the public interest and that copyright’s "primary intended beneficiary is the public" (
<xref rid="ref-52" ref-type="bibr">EFF, 2015</xref>). In the digital age, copying is essential to perform necessary research tasks. These activities range from viewing the article (i.e., downloading requires copying) to re-using figures from an article in a book. The interaction of OA and copyright is complex and deserves extended research in itself (e.g.,
<xref rid="ref-137" ref-type="bibr">Scheufen, 2015</xref>). We will highlight how OA views copyright and relate this to its effects on text- and data-mining (TDM).</p><p>The majority of ‘born OA’ journals and publishers do not request or receive copyright from authors. Instead, publishers are granted non-exclusive rights to publish, and copyright is retained by authors through a Creative Commons license (typically CC-BY). Importantly, this represents a power shift from publisher-owned to author-owned rights to research. This model of author-retained copyright appears to be favoured by the majority (71%) of the research community (
<xref rid="ref-77" ref-type="bibr">Hoorn & van der Graaf, 2006</xref>). Shifting copyright to stay with the author, combined with appropriate open licensing, allows for wider re-use, including TDM, and forms the basis for a robust scholarly ecosystem.</p><p>As such, copyright in OA publications is non-restrictive and also allows machines to freely access it. In traditional publishing, human reading and computer reading are seen as two separate things which require different agreements, whereas OA publishing views them both in the same, non-restrictive manner. In other words, in order to mine OA journals, one only needs the technical skills to do so. In order to mine closed access journals, one needs to sign or negotiate access conditions, even if legitimate access to the articles has already been bought (
<xref rid="ref-25" ref-type="bibr">Bloudoff-Indelicato, 2015</xref>).</p><p>Automated extraction of information from scholarly research via TDM is a methodology that can be applied to investigate the scholarly literature at an enormous scale, creating new knowledge by combining individual findings. This has already proven to be useful for a large variety of applications (e.g.,
<xref rid="ref-66" ref-type="bibr">Glenisson
<italic>et al.</italic>, 2005</xref>;
<xref rid="ref-103" ref-type="bibr">Martone
<italic>et al.</italic>, 2016</xref>;
<xref rid="ref-157" ref-type="bibr">Swanson, 1987</xref>). Moreover, OA publishers facilitate TDM on a massive scale by allowing multiple options for collecting the literature needed. For example, PLOS is non-restrictive and allows users to scrape articles directly from the website or using its API. As a result, scraping tools can be used, such as
<monospace>rplos</monospace>, an R package developed to search and download full-text scholarly papers (
<xref rid="ref-36" ref-type="bibr">Chamberlain
<italic>et al.</italic>, 2016</xref>).</p><p>TDM is not only a knowledge-generation tool; it also allows for automated screening for errors and automated literature searches that renew scientific discovery. With TDM it becomes possible to easily compare one’s results with those of the published literature, identify convergence of evidence and enable knowledge discovery (
<xref rid="ref-116" ref-type="bibr">Natarajan
<italic>et al.</italic>, 2006</xref>) or discover frequent tentative hypotheses that can be used for new research (
<xref rid="ref-101" ref-type="bibr">Malhotra
<italic>et al.</italic>, 2013</xref>). It has already been used to make major advances in fields such as biomedicine (
<xref rid="ref-68" ref-type="bibr">Gonzalez
<italic>et al.</italic>, 2016</xref>). TDM also allows for computer applications that can download all scholarly literature given certain search terms (e.g., ContentMine’s
<monospace>getpapers</monospace> tool ;
<ext-link ext-link-type="uri" xlink:href="http://github.com/ContentMine/getpapers">github.com/ContentMine/getpapers</ext-link>), simplifying and shortening the tedious literature search. TDM can also serve a screening purpose similar to plagiarism scanners, helping to detect statistical errors in the scholarly literature (e.g.,
<xref rid="ref-120" ref-type="bibr">Nuijten
<italic>et al.</italic> (2015)</xref>). TDM can be used in various innovative ways and is an emerging and rapidly advancing field; non-restrictive licensing through OA certainly promotes its wider application.</p><p>Given the exponential increase in the number of scholarly publications, (semi-)automated methods to synthesize results have become increasingly important. TDM decreases the time dedicated to the search for relevant information in scholarly literature by categorizing information (
<xref rid="ref-98" ref-type="bibr">Leitner & Valencia, 2008</xref>), highlighting and annotating relevant results to specific users (
<xref rid="ref-143" ref-type="bibr">Shatkay
<italic>et al.</italic>, 2008</xref>), and profiling research (
<xref rid="ref-131" ref-type="bibr">Porter
<italic>et al.</italic>, 2002</xref>). Furthermore, TDM also prevents researchers and readers from wasting time on reinventing the wheel, simply because one can no longer keep up with the huge amount of published literature available (
<xref rid="ref-71" ref-type="bibr">Harmston
<italic>et al.</italic>, 2010</xref>).</p><p>Because of traditional copyright transfers, TDM has often been stymied by traditional, closed access publishers who frequently see it as a copyright infringement. Researchers using software that harvests data from online publications have been (threatened to be) cut off from accessing the articles. These researchers found themselves trapped in negotiations to resume their research (even though their universities had paid subscription fees for access (e.g.,
<xref rid="ref-25" ref-type="bibr">Bloudoff-Indelicato, 2015</xref>;
<xref rid="ref-164" ref-type="bibr">Van Noorden, 2012</xref>)). Standard subscriptions do not permit systematic downloads because publishers fear that their content might be stolen and their revenue therefore lost (
<xref rid="ref-164" ref-type="bibr">Van Noorden, 2012</xref>). In 2014, Elsevier opened its papers for TDM via a proprietary API (
<xref rid="ref-162" ref-type="bibr">Van Noorden, 2014</xref>), but placed restrictions on the researchers using it; however, researchers are not legally required to comply with these restrictions in some countries (e.g., U.K., U.S.A.,
<xref rid="ref-70" ref-type="bibr">Handke
<italic>et al.</italic>, 2015</xref>).</p><p>To make the enormous corpus of closed access papers retrospectively available to the public might be possible through legal action at an institutional or governmental level. The Dutch Government, for example, has recognized OA as a right, with Dutch citizens capable to make their scientific publications free to access after a ‘reasonable period of time’ (
<xref rid="ref-124" ref-type="bibr">Open Access NL, 2015</xref>). Such steps are further supported by
<xref rid="ref-144" ref-type="bibr">Shavell (2010)</xref> and
<xref rid="ref-53" ref-type="bibr">Eger & Scheufen (2012)</xref> who ascertained that transition towards an OA model could not be smooth without first undertaking the necessary legislative steps. The position of institutes regarding copyright transfer remains generally unclear. While academics themselves may have little power in broader debates regarding copyright, institutes could claim ownership of the work by invoking their rights under the work made-for-hire doctrine (
<xref rid="ref-47" ref-type="bibr">Denicola, 2006</xref>). However, OA policies at universities generally use a system of non-exclusive rights, presupposing that faculty are the owners of their work and can grant non-exclusive rights to the university for use (for examples of approaches and language used when drafting OA policies, see (
<xref rid="ref-146" ref-type="bibr">Shieber & Suber, 2016</xref>)). Importantly, this means that OA through the ‘Green’ route does not always depend on permission from publishers, and increasingly is becoming dependent on rights retention by authors, through carefully-drafted and widely-supported university policies. While these are positive steps towards making research available for TDM, in light of the potential copyright problems for closed access articles and the fact that not all research is available through institutional Open Access policies, TDM will be easier and legally safer for OA journals. As a consequence, TDM is likely to be more readily applied to OA literature when compared to closed access literature.</p></sec></sec><sec><title>The economic impact of Open Access</title><sec><title>The effect on publishers</title><p>Any publisher has to cover operating costs, which are primarily made of (i) article processing charges (APCs), (ii) management and investment costs, and (iii) other costs. Article processing includes editing, proofreading and typesetting, among other things. Management and investment are instead the marginal costs needed to establish and keep the journal running. Other costs include promoting the journal, hosting and infrastructural services, sponsoring conferences, and other services that are extrinsic to research articles themselves. The average production cost for a single research article is estimated to be around $3500–$4000 (
<xref rid="ref-163" ref-type="bibr">Van Noorden, 2013</xref>) but these costs are highly depending on the publisher. For example, Philip Campbell (Editor-in-Chief of
<italic>Nature</italic>) stated that his journal’s internal costs were at $20,000–$30,000 per paper (
<xref rid="ref-163" ref-type="bibr">Van Noorden, 2013</xref>), due in part to the high selectivity and rejection rate at
<italic>Nature</italic> (i.e., this is an average cost per published paper, and not the production costs associated with publishing a single accepted paper). However, these are at the high end of the cost spectrum, with other journals, such as the
<italic>Journal of Machine Learning Research</italic> (JMLR) costing between $6.50–$10 per article (
<ext-link ext-link-type="uri" xlink:href="http://blogs.harvard.edu/pamphlet/2012/03/06/an-efficient-journal/">blogs.harvard.edu/pamphlet/2012/03/06/anefficient-journal/</ext-link>). Other publishers are completely transparent about their direct and indirect production costs, such as Ubiquity Press, which levies an APCs of $500 (
<ext-link ext-link-type="uri" xlink:href="http://ubiquitypress.com/site/publish/">ubiquitypress.com/site/publish/</ext-link>). One possible reason for such variation between journals and publishers is that it is generally unclear whether proposed costs relate to those directly involved in article processing or those required in order for a publisher to ‘break even’ if they receive zero subscription income for an article made OA.</p><p>In order to cover those costs and make a profit, closed access publishers charge for access via subscriptions, whereas many OA publishers or journals charge to publish. Due to increased subscription costs, closed access publishing is becoming an increasingly unsustainable business model (
<xref rid="ref-122" ref-type="bibr">Odlyzko, 2013</xref>) with prices estimated to have outpaced inflation at 250% in the past thirty years (
<ext-link ext-link-type="uri" xlink:href="http://www.eff.org/issues/open-access">www.eff.org/issues/open-access</ext-link>). This will slowly but surely diminish the scope of access to the scholarly literature as fewer organisations are able to pay such high costs. Only recently has any transparency into the detailed costs of subscriptions been gained by using Freedom of Information Requests to bypass non-disclosure agreements between libraries and publishers (
<xref rid="ref-18" ref-type="bibr">Bergstrom
<italic>et al.</italic>, 2014</xref>;
<xref rid="ref-95" ref-type="bibr">Lawson & Meghreblian, 2015</xref>). These requests provide the basis for understanding the economics of scholarly communication. For example,
<xref rid="ref-18" ref-type="bibr">Bergstrom
<italic>et al.</italic> (2014)</xref> found that commercial publishers, including Emerald, Sage, and Taylor and Francis, have prices of ten times the amount of non-profit publishers per citation for PhD-granting institutions. Two potential ways to prevent future retention of an unsustainable model is through decreasing the subscription prices, thereby lowering publishers’ profit margins and the financial burden on subscribers, or through switching to new OA-oriented business models and creating new value. Either way, price transparency will be essential for future bargaining efforts between academic libraries and publishers, and will be of interest to those involved in public policy and scholarly publishing. The concept of transitioning from a subscription-based model to one driven by APCs will be financially appealing to journals that operate with minimal profits or at a loss, and can be a pathway to achieve financial security and long-term journal sustainability. As such, increasing revenues is a strong incentive for OA (
<ext-link ext-link-type="uri" xlink:href="http://osc.hul.harvard.edu/programs/journal-flipping/public-consultation/4/6/">osc.hul.harvard.edu/programs/journal-flipping/public-consultation/4/6/</ext-link>, accessed 26/04/2016).</p><p>OA publishing has become associated with a ‘pay-to-publish’ model, whereas around 70% of peer-reviewed OA journals do not charge APCs, according to data from the Directory of Open Access Journals (DOAJ) (see
<ext-link ext-link-type="uri" xlink:href="http://blogs.harvard.edu/pamphlet/2009/05/29/what-percentage-of-open-access-journals-charge-publication-fees/">blogs.harvard.edu/pamphlet/2009/05/29/what-percentage-of-open-access-journals-charge-publication-fees/</ext-link> and
<ext-link ext-link-type="uri" xlink:href="http://citesandinsights.info/civ16i4.pdf">citesandinsights.info/civ16i4.pdf</ext-link>). However, approximately 50% of all articles published in peer-reviewed OA journals are published in APC-based venues (
<xref rid="ref-42" ref-type="bibr">Crawford, 2015</xref>;
<xref rid="ref-90" ref-type="bibr">Laakso & Björk, 2012</xref>;
<xref rid="ref-172" ref-type="bibr">Walters & Linvill, 2011</xref>). Authors paying to publish can be viewed as a fundamental conflict of interest for researchers. Nonetheless, this payment model has proven itself to function properly when editorial decisions are separated from the business-side of the publisher (i.e., editorial independence), removing the problem of ‘publication-bribery’. Additionally, many journals have always levied charges for to cover the costs of publishing regardless of OA; for example,
<italic>PNAS</italic> charges $1225 per regular research article (with an additional $1350 for OA;
<ext-link ext-link-type="uri" xlink:href="http://pnas.org/site/authors/fees.xhtml">pnas.org/site/authors/fees.xhtml</ext-link>), and
<italic>Cell</italic> charges $1000 for the first colour figure and $275 for each subsequent one (
<ext-link ext-link-type="uri" xlink:href="http://cell.com/cell/authors">cell.com/cell/authors</ext-link>; as of April 2016). Therefore, equating OA with ‘pay-to-publish’ is actually a bit of a misnomer, as several closed journals charge to publish and many open journals do not. Furthermore, many publishers (e.g.,
<italic>PLOS</italic>,
<italic>PeerJ</italic>), as well as many learned societies, operate fee waiver schemes for researchers unable to obtain funds to cover publication fees.</p><p>For those OA publishers implementing a pay-to-publish model, around 68.8% of publishers offer fee waivers to low- and middle-income countries (
<xref rid="ref-96" ref-type="bibr">Lawson, 2015</xref>), while other journals offer fee discounts often given in lieu of total fee waivers.
<xref rid="ref-148" ref-type="bibr">Solomon & Björk (2012) </xref> investigated the sources of funding used by authors for APCs, indicating that these are highly variable across academic disciplines. For example, while 45.5% of authors in Health Sciences, Biology and Life Sciences use grant or contract funding as source for APCs, only 10.4% use this in Business and Economics, with 45.8% coming from personal funds. Other sources include national funding bodies, and discretionary funds administered by institutions, as well as institutional funds specifically in place to support OA policies (see also
<xref rid="ref-43" ref-type="bibr">Dallmeier-Tiessen
<italic>et al.</italic>, 2011</xref>). Sources for APCs are also highly variable depending on the per capital GNP of the authors’ country, as well as the size of the APC (
<xref rid="ref-148" ref-type="bibr">Solomon & Björk, 2012</xref>). According to
<xref rid="ref-100" ref-type="bibr">MacKie-Mason (2016)</xref>, one potential outcome of authors seeing the price of APCs and securing funding for them is that authors may begin to take the price of APCs into account (in addition to other factors such as prestige and topic) when selecting a journal for their research output, which may drive market competition and could as a consequence lower the price of APCs. However, a potential negative consequence of an increasingly APC-driven model of OA is that some researchers may struggle to procure funds in order to publish and conform to mandates at different levels. This might impact early-career researchers and those working in fields were research grants and publishing fees are more difficult to obtain.</p><p>Subscription-based publishers still frequently produce print versions of their journals, which increases production costs, potentially to justify charging for readership or to satisfy a small demographic who prefers this mode of reading. After all, subscriptions to print journals make sense and, if large-scale printing is still in place, simply transferring this idea to the digital versions creates continuity. Print versions are accompanied by logistical costs to print and ship each issue, but these are partially offset with reprint orders, additional charges for colour figures, and print-based advertising. For some of the largest subscription-oriented publishers the annual net profit on investment reaches up to 40 percent, which makes academic journal publishing highly lucrative for investors (
<xref rid="ref-136" ref-type="bibr">Satyanarayana, 2013</xref>), further increases investment to sustain this type of publishing model, and allows maintenance of an oligopoly (
<xref rid="ref-93" ref-type="bibr">Larivière
<italic>et al.</italic>, 2015</xref>).</p><p>OA publishers only publish digitally and have opened up avenues for innovation. For example,
<italic>PeerJ</italic> has introduced a wholly different OA business model, where readers pay nothing to access articles, but authors pay a membership fee once to publish for a lifetime. The Open Library of Humanities (OLH) is another innovative business model in which libraries pay a small fee to support OLH and scholars are able to publish for free (subscription for publishing rather than subscription for access); this support also enables the OLH to help journals transition from a subscription model to OA (for example, the recent case of
<italic>Lingua</italic>;
<ext-link ext-link-type="uri" xlink:href="http://timeshighereducation.com/research-intelligence/open-library-humanities-aims-flip-journals-open-access">timeshighereducation.com/research-intelligence/open-library-humanities-aims-flip-journals-open-access</ext-link>). Library publishing has also developed in response to the OA movement; in this model, academic libraries begin publishing operations in the interest of providing added value to their patrons and contributing to the growth of knowledge (
<ext-link ext-link-type="uri" xlink:href="http://librarypublishing.org">librarypublishing.org</ext-link>). In terms of innovating in the publishing platform itself,
<italic>eLife</italic> have introduced the Lens as a novel way of viewing research articles online (
<ext-link ext-link-type="uri" xlink:href="http://lens.elifesciences.org/about/">lens.elifesciences.org/about/</ext-link>), and
<italic>F1000Research</italic> has introduced so-called ‘living figures’ to enable researchers to interact with data underlying research findings (e.g.,
<xref rid="ref-40" ref-type="bibr">Colomb & Brembs, 2015</xref>).</p><p>With this innovation comes massive scope for reducing the costs associated with publishing through implementing more efficient procedures. In this case, costs are reduced by eliminating the need for type-setting and copy-editing, with web-hosting costing only $15/year, and a total operating cost of between $6.50–$10.50 per article. Other platforms such as ARPHA offer an end-to-end XML-based publishing service, utilised by publishers including Pensoft, with a more efficient and integrated publishing workflow, which should highlight and reduce the real costs of publishing. In addition, OA has the potential to increase the speed of publication, as seen in journals like
<italic>eLife</italic> and
<italic>PeerJ</italic> (
<ext-link ext-link-type="uri" xlink:href="http://blog.dhimmel.com/plos-and-publishing-delays/">blog.dhimmel.com/plos-and-publishing-delays/</ext-link>), which combined with ‘pre-print’ servers like
<italic>biorXiv</italic> and platforms that offer post-publication peer review like
<italic>Research Ideas and Outcomes</italic> (
<ext-link ext-link-type="uri" xlink:href="http://riojournal.com/">riojournal.com/</ext-link>),
<italic>F1000 Research</italic>, and
<italic>ScienceOpen</italic> (
<ext-link ext-link-type="uri" xlink:href="http://www.scienceopen.com/">www.scienceopen.com/</ext-link>), can exceptionally accelerate the speed of research communication. Such innovations add value to the research communication process (contrary to services such as paying to print colour figures) and represent just several cases of innovation across the publishing ecosystem. One can imagine that publishing costs in OA journals become dependent on the value added on a per-article basis, which can help reshape and improve scholarly communication. As such, making publication costs dependent on the value added aligns the interests of publishers with those of scholars, where improving the quality of the process of scholarly communication is the end goal. The motivation behind this could come from the currently available data, which suggest that hybrid publishing options offered by traditional publishers, while being of higher cost due to supposed prestige, provide a much lower overall quality publishing process (
<ext-link ext-link-type="uri" xlink:href="http://blog.wellcome.ac.uk/2016/03/23/wellcome-trust-and-coaf-open-access-spend-2014-15/">blog.wellcome.ac.uk/2016/03/23/wellcome-trust-and-coaf-open-access-spend-2014-15/</ext-link>). It is noteworthy that in spite of the higher costs of hybrid publishing compared to ‘pure’ or ‘born’ OA publishing, some reports, such as the highly influential and somewhat controversial Finch Report in the UK (
<ext-link ext-link-type="uri" xlink:href="http://www.researchinfonet.org/publish/finch/">www.researchinfonet.org/publish/finch/</ext-link>), favoured the former model and high-priced Gold OA over a Green model.</p></sec><sec><title>The effect on non-publishers</title><p>The implementation of OA models has implications beyond the publishing industry in terms of economics. Research funding comes from multiple sources, including national funding agencies and industries, as well as private funders. Much primary research actually takes place outside of academia, inside R&D departments; if R&D in the private sector can access more research findings, this will ultimately benefit the public interest as well. A report from 2004 by Arzberger and colleagues into the scientific, social and economic development of access to research results concluded that access should be promoted to the largest extent possible. According to this report, access to research results can only be responsibly restricted in the case of national security, privacy, or those involving IP rights of the authors (
<xref rid="ref-11" ref-type="bibr">Arzberger
<italic>et al.</italic>, 2004</xref>). A major principle underlying this is the ownership of research results: publicly funded research and data are public goods and because they have been produced in the public interest they should be considered and maintained as such. Indeed, such a principle has become one of the focal rallying points of the global OA movement. Appropriate licensing and accessibility can influence re-use through commercialization, and can empower citizens and industry to recognize great economic benefits. This apparently resonates with many organisations, as indicated by the increased numbers of OA policies on a global basis (see
<xref ref-type="fig" rid="f3">Figure 3</xref>).</p><fig fig-type="figure" id="f3" orientation="portrait" position="float"><label>Figure 3. </label><caption><title>Cumulative number of Open Access policies adopted by multiple research organisations, funder and research organisation, sub-unit of research organisation, funder, and research organisation.</title><p>Figures are given at the beginning of each year. Source: ROARMAP, accessed March 2016.</p></caption><graphic xlink:href="f1000research-5-10376-g0002"></graphic></fig><p>With access to scholarly articles, entrepreneurs and small businesses can accelerate innovation and discovery, which is advantageous for advancing the ‘entrepreneurial state’ (
<xref rid="ref-105" ref-type="bibr">Mazzucato, 2011</xref>). Access to research results has clear advantages for a range of industries and can help stimulate regional and global economies. Increased access to research results has been associated with considerable increases of return on financial investment (
<xref rid="ref-13" ref-type="bibr">Beagrie & Houghton, 2014</xref>). Furthermore, OA facilitates collaborations between publishers and industrial partners to leverage the potential of structured information networks for advanced data mining projects, such as that recently announced between IBM Watson and PLOS (
<xref rid="ref-48" ref-type="bibr">Denker, 2016</xref>). One of the major driving forces behind the development of OA in the UK on a national level, the ‘Finch Report’, also concluded that OA was an essential source for information and innovation to the civil service, commercial sectors, small- and medium-sized enterprises (SMEs), and the general public (
<ext-link ext-link-type="uri" xlink:href="http://www.researchinfonet.org/publish/finch/">www.researchinfonet.org/publish/finch/</ext-link>).</p><p>Taking UK cancer research as one high impact case study, there is substantial evidence for the economic benefit of OA. In 2011–12 prices, the total expenditure on research relating to cancer in the period of 1970–2009 was £15 billion (
<xref rid="ref-67" ref-type="bibr">Glover
<italic>et al.</italic>, 2014</xref>). 5.9 million quality adjusted life years were gained from the prioritized interventions in 1991–2010, of which the net-monetary benefit was an estimated £124 billion (i.e., eight-fold return on investment). However, only 17% of the annual net-monetary benefit was estimated to be attributable to research performed in the UK (
<xref rid="ref-67" ref-type="bibr">Glover
<italic>et al.</italic>, 2014</xref>), suggesting that 83% of the economic return on cancer research is drawn from research from non-UK sources. Another example is from the area of environmental impact assessments, where
<xref rid="ref-168" ref-type="bibr">Vickery (2011)</xref> has shown that OA to R&D results could result in recurring gains of around €6 billion per year. As such, opening up research for global access rather than localized and restricted use has the potential to increase the economic return, as demonstrated with the cases on cancer research and environmental impact assessments.</p></sec><sec><title>The price of Open Access</title><p>The question of the current publication cost is difficult and confounded by estimates of the total global publishing costs and revenue. Data provided by Outsell, a consultant in Burlingame, California, suggest that the science publishing industry generated $9.4 billion in revenue in 2011 and published around 1.8 million English-language articles. This equates to an approximate average revenue per article of $5,000. A white paper produced by the Max Planck Society estimated costs at €3,800–€5,000 per paper through subscription spending, based on a total global spending of €7.6 billion across 1.5-2 million articles per year in total (
<xref rid="ref-138" ref-type="bibr">Schimmer
<italic>et al.</italic>, 2015</xref>). Other estimates suggest that the total spending on publishing, distribution and access to research is around £25 billion per year, with an additional £34 billion spent on reading those outputs, a sum which equates to around one third of the total annual global spending on research (£175 billion;
<xref rid="ref-133" ref-type="bibr">Research Information Network, 2008</xref>).</p><p>Such high costs are at odds with alternative estimates of the cost of OA publishing. For example, the Scientific Electronic Library Online (
<italic>SciELO</italic>) is a pan-Latin American bibliographic database, digital library, and co-operative electronic publishing model of OA journals. It is estimated that their costs are between $70 and $600 per OA article depending on the services provided (
<xref rid="ref-31" ref-type="bibr">Brembs, 2015</xref>). OA now dominates the Latin American publishing landscape, with an estimated 72–85% of articles now with full text OA articles publicly available (
<ext-link ext-link-type="uri" xlink:href="http://www.sparc.arl.org/news/open-access-latin-america-embraced-key-visibility-research-outputs">www.sparc.arl.org/news/open-access-latin-america-embraced-key-visibility-research-outputs</ext-link>). Furthermore, in countries such as Brazil, higher quality journals are more likely to be published OA (
<xref rid="ref-117" ref-type="bibr">Neto
<italic>et al.</italic>, 2016</xref>), implying that low-cost, high quality, and OA can all co-exist. Even more extreme estimates of the cost of OA come from Standard Analytics, who suggested the absolute minimum per-article costs of publishing could fall to between $1.36 and $1.61 with sufficient cloud-based infrastructure (
<xref rid="ref-26" ref-type="bibr">Bogich
<italic>et al.</italic>, 2016</xref>). However, it is likely that this estimate under-emphasizes marginal costs that are beyond a per-article cost basis. However, what is clear from these analyses is that OA has the opportunity to become a cost-reducing mechanism for scholarly publishing. Open Journals System (OJS), an open source software available for anyone to use and download without charge, is another example of this. Additionally, researcher-led initiatives such as the recently launched
<italic>Discrete Analysis</italic> have costs that average around $30 per article, with no cost to authors or readers, and utilise the infrastructure offered by the arXiv to keep costs low (
<ext-link ext-link-type="uri" xlink:href="http://discreteanalysisjournal.com">discreteanalysisjournal.com</ext-link>).</p><p>In her article,
<xref rid="ref-153" ref-type="bibr">Sutton (2011)</xref> argued that current scholarly journals are digital products and that as such they are driven by very different economic principles and social forces than their print ancestors. Based on
<xref rid="ref-9" ref-type="bibr">Anderson (2013b)</xref>, the author made the case that changes in both the delivery of scientific content and in publishers’ business models was inevitable when journals moved online.
<xref rid="ref-153" ref-type="bibr">Sutton (2011)</xref> considered that scientific literature is no different from other digital products with respect to distribution costs and as such it is no exception to the ‘zero is inevitable’ rule of pricing.</p></sec></sec><sec><title>The societal impact of Open Access</title><p>OA to the scholarly literature does not just benefit academics, but also has wider impacts on other domains in society. It makes research available to anyone with an Internet connection who has the ability to search and read the material. Therefore, it transcends academic affiliation and supports sustainable lifelong learning. Examples of groups who might benefit most from OA include citizen scientists, medical patients and their supporting networks, health advocates, NGOs, and those who benefit from translation and transformation (e.g., sight-impaired people). In theory, OA affects anyone who uses information, and opens up possibilities for knowledge to be used in unexpected, creative and innovative ways, far beyond the mainstream professional research.</p><p>Access to knowledge has been called a human rights issue, considering it is included in Article 27 of the United Nations Declaration of Human Rights.
<xref rid="ref-178" ref-type="bibr">Willinsky (2006)</xref> has argued that "
<italic>Access to knowledge is a human right that is closely associated with the ability to defend, as well as to advocate for, other rights.</italic>". This is not only true for access to knowledge from research that could save human lives, but also, as argued by Jacques Derrida, to the right of access to philosophy and the humanities disciplines that stem from it. Derrida writes about the field of Philosophy, "
<italic>No one can forbid access to it. The moment one has the desire or will for it, one has the right to it. The right is inscribed in philosophy itself</italic> " (
<xref rid="ref-49" ref-type="bibr">Derrida, 2002</xref>).</p><p>Society’s ability to make research publicly accessible supports the long-term interest and investment in research. Citizens support research through taxes and therefore one could argue that efforts to support public access should be a fundamental part of the research process. While OA is not a solution to all aspects of research accessibility (e.g., filtering and language barriers, connectivity barriers and disability access remain continuing issues to be addressed;
<ext-link ext-link-type="uri" xlink:href="https://cyber.harvard.edu/hoap/Open_Access_(the_book)">cyber.law.harvard.edu/hoap/Open_Access_(the_book)</ext-link>), it most certainly increases accessibility greatly and at the same time allows innovations to remove other barriers (e.g., OA articles can be freely translated to address language barriers and can be changed to different formats to accommodate screen readers). Anecdotal evidence suggests that public access to research is required from a range of public spheres (
<ext-link ext-link-type="uri" xlink:href="http://whoneedsaccess.org/">whoneedsaccess.org/</ext-link>). Nonetheless, the fact that access to knowledge continues to be prohibited in fields like public health should be of major concern to all stakeholders engaged in academic publishing.</p><p>In addition to professional research by, for example, academics, there is the dimension of citizen science. In citizen science, the broader public participates in the research process itself and will have an increased interest in accessing previous research. Numerous projects such as Galaxy Zoo, Zooniverse, Old Weather, Fold It, Whale FM, Bat Detective, and Project Discovery, are all different initiatives in which citizens publicly and openly engage with research. These initiatives introduce new ways of knowledge creation and these groups also require thorough access to actually be able to do non-redundant research. Citizen science forms part of the societal case for OA, because it clearly indicates that anyone can be actively engaged with research, and not only professional scientists.</p><p>Some traditional publishers and some academics have argued that public access to research is not required because research papers cannot be understood by non-specialists (
<ext-link ext-link-type="uri" xlink:href="http://cyber.law.harvard.edu/hoap/Open_Access_(the_book)">cyber.law.harvard.edu/hoap/Open_Access_(the_book)</ext-link> - see Section 5.5.1). However, citizen science initiatives already indicate the general public
<italic>is</italic> interested in and understands the research. Whereas this understanding and engagement is highly variable, and strongly dependent on a range of extrinsic and intrinsic factors, the fact that a high level of public interest in science already exists is of relevance. These publishers and academics argue that specialization is a sufficient reason for confining access to professional research bodies through subscriptions. Such statements conflate a lack of desire or need for access with the denial of opportunity to access research, and makes false presumptions about the demand in access to the literature (i.e., unmet and unknown demand). Importantly, OA provides access to everyone who potentially needs or wants it, without making explicit and patronising statements or guesswork about who needs or deserves it. As Peter Suber says in his 2012 book: "The idea [of OA] is to stop thinking of knowledge as a commodity to meter out to deserving customers, and to start thinking of it as a public good, especially when it is given away by its authors, funded with public money, or both" (page 116). Isolated incidents such as the crashing of servers of Physical Reviews Letters upon the ‘Gravitational Waves’ announcement and OA publication (Feb, 2016;
<xref rid="ref-1" ref-type="bibr">Abbott
<italic>et al.</italic>, 2016</xref>) indicate that there are cases of extreme public interest in science that closed access would only impede. Moreover, one out of four people seeking medical information have hit a paywall at least once (
<ext-link ext-link-type="uri" xlink:href="http://pewinternet.org/2013/01/15/information-triage/">pewinternet.org/2013/01/15/information-triage/</ext-link>). Claims that only experts can and should read research articles does little to break down the ‘ivory tower’ perception that still pervades academia, and undermines the enormous amounts of resources invested in science communication and public engagement activities. Such perceptions run counter to the idea of access to knowledge as a right, retaining it as a privilege based on financial or academic status.</p><sec><title>Open Access in developing countries</title><p>The arguments outlined above form the basis for democratic and equal access to research, which come to light even stronger in the developing world. For low- and middle-income countries (LMIC), OA publishing breaks traditional financial barriers and allows unrestricted, equal access to scholarly information to people all over the globe. Due to the high prices of journal subscriptions, developing countries struggle with access just as in developed countries, but to a greater extent and consequently with greater negative repercussions. For example, a research paper from 1982 that indicated why Liberia should be included in the Ebola endemic zone was unknown to Liberian officials in the 2014 Ebola outbreak (
<xref rid="ref-85" ref-type="bibr">Knobloch
<italic>et al.</italic>, 1982</xref>); the paper was published behind a paywall, drastically reducing its discoverability. Even though the result is available in the abstract of the paywalled article, assessing the truth of the result certainly requires access to the full research article. In general, lack of access can have major deleterious consequences for students and researchers, in that they do not have sufficient material to conduct their own primary research or education.</p><p>OA provides a mechanism to level the playing field between developed and developing countries. This increases fair competition and the scientific potential of the developing world (
<xref rid="ref-37" ref-type="bibr">Chan
<italic>et al.</italic>, 2005</xref>). This aspect is linked to the wider issue of open licensing, which is essential for effective marketing of medicines and medical research in developing countries (
<xref rid="ref-59" ref-type="bibr">Flynn
<italic>et al.</italic>, 2009</xref>), and justifies the necessity of OA in the wider context of social welfare. Developing countries clearly acknowledge the need for access and as such have launched many repositories to increase access with self-archiving of research articles. In 2014, over 100 institutions in Africa launched a network of over 25 fully-operational OA repositories in Kenya, Tanzania and Uganda (
<ext-link ext-link-type="uri" xlink:href="http://www.ubuntunet.net/april2014#researchrelevant">www.ubuntunet.net/april2014#researchrelevant</ext-link>). Such developments suggest that African nations are leaning more towards a Green model of OA adoption.</p><p>The shift from a ‘reader pays’ to a pre-publication fee model (often conflated with ‘author pays’; see subsection ‘The effect on publishers’) with OA potentially limits its adoption in developing countries. The pay-to-publish system is a potentially greater burden for authors in developing countries, considering that they are not used to paying publication costs, and funding systems for OA are not as well-established as those in the Western world. Publication fees present an even greater relative burden (
<xref rid="ref-104" ref-type="bibr">Matheka
<italic>et al.</italic>, 2014</xref>) given that they can often exceed a monthly salary for researchers. This has been at least partially mitigated with waiver fees for authors from developing countries and additional provisions in research grants, and around 70% of peer reviewed OA journals are fee-free. In November 2015, Research4Life (
<ext-link ext-link-type="uri" xlink:href="http://research4life.org">research4life.org</ext-link>) and DOAJ announced a working partnership that will help to ensure that the Research4Life users will have access to the largest possible array of OA journals from publishers with a certain quality standard. While Research4Life does not directly cover OA publication costs, a lot of publishers propose full or partial waivers if they are based in countries eligible by Research4Life. However, determining which countries qualify for access to scientific journals through these programs, and which journals they are provided access to, is a fairly closed process. They are also not entirely stable, as publishers can opt out of the initiative, or be selective about which countries they choose to serve. In 2011, publishers withdrew free access to 2500 health and biomedical journals for Bangladesh (
<xref rid="ref-84" ref-type="bibr">Kmietowicz, 2011</xref>) through the HINARI programme. While access was subsequently reinstated, this demonstrates that such initiatives are not an adequate replacement for full OA (
<xref rid="ref-38" ref-type="bibr">Chatterjee
<italic>et al.</italic>, 2013</xref>). Despite these programs purporting to provide essential articles to researchers in poor nations, they exclude some developing countries (e.g., India) and limit access to researchers who work in registered institutions.</p><p>Initiatives such as the Journals Online Project developed by INASP (International Network for the Availability of Scientific Publications;
<ext-link ext-link-type="uri" xlink:href="http://inasp.info/en/">inasp.info/en/</ext-link>) has helped to develop a number of online OA platforms in the Global South. These were launched in 1998 with the African Journals Online (AJOL) platform, a project currently managed in South Africa. More recently, INASP have set up Latin American Journals Online (LAMJOL) which hosts journals in El Salvador, Honduras, and Nicaragua. In Asia, Bangladesh Journals Online (BanglaJOL), Nepal Journals Online (NepJOL), and Sri Lankan Journals Online (SLJOL), all facilitated through INASP, continue to develop and now around 95% of their articles are full-text Open Access. As mentioned previously, improved access should not be limited to professional researchers only, considering that there is also global interest from the broader public, including health professionals.</p></sec><sec><title>Deceptive publishing practices</title><p>One negative effect of OA comes from entities that attempt to profit by exploiting the pay-to-publish system used by many OA publishers. These publishers operate a sub-category of OA journals known as vanity presses, predatory publishers (
<xref rid="ref-15" ref-type="bibr">Beall, 2012</xref>) or pseudo-journals (
<xref rid="ref-107" ref-type="bibr">McGlynn, 2013</xref>). These journals, referred to in this work as ‘deceptive publishers’, seem to be in the scholarly publishing business primarily to collect publication fees (i.e., APCs) in exchange for rapid publication without formal peer-review.
<xref rid="ref-14" ref-type="bibr">Beall (2015)</xref> has defined a list of criteria for identifying deceptive publishers and an index of publishers and individual journals that meet these criteria is continuously updated (
<ext-link ext-link-type="uri" xlink:href="http://scholarlyoa.com">scholarlyoa.com</ext-link>).</p><p>While not all scholars and advocates agree with the criteria proposed by Jeffrey Beall (who controversially describes the OA movement as "an anti-corporatist movement that wants to deny the freedom of the press to companies it disagrees with" (
<xref rid="ref-16" ref-type="bibr">Beall, 2013</xref>)), there are several factors that many agree on to identify a deceptive publisher, but these factors are not clear-cut indicators of deceptive publishing. One such indicator is that deceptive publishers tend to charge low publication fees (
<xref rid="ref-181" ref-type="bibr">Xia, 2015</xref>), most below $100 and few charge more than $200. However, while this is a trait of almost all deceptive publishers, the reverse is not necessarily the case. For example, a single-authored paper with
<italic>PeerJ</italic> would cost $99, but this is not a deceptive publisher. On the contrary, the average publication fee of journals indexed in the Directory of Open Access Journals (DOAJ) is around $900–$1,000 (
<xref rid="ref-149" ref-type="bibr">Solomon & Björk, 2012</xref>) and leading universities in the UK and Germany pay on average $1,200–$1,300 per article (
<xref rid="ref-139" ref-type="bibr">Schimmer
<italic>et al.</italic>, 2015</xref>). The editorial and peer-review aspects of deceptive publishers are either non-existent or suspect; they also falsely claim to have ratings such as a Journal Impact Factor and to be indexed in major databases such as Scopus (
<xref rid="ref-50" ref-type="bibr">Djuric, 2015</xref>). Editors from these journals solicit articles that have no relation to the topic of their journal and do not send the manuscripts out to be properly peer-reviewed (
<xref rid="ref-29" ref-type="bibr">Bowman, 2014</xref>).</p><p>The problem of deceptive publishers in OA seems to highly affect countries where the academic evaluation strongly favors international publication without further quality checks (
<xref rid="ref-145" ref-type="bibr">Shen & Björk, 2015</xref>).
<xref rid="ref-180" ref-type="bibr">Xia
<italic>et al.</italic> (2015)</xref> collected and analyzed the publication record, citation count, and geographic location of authors from the various groups of journals. Statistical analyses verified that deceptive and non-deceptive journals have distinct author populations: authors who publish in deceptive journals tend to be early-career researchers from developing countries with still little publishing experience. The spatial distribution of both the deceptive publishers and those authors who submit in pseudo-journals is highly skewed: Asia and Africa contributes three quarters of authors (
<xref rid="ref-180" ref-type="bibr">Xia
<italic>et al.</italic>, 2015</xref>) and Indian journals form the overwhelming proportion of deceptive publishers (
<xref rid="ref-181" ref-type="bibr">Xia, 2015</xref>). An interesting finding is the very low involvement of South America, both among deceptive publishers (0.5%) and corresponding authors in deceptive journals (2.2%). The OA infrastructure in Latin America is different compared to other developing countries, which reveals a possible reason for this asymmetric situation. Latin American journals and universities are engaged in OA publication models at a higher degree than other regions (
<xref rid="ref-6" ref-type="bibr">Alperin
<italic>et al.</italic>, 2011</xref>). As a result, scholars from this region are not only more aware of OA issues, but they have more options for publishing OA than those from other regions (
<xref rid="ref-6" ref-type="bibr">Alperin
<italic>et al.</italic>, 2011</xref>). Moreover, SciELO (
<xref rid="ref-126" ref-type="bibr">Packer, 2009</xref>) and the creation of Latin American databases (
<xref rid="ref-5" ref-type="bibr">Alonso-Gamboa & Russell, 2012</xref>) have played a tremendous part in this process by bringing recognition and a good reputation to publishing outlets in Latin America.</p><p>Considerable attention is given to the subject of deceptive publishers, who have become conflated with the OA movement in general to the detriment of genuine OA publishers. For example, a ‘sting’ operation that outed bad peer-review instead got misinterpreted as bad peer-review in OA journals (
<xref rid="ref-27" ref-type="bibr">Bohannon, 2013</xref>), but was probably more indicative of issues to do with the traditional closed and over-burdened system of peer review (
<ext-link ext-link-type="uri" xlink:href="http://scilogs.com/communication_breakdown/jon-tennant-oa/">scilogs.com/communication_breakdown/jon-tennant-oa/</ext-link>). Overall, the deceptive publisher phenomenon is one major negative aspect that spawns many misconceptions and misgivings about publishing OA. Recently launched industry-led initiatives such as "Think, Check, Submit" (
<ext-link ext-link-type="uri" xlink:href="http://thinkchecksubmit.org">thinkchecksubmit.org</ext-link>) provide a checklist to help researchers identify trustworthy journals, and will likely be a pivotal tool in combating deceptive publishers.</p></sec></sec><sec><title>Open Access and Open Science</title><p>OA exists in a constantly evolving scholarly research ecosystem and the proliferation of "open" as a description of scientific activities has caused some confusion about what the term "open" means (for a more comprehensive discussion, see
<xref rid="ref-130" ref-type="bibr">Pomerantz & Peek (2016)</xref>). As such, it is important to note how it is interconnected to other facets of the scholarly communication system. Here, we discuss the implications that the transition to OA has on developments in the broader context of Open Science (or Open Research).</p><sec><title>Open Access and Open Data</title><p>The overall movement of OA has become conjoined with the drive for Open Data. Data sharing is fundamental to scientific progress, because data lead to the knowledge generated in research articles. Furthermore, data sharing has recently become a common requirement, together with OA, for both research funding and publication. The data sharing policy from PLOS illustrates the high degree of overlap between OA and Open Data; authors of articles published in PLOS are required to share the data except if they have valid reasons not to (i.e., an opt-out system;
<ext-link ext-link-type="uri" xlink:href="http://journals.plos.org/plosone/s/data-availability">journals.plos.org/plosone/s/data-availability</ext-link>). Many publishers, NGOs, and research funders have recently come together to commit to free research sharing in times of public health emergency, catalysed by the current Zika health threat (
<ext-link ext-link-type="uri" xlink:href="http://http://www.wellcome.ac.uk/About-us/Policy/Spotlight-issues/Data-sharing/Public-health-emergencies/index.htm">http://www.wellcome.ac.uk/About-us/Policy/Spotlight-issues/Data-sharing/Public-health-emergencies/index.htm</ext-link>). It is noteworthy that some of the largest publishers, including Wiley, Taylor and Francis, and Elsevier (with the exception of the journal
<italic>The Lancet</italic>) did not commit to research sharing during ongoing or future public health crises (as of May, 2016).</p><p>The benefits of Open Data are diverse, including a citation advantage. Combined with the citation advantage for OA articles, providing data alongside publications can increase citations on average by 30% (
<xref rid="ref-129" ref-type="bibr">Piwowar & Vision, 2013</xref>) and up to 69% (
<xref rid="ref-128" ref-type="bibr">Piwowar
<italic>et al.</italic>, 2007</xref>), but this evidence is entirely field-dependent (e.g.,
<xref rid="ref-51" ref-type="bibr">Dorch
<italic>et al.</italic>, 2015)</xref>). Below we cover seven additional benefits of Open Data.</p><p>First, data sharing enhances reproducibility, a crucial aspect in a time where some scientific domains appear to have problems with reproducibility (e.g.,
<xref rid="ref-125" ref-type="bibr">Open Science Collaboration, 2015</xref>). Several factors could form the basis for this ‘crisis’, such as an overemphasis on novelty instead of rigour, selective reporting of results, an overemphasis on statistical significance, and insufficient documentation of the research methods. Publicly sharing data, code, and materials can certainly alleviate issues with reproducibility. This is especially pertinent in the modern sciences, where a substantial proportion of published results draw on quantitative experiments and computer simulations. As such, it is largely impossible to reproduce these experiments as they become more complex and the associated datasets increase in complexity. When full access to the data, metadata, and the code used to produce the ultimate results are provided alongside publication, this greatly improves reproducibility.</p><p>Second, publicly available data can be used to stimulate innovations, such as new analytical methods. An excellent example of this is provided by the neuroimaging OpenfMRI project, where shared data have been used to examine the effects of different processing pipelines on analysis outcomes (
<xref rid="ref-34" ref-type="bibr">Carp, 2012</xref>) and test new methods to characterize different cognitive tasks (
<xref rid="ref-159" ref-type="bibr">Turner & Laird, 2012</xref>). Another good example is the Protein Data Bank (PDB) (
<xref rid="ref-19" ref-type="bibr">Berman
<italic>et al.</italic>, 2000</xref>), a project which has enabled the re-use of the primary structural data and opened up new avenues of research, despite the latter not being expected.</p><p>Third, data sharing enables new research questions that can only be answered by combining datasets which now remain separated. Analyzing vast volumes of data can yield novel and perhaps surprising findings. This allows for integrated research hypotheses on the underlying processes behind the original data and observations. Exploratory approaches to large datasets can be seen as hypothesis generating tools, which later drives experimental testing to confirm or disprove these hypotheses (
<xref rid="ref-170" ref-type="bibr">Wagenmakers
<italic>et al.</italic>, 2012</xref>).</p><p>Fourth, the realization that data will ultimately be shared and visible to the community provides a strong incentive for researchers to ensure they engage in better data documentation and, therefore, research methods. For example, the willingness to publicly share data has been associated with fewer statistical errors in the final research article (
<xref rid="ref-175" ref-type="bibr">Wicherts
<italic>et al.</italic>, 2011</xref>).</p><p>Fifth, public data sharing provides a digital backup for datasets, protecting valuable scientific resources. Moreover, a considerable amount of data produced every day does not ultimately lead to publication and often remain hidden. Such data might remain in a hidden file-drawer despite being valid, creating a systematic bias in the information available. Public data sharing opens this file-drawer and, consequently, allows independent assessments of whether the data are valid or not.</p><p>Sixth, sharing data can certainly reduce the cost of performing research. A file-drawer has been indicated to greatly reduce the efficiency of research in detecting effects (
<xref rid="ref-161" ref-type="bibr">van Assen
<italic>et al.</italic>, 2014</xref>). Open Data, as such, discourages redundant data collection (i.e., data that have been already collected but never made publicly accessible) and simultaneously allows researchers to better approximate what is happening in their fields. This will have a large effect on research costs, resulting in savings that can be then be used for more productive research goals.</p><p>Finally, and tightly connected with the sixth point, Open Data potentially has a great economic value. For example, Open Data creates jobs for analysis and re-use of these data
<xref rid="ref-33" ref-type="bibr">Capgemini (2015)</xref>, and contributes to additional value of products and services in major sectors (
<xref rid="ref-102" ref-type="bibr">Manyika
<italic>et al.</italic>, 2013</xref>), ad well as benefits users of these data rich services (
<xref rid="ref-151" ref-type="bibr">Stott, 2014</xref>).</p></sec><sec><title>Open Access and Open Science</title><p>Beyond OA and Open Data lies a more integrated approach to research, referred to more broadly as Open Science (i.e., Science 2.0, Open Scholarship). According to the European Commission’s Horizon 2020 programme, Open Science is defined as "
<italic>The transformation, opening up and democratisation of science and research through ICT, with the objectives of making science more efficient, transparent and interdisciplinary, of changing the interaction between science and society, and of enabling broader societal impact and innovation</italic>". Consequently, we see OA as only one of the multiple challenges currently facing the ‘open transformation’ of the scholarly publishing system (
<xref rid="ref-174" ref-type="bibr">Watson, 2015</xref>), and OA should therefore be considered in the wider contexts and complimentary domains of research transparency and open source.</p><p>As
<xref rid="ref-87" ref-type="bibr">Kriegeskorte
<italic>et al.</italic> (2012)</xref> pointed out, OA is now widely accepted as desirable and becoming a reality in many academic spheres. However, the second essential complementary element to research, evaluation, has received less attention despite the large amount of research that has been done to document its current limitations (
<xref rid="ref-17" ref-type="bibr">Benos
<italic>et al.</italic>, 2007</xref>;
<xref rid="ref-22" ref-type="bibr">Birukou
<italic>et al.</italic>, 2011</xref>;
<xref rid="ref-80" ref-type="bibr">Ioannidis, 2005</xref>;
<xref rid="ref-81" ref-type="bibr">Ioannidis, 2012a</xref>;
<xref rid="ref-79" ref-type="bibr">Ioannidis, 2012b</xref>;
<xref rid="ref-82" ref-type="bibr">John
<italic>et al.</italic>, 2012</xref>;
<xref rid="ref-119" ref-type="bibr">Nosek & Bar-Anan, 2012</xref>;
<xref rid="ref-147" ref-type="bibr">Simmons
<italic>et al.</italic>, 2011</xref>).</p><p>Open evaluation, an ongoing post-publication process of transparent peer review and rating of papers, promises to address the problems of the current assessment systems
<xref rid="ref-87" ref-type="bibr">Kriegeskorte
<italic>et al.</italic> (2012)</xref>, as well as increasing the overall quality of the peer review process. As such, ongoing assessments of the development of OA must also consider the broader impact and concurrent changes to the peer review system (
<xref rid="ref-165" ref-type="bibr">van Rooyen
<italic>et al.</italic>, 1999</xref>;
<xref rid="ref-176" ref-type="bibr">Wicherts, 2016</xref>;
<xref rid="ref-97" ref-type="bibr">Leek
<italic>et al.</italic>, 2011</xref>). Some assessment methods, such as the Research Excellence Framework (REF) in England and administered by HEFCE, have already made OA a core feature of evaluation in that all research papers submitted to the REF must be archived in an institutional or subject repository (
<ext-link ext-link-type="uri" xlink:href="http://www.hefce.ac.uk/pubs/year/2014/201407/">www.hefce.ac.uk/pubs/year/2014/201407/</ext-link>). While it is too early to evaluate the impact of this policy, by tying OA compliance with research evaluation we might expect to see a national shift towards large-scale OA adoption. At the very least, such a combination is generating increasing interest and awareness about OA among researchers, increasing usage of institutional repositories, and increasing demand for funding for APCs (
<xref rid="ref-158" ref-type="bibr">Tate, 2015</xref>).</p><p>Future research regarding better ways to improve scholarly communication will be instrumental in providing evidence to support the transformation of the publishing system and design new alternatives (
<xref rid="ref-32" ref-type="bibr">Buttliere, 2014</xref>;
<xref rid="ref-65" ref-type="bibr">Ghosh
<italic>et al.</italic>, 2012</xref>;
<xref rid="ref-87" ref-type="bibr">Kriegeskorte
<italic>et al.</italic>, 2012</xref>;
<xref rid="ref-132" ref-type="bibr">Pöschl, 2012</xref>), which will draw heavily upon on open publishing framework driven by developments and newly emerging models in OA. Finally, consideration of Open Science and OA will be important inclusions in evolving research standards such as the Transparency and Openness Promotion (TOP) guidelines (
<ext-link ext-link-type="uri" xlink:href="https://cos.io/top/">https://cos.io/top/</ext-link>) .</p></sec></sec><sec><title>Conclusions</title><p>This article provides an evidence-based review of the impact of OA on academy, economy and society. Overall, the evidence points to a favorable impact of OA on the scholarly literature through increased dissemination and re-use. OA has the potential to be a sustainable business venture for new and established publishers, and can provide substantial benefits to research- and development-intensive businesses, including health organisations, volunteer sectors, and technology. OA is a global issue, highlighted by inequalities between developing and developed nations, and largely fueled by financial disparity. Current levels of access in the developing world are insufficient and unstable, and OA has the potential to foster the development of stable research ecosystems. While deceptive publishing remains an ongoing issue, particularly in the developing world, increasing public engagement, development of OA policies, and discussion of sustainable and ethical publishing practices can remove this potential threat.</p><p>For libraries, universities, governments, and research institutions, one major benefit of lowering the cost of knowledge is the availability of extra budget that can be reallocated for other purposes. For researchers themselves, OA can increase their audience and impact by delivering wider and easier access for readers. For publishers, promoting OA is an answer to the desires and the needs of their research communities. Furthermore, subscription-based publishers have (partly) answered the call of the increasing global demand for OA, by giving their green light to author self-archiving (
<xref rid="ref-72" ref-type="bibr">Harnad
<italic>et al.</italic>, 2008</xref>), as well as by establishing numerous ‘hybrid’ OA options. In an author survey,
<xref rid="ref-154" ref-type="bibr">Swan & Brown (2004)</xref> reported that the vast majority of their sample indicated that they would self-archive willingly if their employer (or funding body) required them to do so. Similarly, in a study by
<xref rid="ref-155" ref-type="bibr">Swan & Brown (2005)</xref> the vast majority of researchers (81%) indicated that they would comply with mandates that made OA a condition of funding or employment. There is evidence that many funders and research organisations are moving in this direction: since 2005, the number of policies supporting OA publishing increased steadily, and there is similar growth in the number of institutional rights-retention policies. Consequently, it is now the responsibility of researchers to ensure OA to their publications either by choosing the Green or the Gold road, and for public research funders to employ policies that are in the best interests of the wider public while considering the financial sustainability of the scholarly publishing ecosystem.</p><p>The fact that OA impacts upon such a diverse range of stakeholders, often with highly polarised and emotional viewpoints, highlights the ongoing need for evidence-informed discussion and engagement at all levels. This is especially the case for research communities, who have exceptionally diverse perspectives about OA and in particular how it interacts with ‘quality’ and ‘prestige’ in publishing (
<xref rid="ref-141" ref-type="bibr">Schroter & Tite, 2006</xref>;
<xref rid="ref-140" ref-type="bibr">Schroter
<italic>et al.</italic>, 2005</xref>). As Peter Suber, a leading voice in the OA movement, stated (
<ext-link ext-link-type="uri" xlink:href="http://dash.harvard.edu/handle/1/4391169">dash.harvard.edu/handle/1/4391169</ext-link>).</p><list list-type="simple"><list-item><label></label><p>"
<italic>TA [toll-access] publishers are not the enemy. They are only unpersuaded. Even when they are opposed, and not merely unpersuaded, they are only enemies if they have the power to stop OA. No publisher has this power, or at least not by virtue of publishing under a TA business model. If we have enemies, they are those who can obstruct progress to OA. The only people who fit this description are friends of OA who are distracted from providing OA by other work or other priorities.</italic>"</p></list-item></list><p>Therefore, OA supporters should focus their efforts on working for new models and systems rather than trying to undermine or punish the existing ones. OA remains only one of the multiple challenges that the scholarly publishing system is currently facing. As highlighted in this review, the empirical evidence for OA is overwhelmingly positive, but further research is certainly required to move from investigating the effects of OA to researching the broader effects of Open Science. In particular, OA must be considered in the future to more broadly regarding the adverse effects of a system of journal-based research assessment (
<xref rid="ref-30" ref-type="bibr">Brembs
<italic>et al.</italic>, 2013</xref>), and the development of scholarly communication systems that are sustainable for, and in the best interests of, the commons.</p></sec></body><back><ack><title>Acknowledgments</title><p>We would like to collectively acknowledge the OpenCon community for inspiring this paper, and for providing continuous discussion about the various aspects of Open Access. In particular, we are grateful to Brett Buttliere, Audrey Risser, Sarah Barkla, and April Clyburne-Sherin for contributing resources to the development of this paper, and Tracey Depellegrin Connelly, Matt Menzenski, and Joseph McArthur for helpful comments on an earlier draft. We also thank Neil Saunders who provided the base code to extract data from PubMed Central. We would also like to thank Andy Nobes for drawing our attention to the work of INASP. PM would like to thank Lennart Martens for insightful discussions on Open Science. For comments on the first published version of this manuscript, we would like to thank Philip Young, Ross Mounce, Anna Sharman, and David Wojick for their helpful comments. Reviews from Gwilym Lockwood, Peter Suber, Paige Brown Jarreau, Anne Tierney and Chris Chambers were supportive, constructive, and greatly improved the content and balance of this article.</p></ack><ref-list><ref id="ref-1"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Abbott</surname><given-names>BP</given-names></name><name><surname>Abbott</surname><given-names>R</given-names></name><name><surname>Abbott</surname><given-names>TD</given-names></name><etal></etal></person-group>:
<article-title>Observation of Gravitational Waves from a Binary Black Hole Merger.</article-title><source><italic>Phys Rev Lett.</italic></source><year>2016</year>;<volume>116</volume>(<issue>6</issue>): 061102.
<pub-id pub-id-type="doi">10.1103/PhysRevLett.116.061102</pub-id><pub-id pub-id-type="pmid">26918975</pub-id></mixed-citation></ref><ref id="ref-2"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Adcock</surname><given-names>J</given-names></name><name><surname>Fottrell</surname><given-names>E</given-names></name></person-group>:
<article-title>The North-South information highway: case studies of publication access among health researchers in resource-poor countries.</article-title><source><italic>Glob Health Action.</italic></source><year>2008</year>;<volume>1</volume>.
<pub-id pub-id-type="doi">10.3402/gha.v1i0.1865</pub-id><pmc-comment>2779915 </pmc-comment>
<pub-id pub-id-type="pmid">20027241</pub-id></mixed-citation></ref><ref id="ref-3"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Adie</surname><given-names>E</given-names></name></person-group>:
<article-title>Attention! a study of open access vs non-open access articles.</article-title><source><italic>Figshare.</italic></source><year>2014</year><pub-id pub-id-type="doi">10.6084/m9.figshare.1213690</pub-id></mixed-citation></ref><ref id="ref-4"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Allen</surname><given-names>HG</given-names></name><name><surname>Stanton</surname><given-names>TR</given-names></name><name><surname>Di Pietro</surname><given-names>F</given-names></name><etal></etal></person-group>:
<article-title>Social media release increases dissemination of original articles in the clinical pain sciences.</article-title><source><italic>PLoS One.</italic></source><year>2013</year>;<volume>8</volume>(<issue>7</issue>):<fpage>e68914</fpage>.
<pub-id pub-id-type="doi">10.1371/journal.pone.0068914</pub-id><pmc-comment>3714259 </pmc-comment>
<pub-id pub-id-type="pmid">23874810</pub-id></mixed-citation></ref><ref id="ref-5"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Alonso-Gamboa</surname><given-names>JO</given-names></name><name><surname>Russell</surname><given-names>JM</given-names></name></person-group>:
<article-title>Latin American scholarly journal databases: a look back to the way forward.</article-title>In
<italic>Aslib Proceedings.</italic>Emerald Group Publishing Limited,<year>2012</year>;<volume>64</volume>(<issue>1</issue>):<fpage>32</fpage>–<lpage>45</lpage>.
<pub-id pub-id-type="doi">10.1108/00012531211196693</pub-id></mixed-citation></ref><ref id="ref-6"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Alperin</surname><given-names>JP</given-names></name><name><surname>Fischman</surname><given-names>GE</given-names></name><name><surname>Willinsky</surname><given-names>J</given-names></name></person-group>:
<article-title>Scholarly communication strategies in Latin America’s research-intensive universities.</article-title><source><italic>Educación superior y sociedad.</italic></source><year>2011</year>;<volume>16</volume>(<issue>2</issue>).
<ext-link ext-link-type="uri" xlink:href="https://pkp.sfu.ca/files/iesalc_final.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-7"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Aman</surname><given-names>V</given-names></name></person-group>:
<article-title>Is there any measurable benefit in publishing preprints in the arxiv section quantitative biology?</article-title><source><italic>CoRR.</italic></source><year>2014</year>; abs/1411.1955.
<ext-link ext-link-type="uri" xlink:href="http://arxiv.org/abs/1411.1955">Reference Source</ext-link></mixed-citation></ref><ref id="ref-8"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Anderson</surname><given-names>B</given-names></name></person-group>:
<article-title>Funding sources of impactful and transformative research.</article-title>Master’s thesis, San Jose State University,<year>2013a</year><ext-link ext-link-type="uri" xlink:href="http://scholarworks.sjsu.edu/cgi/viewcontent.cgi?article=7921&context=etd_theses">Reference Source</ext-link></mixed-citation></ref><ref id="ref-9"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Anderson</surname><given-names>C</given-names></name></person-group>:
<article-title>Free: How today’s smartest businesses profit by giving something for nothing.</article-title>Random House,<year>2013b</year><ext-link ext-link-type="uri" xlink:href="http://www.randomhouse.com.au/books/chris-anderson/free-how-todays-smartest-businesses-profit-by-giving-something-for-nothing-9781905211494.aspx">Reference Source</ext-link></mixed-citation></ref><ref id="ref-10"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Antelman</surname><given-names>K</given-names></name></person-group>:
<article-title>Do open-access articles have a greater research impact?</article-title><source><italic>Coll Res Libr.</italic></source><year>2004</year>;<volume>65</volume>(<issue>5</issue>):<fpage>372</fpage>–<lpage>382</lpage>.
<pub-id pub-id-type="doi">10.5860/crl.65.5.372</pub-id></mixed-citation></ref><ref id="ref-11"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Arzberger</surname><given-names>P</given-names></name><name><surname>Schroeder</surname><given-names>P</given-names></name><name><surname>Beaulieu</surname><given-names>A</given-names></name><etal></etal></person-group>:
<article-title>Promoting access to public research data for scientific, economic, and social development.</article-title><source><italic>Data Sci J.</italic></source><year>2004</year>;<volume>3</volume>:<fpage>135</fpage>–<lpage>152</lpage>.
<pub-id pub-id-type="doi">10.2481/dsj.3.135</pub-id></mixed-citation></ref><ref id="ref-12"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Atchison</surname><given-names>A</given-names></name><name><surname>Bull</surname><given-names>J</given-names></name></person-group>:
<article-title>Will open access get me cited? an analysis of the efficacy of open access publishing in political science.</article-title><source><italic>PS Polit Sci Polit.</italic></source><year>2015</year>;<volume>48</volume>(<issue>01</issue>):<fpage>129</fpage>–<lpage>137</lpage>.
<pub-id pub-id-type="doi">10.1017/S1049096514001668</pub-id></mixed-citation></ref><ref id="ref-13"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Beagrie</surname><given-names>N</given-names></name><name><surname>Houghton</surname><given-names>JW</given-names></name></person-group>:
<article-title>The value and impact of data sharing and curation: A synthesis of three recent studies of UK research data centres</article-title>.<year>2014</year><ext-link ext-link-type="uri" xlink:href="http://repository.jisc.ac.uk/5568/">Reference Source</ext-link></mixed-citation></ref><ref id="ref-14"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Beall</surname><given-names>J</given-names></name></person-group>:
<article-title>Criteria for determining predatory open-access publishers.</article-title><source><italic>Scholarly Open Access.</italic></source><year>2015</year> (accessed 2015-02-14).
<ext-link ext-link-type="uri" xlink:href="https://scholarlyoa.files.wordpress.com/2015/01/criteria-2015.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-15"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Beall</surname><given-names>J</given-names></name></person-group>:
<article-title>Predatory publishers are corrupting open access.</article-title><source><italic>Nature.</italic></source><year>2012</year>;<volume>489</volume>(<issue>7415</issue>):<fpage>179</fpage>.
<pub-id pub-id-type="doi">10.1038/489179a</pub-id><pub-id pub-id-type="pmid">22972258</pub-id></mixed-citation></ref><ref id="ref-16"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Beall</surname><given-names>J</given-names></name></person-group>:
<article-title>The open-access movement is not really about open access.</article-title>tripleC: Communication, Capitalism and Critique.
<source><italic>Open Access Journal for a Global Sustainable Information Society.</italic></source><year>2013</year>;<volume>11</volume>(<issue>2</issue>):<fpage>589</fpage>–<lpage>597</lpage>.
<ext-link ext-link-type="uri" xlink:href="http://triplec.at/index.php/tripleC/article/download/525/514">Reference Source</ext-link></mixed-citation></ref><ref id="ref-17"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Benos</surname><given-names>DJ</given-names></name><name><surname>Bashari</surname><given-names>E</given-names></name><name><surname>Chaves</surname><given-names>JM</given-names></name><etal></etal></person-group>:
<article-title>The ups and downs of peer review.</article-title><source><italic>Adv Physiol Educ.</italic></source><year>2007</year>;<volume>31</volume>(<issue>2</issue>):<fpage>145</fpage>–<lpage>152</lpage>.
<pub-id pub-id-type="doi">10.1152/advan.00104.2006</pub-id><pub-id pub-id-type="pmid">17562902</pub-id></mixed-citation></ref><ref id="ref-18"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bergstrom</surname><given-names>TC</given-names></name><name><surname>Courant</surname><given-names>PN</given-names></name><name><surname>McAfee</surname><given-names>RP</given-names></name><etal></etal></person-group>:
<article-title>Evaluating big deal journal bundles.</article-title><source><italic>Proc Natl Acad Sci U S A.</italic></source><year>2014</year>;<volume>111</volume>(<issue>26</issue>):<fpage>9425</fpage>–<lpage>9430</lpage>.
<pub-id pub-id-type="doi">10.1073/pnas.1403006111</pub-id><pmc-comment>4084480 </pmc-comment>
<pub-id pub-id-type="pmid">24979785</pub-id></mixed-citation></ref><ref id="ref-19"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Berman</surname><given-names>HM</given-names></name><name><surname>Westbrook</surname><given-names>J</given-names></name><name><surname>Feng</surname><given-names>Z</given-names></name><etal></etal></person-group>:
<article-title>The Protein Data Bank.</article-title><source><italic>Nucleic Acids Res.</italic></source><year>2000</year>;<volume>28</volume>(<issue>1</issue>):<fpage>235</fpage>–<lpage>242</lpage>.
<pub-id pub-id-type="doi">10.1093/nar/28.1.235</pub-id><pmc-comment>102472 </pmc-comment>
<pub-id pub-id-type="pmid">10592235</pub-id></mixed-citation></ref><ref id="ref-20"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Berners-Lee</surname><given-names>T</given-names></name><name><surname>De Roure</surname><given-names>D</given-names></name><name><surname>Harnad</surname><given-names>S</given-names></name><etal></etal></person-group>:
<article-title>Journal publishing and author self-archiving: Peaceful co-existence and fruitful collaboration.</article-title>Commentary On:
<ext-link ext-link-type="uri" xlink:href="http://www.alpsp.org/news/rcuk/default.htm">http://www.alpsp.org/news/rcuk/default.htm</ext-link>.<year>2005</year><ext-link ext-link-type="uri" xlink:href="http://eprints.soton.ac.uk/261160/.">Reference Source</ext-link></mixed-citation></ref><ref id="ref-21"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bernius</surname><given-names>S</given-names></name><name><surname>Hanauske</surname><given-names>M</given-names></name><name><surname>Dugall</surname><given-names>B</given-names></name><etal></etal></person-group>:
<article-title>Exploring the effects of a transition to open access: Insights from a simulation study.</article-title><source><italic>J Am Soc Inf Sci Technol.</italic></source><year>2013</year>;<volume>64</volume>(<issue>4</issue>):<fpage>701</fpage>–<lpage>726</lpage>.
<pub-id pub-id-type="doi">10.1002/asi.22772</pub-id></mixed-citation></ref><ref id="ref-22"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Birukou</surname><given-names>A</given-names></name><name><surname>Wakeling</surname><given-names>JR</given-names></name><name><surname>Bartolini</surname><given-names>C</given-names></name><etal></etal></person-group>:
<article-title>Alternatives to peer review: novel approaches for research evaluation.</article-title><source><italic>Front Comput Neurosci.</italic></source><year>2011</year>;<volume>5</volume>:<fpage>56</fpage>.
<pub-id pub-id-type="doi">10.3389/fncom.2011.00056</pub-id><pmc-comment>3237011 </pmc-comment>
<pub-id pub-id-type="pmid">22174702</pub-id></mixed-citation></ref><ref id="ref-23"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Björk</surname><given-names>BC</given-names></name><name><surname>Laakso</surname><given-names>M</given-names></name><name><surname>Welling</surname><given-names>P</given-names></name><etal></etal></person-group>:
<article-title>Anatomy of green open access.</article-title><source><italic>J Assoc Inf Sci Technol.</italic></source><year>2014</year>;<volume>65</volume>(<issue>2</issue>):<fpage>237</fpage>–<lpage>250</lpage>.
<pub-id pub-id-type="doi">10.1002/asi.22963</pub-id></mixed-citation></ref><ref id="ref-24"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bjork</surname><given-names>BC</given-names></name><name><surname>Roos</surname><given-names>A</given-names></name><name><surname>Lauri</surname><given-names>M</given-names></name></person-group>:
<article-title>Scientific journal publishing: yearly volume and open access availability.</article-title><source><italic>Inform Res.</italic></source><year>2009</year>;<volume>14</volume>(<issue>1</issue>).
<ext-link ext-link-type="uri" xlink:href="https://helda.helsinki.fi/bitstream/handle/10227/615/bjork_roos_lauri.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-25"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bloudoff-Indelicato</surname><given-names>M</given-names></name></person-group>:
<article-title>Text-mining block prompts online response.</article-title><source><italic>Nature News.</italic></source><year>2015</year>;<volume>527</volume>(<issue>7579</issue>):<fpage>413</fpage><pub-id pub-id-type="doi">10.1038/527413f</pub-id></mixed-citation></ref><ref id="ref-26"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Bogich</surname><given-names>T</given-names></name><name><surname>Ballesteros</surname><given-names>S</given-names></name><name><surname>Berjon</surname><given-names>R</given-names></name><etal></etal></person-group>:
<article-title>On the marginal cost of scholarly communication</article-title>.<year>2016</year> Accessed: 2016-3-24.
<ext-link ext-link-type="uri" xlink:href="https://research.science.ai/article/on-the-marginal-cost-of-scholarly-communication">Reference Source</ext-link></mixed-citation></ref><ref id="ref-27"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bohannon</surname><given-names>J</given-names></name></person-group>:
<article-title>Who’s afraid of peer review?</article-title><source><italic>Science.</italic></source><year>2013</year>;<volume>342</volume>(<issue>6154</issue>):<fpage>60</fpage>–<lpage>5</lpage>.
<pub-id pub-id-type="doi">10.1126/science.342.6154.60</pub-id><pub-id pub-id-type="pmid">24092725</pub-id></mixed-citation></ref><ref id="ref-28"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Bohannon</surname><given-names>J</given-names></name></person-group>:
<article-title>Who’s downloading pirated papers? everyone</article-title>.<year>2016</year>; Accessed:
2016-5-4.
<ext-link ext-link-type="uri" xlink:href="http://www.sciencemag.org/news/2016/04/whos-downloading-pirated-papers-everyone">Reference Source</ext-link></mixed-citation></ref><ref id="ref-29"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bowman</surname><given-names>JD</given-names></name></person-group>:
<article-title>Predatory publishing, questionable peer review, and fraudulent conferences.</article-title><source><italic>Am J Pharm Educ.</italic></source><year>2014</year>;<volume>78</volume>(<issue>10</issue>): 176.
<pub-id pub-id-type="doi">10.5688/ajpe7810176</pub-id><pmc-comment>4315198 </pmc-comment>
<pub-id pub-id-type="pmid">25657363</pub-id></mixed-citation></ref><ref id="ref-30"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brembs</surname><given-names>B</given-names></name><name><surname>Button</surname><given-names>K</given-names></name><name><surname>Munafò</surname><given-names>M</given-names></name></person-group>:
<article-title>Deep impact: unintended consequences of journal rank.</article-title><source><italic>Front Hum Neurosci.</italic></source><year>2013</year>;<volume>7</volume>:<fpage>291</fpage>.
<pub-id pub-id-type="doi">10.3389/fnhum.2013.00291</pub-id><pmc-comment>3690355 </pmc-comment>
<pub-id pub-id-type="pmid">23805088</pub-id></mixed-citation></ref><ref id="ref-31"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Brembs</surname><given-names>B</given-names></name></person-group>:
<article-title>What goes into making a scientific manuscript public</article-title>?<year>2015</year>; Accessed: 2016-3-24.
<ext-link ext-link-type="uri" xlink:href="http://bjoern.brembs.net/2015/06/what-goes-into-making-a-scientific-manuscript-public/">Reference Source</ext-link></mixed-citation></ref><ref id="ref-32"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Buttliere</surname><given-names>BT</given-names></name></person-group>:
<article-title>Using science and psychology to improve the dissemination and evaluation of scientific work.</article-title><source><italic>Front Comput Neurosci.</italic></source><year>2014</year>;<volume>8</volume>:<fpage>82</fpage>.
<pub-id pub-id-type="doi">10.3389/fncom.2014.00082</pub-id><pmc-comment>4137661 </pmc-comment>
<pub-id pub-id-type="pmid">25191261</pub-id></mixed-citation></ref><ref id="ref-33"><mixed-citation publication-type="journal"><collab>Capgemini</collab>:
<article-title>Creating value through open data: Study on the impact of re-use of public data resources.</article-title><source><italic>Digital Agenda for Europe.</italic></source><year>2015</year><ext-link ext-link-type="uri" xlink:href="https://www.europeandataportal.eu/sites/default/files/edp_creating_value_through_open_data_0.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-34"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Carp</surname><given-names>J</given-names></name></person-group>:
<article-title>On the plurality of (methodological) worlds: estimating the analytic flexibility of fMRI experiments.</article-title><source><italic>Front Neurosci.</italic></source><year>2012</year>;<volume>6</volume>:<fpage>149</fpage>.
<pub-id pub-id-type="doi">10.3389/fnins.2012.00149</pub-id><pmc-comment>3468892 </pmc-comment>
<pub-id pub-id-type="pmid">23087605</pub-id></mixed-citation></ref><ref id="ref-35"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Carr</surname><given-names>L</given-names></name><name><surname>Harnad</surname><given-names>S</given-names></name><name><surname>Swan</surname><given-names>A</given-names></name></person-group>:
<article-title>A longitudinal study of the practice of self-archiving.</article-title><source><italic>University of Southampton Working Paper.</italic></source><year>2007</year><ext-link ext-link-type="uri" xlink:href="http://www.ofuturescholar.com/paperpage?docid=512468">Reference Source</ext-link></mixed-citation></ref><ref id="ref-36"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Chamberlain</surname><given-names>S</given-names></name><name><surname>Boettiger</surname><given-names>C</given-names></name><name><surname>Ram</surname><given-names>K</given-names></name></person-group>:
<article-title>rplos: Interface to the Search ‘API’ for ‘PLoS’ Journals</article-title>.<year>2016</year><ext-link ext-link-type="uri" xlink:href="https://cran.r-project.org/web/packages/rplos/index.html">Reference Source</ext-link></mixed-citation></ref><ref id="ref-37"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Chan</surname><given-names>L</given-names></name><name><surname>Kirsop</surname><given-names>B</given-names></name><name><surname>Arunachalam</surname><given-names>S</given-names></name></person-group>:
<article-title>Open access archiving: the fast track to building research capacity in developing countries</article-title>.<year>2005</year><ext-link ext-link-type="uri" xlink:href="http://www.scidev.net/global/communication/feature/open-access-archiving-the-fast-track-to-building-r.html">Reference Source</ext-link></mixed-citation></ref><ref id="ref-38"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chatterjee</surname><given-names>P</given-names></name><name><surname>Biswas</surname><given-names>T</given-names></name><name><surname>Mishra</surname><given-names>V</given-names></name></person-group>:
<article-title>Open access: the changing face of scientific publishing.</article-title><source><italic>J Family Med Prim Care.</italic></source><year>2013</year>;<volume>2</volume>(<issue>2</issue>):<fpage>128</fpage>–<lpage>30</lpage>.
<pub-id pub-id-type="doi">10.4103/2249-4863.117400</pub-id><pmc-comment>3894027 </pmc-comment>
<pub-id pub-id-type="pmid">24479064</pub-id></mixed-citation></ref><ref id="ref-39"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cheng</surname><given-names>W</given-names></name><name><surname>Ren</surname><given-names>S</given-names></name></person-group>:
<article-title>Evolution of open access publishing in Chinese scientific journals.</article-title><source><italic>Learn Publ.</italic></source><year>2008</year>;<volume>21</volume>(<issue>2</issue>):<fpage>140</fpage>–<lpage>152</lpage>.
<pub-id pub-id-type="doi">10.1087/095315108X288884</pub-id></mixed-citation></ref><ref id="ref-40"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Colomb</surname><given-names>J</given-names></name><name><surname>Brembs</surname><given-names>B</given-names></name></person-group>:
<article-title>Sub-strains of
<italic>Drosophila</italic> Canton-S differ markedly in their locomotor behavior [version 2; referees: 3 approved].</article-title><source><italic>F1000Res.</italic></source><year>2015</year>;<volume>3</volume>:<fpage>176</fpage><pub-id pub-id-type="doi">10.12688/f1000research.4263.2</pub-id><pub-id pub-id-type="pmid">25210619</pub-id></mixed-citation></ref><ref id="ref-41"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Costas</surname><given-names>R</given-names></name><name><surname>Zahedi</surname><given-names>Z</given-names></name><name><surname>Wouters</surname><given-names>P</given-names></name></person-group>:
<article-title>Do “altmetrics” correlate with citations? extensive comparison of altmetric indicators with citations from a multidisciplinary perspective.</article-title><source><italic>J Assoc Inf Sci Technol.</italic></source><year>2015</year>;<volume>66</volume>:<fpage>2003</fpage>–<lpage>2019</lpage>.
<pub-id pub-id-type="doi">10.1002/asi.23309</pub-id></mixed-citation></ref><ref id="ref-42"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Crawford</surname><given-names>W</given-names></name></person-group>:
<article-title>Open Access Journals 2014, DOAJ subset</article-title>.<year>2015</year><pub-id pub-id-type="doi">10.6084/m9.figshare.1299451.v4</pub-id></mixed-citation></ref><ref id="ref-43"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Dallmeier-Tiessen</surname><given-names>S</given-names></name><name><surname>Darby</surname><given-names>R</given-names></name><name><surname>Goerner</surname><given-names>B</given-names></name><etal></etal></person-group>:
<article-title>Highlights from the soap project survey. What scientists think about open access publishing</article-title>. arXiv preprint arXiv:1101.5260.<year>2011</year><ext-link ext-link-type="uri" xlink:href="https://arxiv.org/ftp/arxiv/papers/1101/1101.5260.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-44"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Davis</surname><given-names>P</given-names></name><name><surname>Fromerth</surname><given-names>M</given-names></name></person-group>:
<article-title>Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles?</article-title><source><italic>Scientometrics.</italic></source><year>2007</year>;<volume>71</volume>(<issue>2</issue>):<fpage>203</fpage>–<lpage>215</lpage>.
<pub-id pub-id-type="doi">10.1007/s11192-007-1661-8</pub-id></mixed-citation></ref><ref id="ref-45"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Davis</surname><given-names>PM</given-names></name><name><surname>Lewenstein</surname><given-names>BV</given-names></name><name><surname>Simon</surname><given-names>DH</given-names></name><etal></etal></person-group>:
<article-title>Open access publishing, article downloads, and citations: randomised controlled trial.</article-title><source><italic>BMJ.</italic></source><year>2008</year>;
<bold>337</bold>:<fpage>a568</fpage>.
<pub-id pub-id-type="doi">10.1136/bmj.a568</pub-id><pmc-comment>2492576 </pmc-comment>
</mixed-citation></ref><ref id="ref-46"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Davis</surname><given-names>PM</given-names></name></person-group>:
<article-title>Open access, readership, citations: a randomized controlled trial of scientific journal publishing.</article-title><source><italic>FASEB J.</italic></source><year>2011</year>;<volume>25</volume>(<issue>7</issue>):<fpage>2129</fpage>–<lpage>2134</lpage>.
<pub-id pub-id-type="doi">10.1096/fj.11-183988</pub-id><pub-id pub-id-type="pmid">21450907</pub-id></mixed-citation></ref><ref id="ref-47"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Denicola</surname><given-names>R</given-names></name></person-group>:
<article-title>Copyright and open access: reconsidering university ownership of faculty research.</article-title><source><italic>Nebraska Law Review.</italic></source><year>2006</year>;<volume>85</volume>(<issue>2</issue>).
<ext-link ext-link-type="uri" xlink:href="http://digitalcommons.unl.edu/cgi/viewcontent.cgi?article=1115&context=nlr">Reference Source</ext-link></mixed-citation></ref><ref id="ref-48"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Denker</surname><given-names>SP</given-names></name></person-group>:
<article-title>Collaboration with IBM watson supports the value add of open access</article-title>.<year>2016</year><ext-link ext-link-type="uri" xlink:href="http://blogs.plos.org/plos/2016/03/collaboration-with-ibm-watson-supports-the-value-add-of-open-access-2/">Reference Source</ext-link></mixed-citation></ref><ref id="ref-49"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Derrida</surname><given-names>J</given-names></name></person-group>:
<article-title>Who’s afraid of philosophy?: Right to philosophy 1.</article-title>Stanford University Press,<year>2002</year>;
<bold>1</bold><ext-link ext-link-type="uri" xlink:href="https://books.google.co.in/books/about/Who_s_Afraid_of_Philosophy.html?id=103Koc9coZQC">Reference Source</ext-link></mixed-citation></ref><ref id="ref-50"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Djuric</surname><given-names>D</given-names></name></person-group>:
<article-title>Penetrating the omerta of predatory publishing: the Romanian connection.</article-title><source><italic>Sci Eng Ethics.</italic></source><year>2015</year>;<volume>21</volume>(<issue>1</issue>):<fpage>183</fpage>–<lpage>202</lpage>.
<pub-id pub-id-type="doi">10.1007/s11948-014-9521-4</pub-id><pub-id pub-id-type="pmid">24488723</pub-id></mixed-citation></ref><ref id="ref-51"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Dorch</surname><given-names>SBF</given-names></name><name><surname>Drachen</surname><given-names>TM</given-names></name><name><surname>Ellegaard</surname><given-names>O</given-names></name></person-group>:
<article-title>The data sharing advantage in Astrophysics</article-title>. arXiv,<year>2015</year><ext-link ext-link-type="uri" xlink:href="http://arxiv.org/abs/1511.02512">Reference Source</ext-link></mixed-citation></ref><ref id="ref-52"><mixed-citation publication-type="book"><collab>EFF</collab>:
<article-title>Big win for fair use in google books lawsuit</article-title>.<year>2015</year>; Accessed: 2016-4-26.
<ext-link ext-link-type="uri" xlink:href="https://www.eff.org/deeplinks/2015/10/big-win-fair-use-google-books-lawsuit">Reference Source</ext-link></mixed-citation></ref><ref id="ref-53"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Eger</surname><given-names>T</given-names></name><name><surname>Scheufen</surname><given-names>M</given-names></name></person-group>:
<article-title>The past and the future of copyright law: Technological change and beyond</article-title>.
<italic>Liber Amicorum Boudewijn Bouckaert</italic>, forthcoming.<year>2012</year>;<fpage>37</fpage>–<lpage>64</lpage>.
<ext-link ext-link-type="uri" xlink:href="https://www.researchgate.net/publication/280043122_The_past_and_the_future_of_copyright_law_technological_change_and_beyond">Reference Source</ext-link></mixed-citation></ref><ref id="ref-54"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Elbakyan</surname><given-names>A</given-names></name><name><surname>Bohannon</surname><given-names>J</given-names></name></person-group>:
<article-title>Data from: Who’s downloading pirated papers? everyone.</article-title><source><italic>Dryad Digital Repository.</italic></source><year>2016</year><pub-id pub-id-type="doi">10.5061/dryad.q447c</pub-id></mixed-citation></ref><ref id="ref-55"><mixed-citation publication-type="book"><collab>European Commission</collab>:
<article-title>Communication from the commission to the european parliament, the council, the european economic and social committee, and the committee of the regions</article-title>. Towards better access to scientific information: Boosting the benefits of public investments in research.<year>2012</year><ext-link ext-link-type="uri" xlink:href="https://ec.europa.eu/research/science-society/document_library/pdf_06/era-communication-towards-better-access-to-scientific-information_en.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-56"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Evans</surname><given-names>JA</given-names></name><name><surname>Reimer</surname><given-names>J</given-names></name></person-group>:
<article-title>Open access and global participation in science.</article-title><source><italic>Science.</italic></source><year>2009</year>;<volume>323</volume>(<issue>5917</issue>):<fpage>1025</fpage>.
<pub-id pub-id-type="doi">10.1126/science.1154562</pub-id><pub-id pub-id-type="pmid">19229029</pub-id></mixed-citation></ref><ref id="ref-57"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Eysenbach</surname><given-names>G</given-names></name></person-group>:
<article-title>Can tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact.</article-title><source><italic>J Med Internet Res.</italic></source><year>2011</year>;<volume>13</volume>(<issue>4</issue>):<fpage>e123</fpage>.
<pub-id pub-id-type="doi">10.2196/jmir.2012</pub-id><pmc-comment>3278109 </pmc-comment>
<pub-id pub-id-type="pmid">22173204</pub-id></mixed-citation></ref><ref id="ref-58"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Eysenbach</surname><given-names>G</given-names></name></person-group>:
<article-title>Citation advantage of open access articles.</article-title><source><italic>PLoS Biol.</italic></source><year>2006</year>;<volume>4</volume>(<issue>5</issue>):<fpage>e157</fpage>.
<pub-id pub-id-type="doi">10.1371/journal.pbio.0040157</pub-id><pmc-comment>1459247 </pmc-comment>
<pub-id pub-id-type="pmid">16683865</pub-id></mixed-citation></ref><ref id="ref-59"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Flynn</surname><given-names>S</given-names></name><name><surname>Hollis</surname><given-names>A</given-names></name><name><surname>Palmedo</surname><given-names>M</given-names></name></person-group>:
<article-title>An economic justification for open access to essential medicine patents in developing countries.</article-title><source><italic>J Law Med Ethics.</italic></source><year>2009</year>;<volume>37</volume>(<issue>2</issue>):<fpage>184</fpage>–<lpage>208</lpage>.
<pub-id pub-id-type="doi">10.1111/j.1748-720X.2009.00365.x</pub-id><pub-id pub-id-type="pmid">19493066</pub-id></mixed-citation></ref><ref id="ref-60"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Frandsen</surname><given-names>TF</given-names></name></person-group>:
<article-title>The integration of open access journals in the scholarly communication system: Three science fields.</article-title><source><italic>Inf Process Manag.</italic></source><year>2009</year>;<volume>45</volume>(<issue>1</issue>):<fpage>131</fpage>–<lpage>141</lpage>.
<pub-id pub-id-type="doi">10.1016/j.ipm.2008.06.001</pub-id></mixed-citation></ref><ref id="ref-61"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gargouri</surname><given-names>Y</given-names></name><name><surname>Hajjem</surname><given-names>C</given-names></name><name><surname>Larivière</surname><given-names>V</given-names></name><etal></etal></person-group>:
<article-title>Self-selected or mandated, open access increases citation impact for higher quality research.</article-title><source><italic>PLoS One.</italic></source><year>2010</year>;<volume>5</volume>(<issue>10</issue>):<fpage>e13636</fpage>.
<pub-id pub-id-type="doi">10.1371/journal.pone.0013636</pub-id><pmc-comment>2956678 </pmc-comment>
<pub-id pub-id-type="pmid">20976155</pub-id></mixed-citation></ref><ref id="ref-62"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Gargouri</surname><given-names>Y</given-names></name><name><surname>Larivière</surname><given-names>V</given-names></name><name><surname>Gingras</surname><given-names>Y</given-names></name><etal></etal></person-group>:
<article-title>Green and gold open access percentages and growth, by discipline.</article-title><source><italic>arXiv preprint arXiv:1206.3664.</italic></source><year>2012</year><ext-link ext-link-type="uri" xlink:href="http://arxiv.org/abs/1206.3664">Reference Source</ext-link></mixed-citation></ref><ref id="ref-63"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gaule</surname><given-names>P</given-names></name><name><surname>Maystre</surname><given-names>N</given-names></name></person-group>:
<article-title>Getting cited: does open access help?</article-title><source><italic>Res Policy.</italic></source><year>2011</year>;<volume>40</volume>(<issue>10</issue>):<fpage>1332</fpage>–<lpage>1338</lpage>.
<pub-id pub-id-type="doi">10.1016/j.respol.2011.05.025</pub-id></mixed-citation></ref><ref id="ref-64"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gentil-Beccot</surname><given-names>A</given-names></name><name><surname>Mele</surname><given-names>S</given-names></name><name><surname>Brooks</surname><given-names>T</given-names></name></person-group>:
<article-title>Citing and reading behaviours in high-energy physics.</article-title><source><italic>Scientometrics.</italic></source><year>2010</year>;<volume>84</volume>(<issue>2</issue>):<fpage>345</fpage>–<lpage>355</lpage>.
<pub-id pub-id-type="doi">10.1007/s11192-009-0111-1</pub-id></mixed-citation></ref><ref id="ref-65"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Ghosh</surname><given-names>SS</given-names></name><name><surname>Klein</surname><given-names>A</given-names></name><name><surname>Avants</surname><given-names>B</given-names></name><etal></etal></person-group>:
<article-title>Learning from open source software projects to improve scientific review.</article-title><source><italic>Front Comput Neurosci.</italic></source><year>2012</year>;
<bold>6</bold>:<fpage>18</fpage>.
<pub-id pub-id-type="doi">10.3389/fncom.2012.00018</pub-id><pmc-comment>3328792 </pmc-comment>
</mixed-citation></ref><ref id="ref-66"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Glenisson</surname><given-names>P</given-names></name><name><surname>Glänzel</surname><given-names>W</given-names></name><name><surname>Janssens</surname><given-names>F</given-names></name><etal></etal></person-group>:
<article-title>Combining full text and bibliometric information in mapping scientific disciplines.</article-title><source><italic>Inf Process Manag.</italic></source><year>2005</year>;<volume>41</volume>(<issue>6</issue>):<fpage>1548</fpage>–<lpage>1572</lpage>.
<pub-id pub-id-type="doi">10.1016/j.ipm.2005.03.021</pub-id></mixed-citation></ref><ref id="ref-67"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Glover</surname><given-names>M</given-names></name><name><surname>Buxton</surname><given-names>M</given-names></name><name><surname>Guthrie</surname><given-names>S</given-names></name><etal></etal></person-group>:
<article-title>Estimating the returns to UK publicly funded cancer-related research in terms of the net value of improved health outcomes.</article-title><source><italic>BMC Med.</italic></source><year>2014</year>;<volume>12</volume>(<issue>1</issue>):<fpage>99</fpage>.
<pub-id pub-id-type="doi">10.1186/1741-7015-12-99</pub-id><pmc-comment>4058434 </pmc-comment>
<pub-id pub-id-type="pmid">24930803</pub-id></mixed-citation></ref><ref id="ref-68"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gonzalez</surname><given-names>GH</given-names></name><name><surname>Tahsin</surname><given-names>T</given-names></name><name><surname>Goodale</surname><given-names>BC</given-names></name><etal></etal></person-group>:
<article-title>Recent Advances and Emerging Applications in Text and Data Mining for Biomedical Discovery.</article-title><source><italic>Brief Bioinform.</italic></source><year>2016</year>;<volume>17</volume>(<issue>1</issue>):<fpage>33</fpage>–<lpage>42</lpage>.
<pub-id pub-id-type="doi">10.1093/bib/bbv087</pub-id><pmc-comment>4719073 </pmc-comment>
<pub-id pub-id-type="pmid">26420781</pub-id></mixed-citation></ref><ref id="ref-69"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hajjem</surname><given-names>C</given-names></name><name><surname>Harnad</surname><given-names>S</given-names></name><name><surname>Gingras</surname><given-names>Y</given-names></name></person-group>:
<article-title>Ten-year cross-disciplinary comparison of the growth of open access and how it increases research citation impact</article-title>.<year>2006</year>; arXiv preprint cs/0606079.
<ext-link ext-link-type="uri" xlink:href="http://arxiv.org/abs/cs/0606079">Reference Source</ext-link></mixed-citation></ref><ref id="ref-70"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Handke</surname><given-names>C</given-names></name><name><surname>Guibault</surname><given-names>L</given-names></name><name><surname>Vallbé</surname><given-names>JJ</given-names></name></person-group>:
<article-title>Is Europe falling behind in data mining? Copyright’s impact on data mining in academic research</article-title>.<year>2015</year><pub-id pub-id-type="doi">10.2139/ssrn.2608513</pub-id></mixed-citation></ref><ref id="ref-71"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Harmston</surname><given-names>N</given-names></name><name><surname>Filsell</surname><given-names>W</given-names></name><name><surname>Stumpf</surname><given-names>MP</given-names></name></person-group>:
<article-title>What the papers say: text mining for genomics and systems biology.</article-title><source><italic>Hum Genomics.</italic></source><year>2010</year>;<volume>5</volume>(<issue>1</issue>):<fpage>17</fpage>–<lpage>29</lpage>.
<pub-id pub-id-type="doi">10.1186/1479-7364-5-1-17</pub-id><pmc-comment>3500154 </pmc-comment>
<pub-id pub-id-type="pmid">21106487</pub-id></mixed-citation></ref><ref id="ref-72"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Harnad</surname><given-names>S</given-names></name><name><surname>Brody</surname><given-names>T</given-names></name><name><surname>Vallieres</surname><given-names>F</given-names></name><etal></etal></person-group>:
<article-title>The access/impact problem and the green and gold roads to open access: An update.</article-title><source><italic>Serials Rev.</italic></source><year>2008</year>;<volume>34</volume>(<issue>1</issue>):<fpage>36</fpage>–<lpage>40</lpage>.
<pub-id pub-id-type="doi">10.1016/j.serrev.2007.12.005</pub-id></mixed-citation></ref><ref id="ref-73"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Harnad</surname><given-names>S</given-names></name><name><surname>Brody</surname><given-names>T</given-names></name></person-group>:
<article-title>Comparing the Impact of Open Access (OA) vs. Non-OA Articles in the Same Journals.</article-title><source><italic>D-lib Magazine.</italic></source><year>2004</year>;<volume>10</volume>(<issue>6</issue>).
<pub-id pub-id-type="doi">10.1045/june2004-harnad</pub-id></mixed-citation></ref><ref id="ref-74"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Harnad</surname><given-names>S</given-names></name></person-group>:
<article-title>Opening access by overcoming zeno’s paralysis</article-title>.<year>2006</year><ext-link ext-link-type="uri" xlink:href="http://eprints.soton.ac.uk/262094/2/harnad-jacobsbook.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-75"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Henneken</surname><given-names>EA</given-names></name><name><surname>Kurtz</surname><given-names>MJ</given-names></name><name><surname>Eichhorn</surname><given-names>G</given-names></name><etal></etal></person-group>:
<article-title>Effect of E-Printing on Citation Rates in Astronomy and Physics.</article-title><source><italic>arXiv.</italic></source><year>2006</year><ext-link ext-link-type="uri" xlink:href="http://arxiv.org/abs/cs/0604061">Reference Source</ext-link></mixed-citation></ref><ref id="ref-76"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hitchcock</surname><given-names>S</given-names></name></person-group>:
<article-title>The effect of open access and downloads (‘hits’) on citation impact: a bibliography of studies</article-title>.<year>2013</year><ext-link ext-link-type="uri" xlink:href="http://eprints.soton.ac.uk/354006/1/oacitation-biblio-snapshot0613.html">Reference Source</ext-link></mixed-citation></ref><ref id="ref-77"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hoorn</surname><given-names>E</given-names></name><name><surname>van der Graaf</surname><given-names>M</given-names></name></person-group>:
<article-title>Copyright issues in open access research journals: The authors perspective.</article-title><source><italic>D-Lib Magazine.</italic></source><year>2006</year>;<volume>12</volume>(<issue>2</issue>):<fpage>6</fpage><pub-id pub-id-type="doi">10.1045/february2006-vandergraaf</pub-id></mixed-citation></ref><ref id="ref-78"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Houghton</surname><given-names>JW</given-names></name><name><surname>Oppenheim</surname><given-names>C</given-names></name></person-group>:
<article-title>The economic implications of alternative publishing models.</article-title><source><italic>Prometheus.</italic></source><year>2010</year>;<volume>28</volume>(<issue>1</issue>):<fpage>41</fpage>–<lpage>54</lpage>.
<pub-id pub-id-type="doi">10.1080/08109021003676359</pub-id></mixed-citation></ref><ref id="ref-79"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ioannidis</surname><given-names>JP</given-names></name></person-group>:
<article-title>Scientific communication is down at the moment, please check again later.</article-title><source><italic>Psychol Inq.</italic></source><year>2012b</year>;<volume>23</volume>(<issue>3</issue>):<fpage>267</fpage>–<lpage>270</lpage>.
<pub-id pub-id-type="doi">10.1080/1047840X.2012.699427</pub-id></mixed-citation></ref><ref id="ref-80"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ioannidis</surname><given-names>JP</given-names></name></person-group>:
<article-title>Why most published research findings are false.</article-title><source><italic>PLoS Med.</italic></source><year>2005</year>;<volume>2</volume>(<issue>8</issue>):<fpage>e124</fpage>.
<pub-id pub-id-type="doi">10.1371/journal.pmed.0020124</pub-id><pmc-comment>1182327 </pmc-comment>
<pub-id pub-id-type="pmid">16060722</pub-id></mixed-citation></ref><ref id="ref-81"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ioannidis</surname><given-names>JP</given-names></name></person-group>:
<article-title>Why Science Is Not Necessarily Self-Correcting.</article-title><source><italic>Perspect Psychol Sci.</italic></source><year>2012a</year>:<volume>7</volume>(<issue>6</issue>):<fpage>645</fpage>–<lpage>654</lpage>.
<pub-id pub-id-type="doi">10.1177/1745691612464056</pub-id><pub-id pub-id-type="pmid">26168125</pub-id></mixed-citation></ref><ref id="ref-82"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>John</surname><given-names>LK</given-names></name><name><surname>Loewenstein</surname><given-names>G</given-names></name><name><surname>Prelec</surname><given-names>D</given-names></name></person-group>:
<article-title>Measuring the prevalence of questionable research practices with incentives for truth telling.</article-title><source><italic>Psychol Sci.</italic></source><year>2012</year>;<volume>23</volume>(<issue>5</issue>):<fpage>524</fpage>–<lpage>32</lpage>.
<pub-id pub-id-type="doi">10.1177/0956797611430953</pub-id><pub-id pub-id-type="pmid">22508865</pub-id></mixed-citation></ref><ref id="ref-83"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Khabsa</surname><given-names>M</given-names></name><name><surname>Giles</surname><given-names>CL</given-names></name></person-group>:
<article-title>The number of scholarly documents on the public web.</article-title><source><italic>PLoS One.</italic></source><year>2014</year>;<volume>9</volume>(<issue>5</issue>):<fpage>e93949</fpage>.
<pub-id pub-id-type="doi">10.1371/journal.pone.0093949</pub-id><pmc-comment>4015892 </pmc-comment>
<pub-id pub-id-type="pmid">24817403</pub-id></mixed-citation></ref><ref id="ref-84"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kmietowicz</surname><given-names>Z</given-names></name></person-group>:
<article-title>Publishers withdraw 2500 journals from free access scheme in Bangladesh.</article-title><source><italic>BMJ.</italic></source><year>2011</year>;<volume>342</volume>:<fpage>d196</fpage><ext-link ext-link-type="uri" xlink:href="http://www.bmj.com/content/342/bmj.d196">Reference Source</ext-link></mixed-citation></ref><ref id="ref-85"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Knobloch</surname><given-names>J</given-names></name><name><surname>Albiez</surname><given-names>EJ</given-names></name><name><surname>Schmitz</surname><given-names>H</given-names></name></person-group>:
<article-title>A serological survey on viral haemorrhagic fevers in Liberia.</article-title>In
<italic>Annales de l’Institut Pasteur/Virologie.</italic>Elsevier.<year>1982</year>;<volume>133</volume>:<fpage>125</fpage>–<lpage>128</lpage>.
<pub-id pub-id-type="doi">10.1016/S0769-2617(82)80028-2</pub-id></mixed-citation></ref><ref id="ref-86"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kousha</surname><given-names>K</given-names></name><name><surname>Abdoli</surname><given-names>M</given-names></name></person-group>:
<article-title>The citation impact of Open Access agricultural research: A comparison between OA and non-OA publications.</article-title><source><italic>Online Inform Rev.</italic></source><year>2010</year>;<volume>34</volume>(<issue>5</issue>):<fpage>772</fpage>–<lpage>785</lpage>.
<pub-id pub-id-type="doi">10.1108/14684521011084618</pub-id></mixed-citation></ref><ref id="ref-87"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kriegeskorte</surname><given-names>N</given-names></name><name><surname>Walther</surname><given-names>A</given-names></name><name><surname>Deca</surname><given-names>D</given-names></name></person-group>:
<article-title>An emerging consensus for open evaluation: 18 visions for the future of scientific publishing.</article-title><source><italic>Front Comput Neurosci.</italic></source><year>2012</year>;<volume>6</volume>:<fpage>94</fpage>.
<pub-id pub-id-type="doi">10.3389/fncom.2012.00094</pub-id><pmc-comment>3498742 </pmc-comment>
<pub-id pub-id-type="pmid">23162460</pub-id></mixed-citation></ref><ref id="ref-88"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kurtz</surname><given-names>MJ</given-names></name><name><surname>Eichhorn</surname><given-names>G</given-names></name><name><surname>Accomazzi</surname><given-names>A</given-names></name><etal></etal></person-group>:
<article-title>The effect of use and access on citations.</article-title><source><italic>Inf Process Manag.</italic></source><year>2005</year>;<volume>41</volume>(<issue>6</issue>):<fpage>1395</fpage>–<lpage>1402</lpage>.
<pub-id pub-id-type="doi">10.1016/j.ipm.2005.03.010</pub-id></mixed-citation></ref><ref id="ref-89"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Kurtz</surname><given-names>MJ</given-names></name><name><surname>Henneken</surname><given-names>EA</given-names></name></person-group>:
<article-title>Open Access does not increase citations for research articles from The Astrophysical Journal.</article-title><source><italic>arXiv.</italic></source><year>2007</year><ext-link ext-link-type="uri" xlink:href="http://arxiv.org/abs/0709.0896">Reference Source</ext-link></mixed-citation></ref><ref id="ref-90"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Laakso</surname><given-names>M</given-names></name><name><surname>Björk</surname><given-names>BC</given-names></name></person-group>:
<article-title>Anatomy of open access publishing: a study of longitudinal development and internal structure.</article-title><source><italic>BMC Med.</italic></source><year>2012</year>;<volume>10</volume>(<issue>1</issue>):<fpage>124</fpage>. ISSN 1741-7015.
<pub-id pub-id-type="doi">10.1186/1741-7015-10-124</pub-id><pmc-comment>3478161 </pmc-comment>
<pub-id pub-id-type="pmid">23088823</pub-id></mixed-citation></ref><ref id="ref-91"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Laakso</surname><given-names>M</given-names></name><name><surname>Welling</surname><given-names>P</given-names></name><name><surname>Bukvova</surname><given-names>H</given-names></name><etal></etal></person-group>:
<article-title>The development of open access journal publishing from 1993 to 2009.</article-title><source><italic>PLoS One.</italic></source><year>2011</year>;<volume>6</volume>(<issue>6</issue>):<fpage>e20961</fpage>.
<pub-id pub-id-type="doi">10.1371/journal.pone.0020961</pub-id><pmc-comment>3113847 </pmc-comment>
<pub-id pub-id-type="pmid">21695139</pub-id></mixed-citation></ref><ref id="ref-92"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lansingh</surname><given-names>VC</given-names></name><name><surname>Carter</surname><given-names>MJ</given-names></name></person-group>:
<article-title>Does open access in ophthalmology affect how articles are subsequently cited in research?</article-title><source><italic>Ophthalmology.</italic></source><year>2009</year>;<volume>116</volume>(<issue>8</issue>):<fpage>1425</fpage>–<lpage>1431</lpage>.
<pub-id pub-id-type="doi">10.1016/j.ophtha.2008.12.052</pub-id><pub-id pub-id-type="pmid">19545905</pub-id></mixed-citation></ref><ref id="ref-93"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Larivière</surname><given-names>V</given-names></name><name><surname>Haustein</surname><given-names>S</given-names></name><name><surname>Mongeon</surname><given-names>P</given-names></name></person-group>:
<article-title>The Oligopoly of Academic Publishers in the Digital Era.</article-title><source><italic>PLoS One.</italic></source><year>2015</year>;<volume>10</volume>(<issue>6</issue>):<fpage>e0127502</fpage>.
<pub-id pub-id-type="doi">10.1371/journal.pone.0127502</pub-id><pmc-comment>4465327 </pmc-comment>
<pub-id pub-id-type="pmid">26061978</pub-id></mixed-citation></ref><ref id="ref-94"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lawrence</surname><given-names>S</given-names></name></person-group>:
<article-title>Online or invisible?</article-title><source><italic>Nature.</italic></source><year>2001</year>;<volume>411</volume>(<issue>6837</issue>):<fpage>521</fpage><ext-link ext-link-type="uri" xlink:href="http://www.idemployee.id.tue.nl/g.w.m.rauterberg/publications/CITESEER2001online-nature.pdf">Reference Source</ext-link><pub-id pub-id-type="pmid">11385534</pub-id></mixed-citation></ref><ref id="ref-95"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lawson</surname><given-names>S</given-names></name><name><surname>Meghreblian</surname><given-names>B</given-names></name></person-group>:
<article-title>Journal subscription expenditure of UK higher education institutions [version 3; referees: 4 approved].</article-title><source><italic>F1000Res.</italic></source><year>2015</year>;<volume>3</volume>(<issue>274</issue>).
<pub-id pub-id-type="doi">10.12688/f1000research.5706.3</pub-id><pmc-comment>4304214 </pmc-comment>
<pub-id pub-id-type="pmid">25653840</pub-id></mixed-citation></ref><ref id="ref-96"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lawson</surname><given-names>S</given-names></name></person-group>:
<article-title>Fee waivers for open access journals.</article-title><source><italic>Publications.</italic></source><year>2015</year>;<volume>3</volume>(<issue>3</issue>):<fpage>155</fpage>–<lpage>167</lpage>.
<pub-id pub-id-type="doi">10.3390/publications3030155</pub-id></mixed-citation></ref><ref id="ref-97"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Leek</surname><given-names>JT</given-names></name><name><surname>Taub</surname><given-names>MA</given-names></name><name><surname>Pineda</surname><given-names>FJ</given-names></name></person-group>:
<article-title>Cooperation between referees and authors increases peer review accuracy.</article-title><source><italic> PLoS One.</italic></source><year>2011</year>;<volume>6</volume>(<issue>11</issue>):<fpage>e26895</fpage>.
<pub-id pub-id-type="doi">10.1371/journal.pone.0026895</pub-id><pmc-comment>3212530 </pmc-comment>
<pub-id pub-id-type="pmid">22096506</pub-id></mixed-citation></ref><ref id="ref-98"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Leitner</surname><given-names>F</given-names></name><name><surname>Valencia</surname><given-names>A</given-names></name></person-group>:
<article-title>A text-mining perspective on the requirements for electronically annotated abstracts.</article-title><source><italic>FEBS Lett.</italic></source><year>2008</year>;<volume>582</volume>(<issue>8</issue>):<fpage>1178</fpage>–<lpage>81</lpage>.
<pub-id pub-id-type="doi">10.1016/j.febslet.2008.02.072</pub-id><pub-id pub-id-type="pmid">18328824</pub-id></mixed-citation></ref><ref id="ref-99"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Liang</surname><given-names>X</given-names></name><name><surname>Su</surname><given-names>LY</given-names></name><name><surname>Yeo</surname><given-names>SK</given-names></name><etal></etal></person-group>:
<article-title>Building buzz (scientists) communicating science in new media environments.</article-title><source><italic>Journal Mass Commun Q.</italic></source><year>2014</year>;<volume>91</volume>(<issue>4</issue>):<fpage>772</fpage>–<lpage>791</lpage>.
<pub-id pub-id-type="doi">10.1177/1077699014550092</pub-id></mixed-citation></ref><ref id="ref-100"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>MacKie-Mason</surname><given-names>J</given-names></name></person-group>:
<article-title>Economic thoughts about “gold” open access</article-title>.<year>2016</year>; Accessed: 2016-4-27.
<ext-link ext-link-type="uri" xlink:href="http://madlibbing.berkeley.edu/economic-thoughts-about-gold-open-access/">Reference Source</ext-link></mixed-citation></ref><ref id="ref-101"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Malhotra</surname><given-names>A</given-names></name><name><surname>Younesi</surname><given-names>E</given-names></name><name><surname>Gurulingappa</surname><given-names>H</given-names></name><etal></etal></person-group>:
<article-title>‘HypothesisFinder:’ a strategy for the detection of speculative statements in scientific text.</article-title><source><italic>PLoS Comput Biol.</italic></source><year>2013</year>;<volume>9</volume>(<issue>7</issue>):<fpage>e1003117</fpage>.
<pub-id pub-id-type="doi">10.1371/journal.pcbi.1003117</pub-id><pmc-comment>3723489 </pmc-comment>
<pub-id pub-id-type="pmid">23935466</pub-id></mixed-citation></ref><ref id="ref-102"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Manyika</surname><given-names>J</given-names></name><name><surname>Chui</surname><given-names>M</given-names></name><name><surname>Groves</surname><given-names>P</given-names></name><etal></etal></person-group>:
<article-title>Open data: Unlocking innovation and performance with liquid information.</article-title><italic>McKinsey global institute. McKinsey Center for Government and McKinsey Business Technology Office</italic><year>2013</year><ext-link ext-link-type="uri" xlink:href="http://www.mckinsey.com/business-functions/business-technology/our-insights/open-data-unlocking-innovation-and-performance-with-liquid-information">Reference Source</ext-link></mixed-citation></ref><ref id="ref-103"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Martone</surname><given-names>M</given-names></name><name><surname>Murray-Rust</surname><given-names>P</given-names></name><name><surname>Molloy</surname><given-names>J</given-names></name><etal></etal></person-group>:
<article-title>Contentmine/hypothes.is proposal.</article-title><source><italic>Research Ideas and Outcomes.</italic></source><year>2016</year>;<volume>2</volume>:<fpage>e8424</fpage><pub-id pub-id-type="doi">10.3897/rio.2.e8424</pub-id></mixed-citation></ref><ref id="ref-104"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Matheka</surname><given-names>DM</given-names></name><name><surname>Nderitu</surname><given-names>J</given-names></name><name><surname>Mutonga</surname><given-names>D</given-names></name><etal></etal></person-group>:
<article-title>Open access: academic publishing and its implications for knowledge equity in kenya.</article-title><source><italic>Global Health.</italic></source><year>2014</year>;<volume>10</volume>(<issue>1</issue>):<fpage>26</fpage>.
<pub-id pub-id-type="doi">10.1186/1744-8603-10-26</pub-id><pmc-comment>4046522 </pmc-comment>
<pub-id pub-id-type="pmid">24716579</pub-id></mixed-citation></ref><ref id="ref-105"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mazzucato</surname><given-names>M</given-names></name></person-group>:
<article-title>The entrepreneurial state.</article-title><source><italic>Soundings.</italic></source><year>2011</year>;<volume>49</volume>(<issue>49</issue>):<fpage>131</fpage>–<lpage>142</lpage>.
<pub-id pub-id-type="doi">10.3898/136266211798411183</pub-id></mixed-citation></ref><ref id="ref-106"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>McCabe</surname><given-names>M</given-names></name><name><surname>Snyder</surname><given-names>CM</given-names></name></person-group>:
<article-title>Identifying the effect of open access on citations using a panel of science journals.</article-title><source><italic>Econ Inq.</italic></source><year>2014</year>;<volume>52</volume>(<issue>4</issue>):<fpage>1284</fpage>–<lpage>1300</lpage>.
<pub-id pub-id-type="doi">10.1111/ecin.12064</pub-id></mixed-citation></ref><ref id="ref-107"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>McGlynn</surname><given-names>T</given-names></name></person-group>:
<article-title>The evolution of pseudojournals</article-title>.
<italic>Small Pond Science</italic> Dominguez Hills, CA,<year>2013</year><ext-link ext-link-type="uri" xlink:href="https://smallpondscience.com/2013/02/14/the-evolution-of-pseudojournals/">Reference Source</ext-link></mixed-citation></ref><ref id="ref-108"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>McGuigan</surname><given-names>GS</given-names></name><name><surname>Russel</surname><given-names>RD</given-names></name></person-group>:
<article-title>The business of academic publishing: A strategic analysis of the academic journal publishing industry and its impact on the future of scholarly publishing.</article-title><source><italic>Electron Journal of Academic and Special Librarianship.</italic></source><year>2008</year>;<volume>9</volume>(<issue>3</issue>).
<ext-link ext-link-type="uri" xlink:href="http://southernlibrarianship.icaap.org/content/v09n03/_g01.html">Reference Source</ext-link></mixed-citation></ref><ref id="ref-109"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>McKiernan</surname><given-names>E</given-names></name><name><surname>Bourne</surname><given-names>PE</given-names></name><name><surname>Brown</surname><given-names>CT</given-names></name><etal></etal></person-group>:
<article-title>The open research value proposition: How sharing can help researchers succeed.</article-title><source><italic>Figshare.</italic></source><year>2016</year>;<volume>1</volume><pub-id pub-id-type="doi">10.6084/m9.figshare.1619902.v2</pub-id></mixed-citation></ref><ref id="ref-110"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>McVeigh</surname><given-names>ME</given-names></name></person-group>:
<article-title>Open access journals in the ISI citation databases: analysis of impact factors and citation patterns: a citation study from Thomson Scientific</article-title>. Thomson Scientific.<year>2004</year><ext-link ext-link-type="uri" xlink:href="http://ip-science.thomsonreuters.com/m/pdfs/openaccesscitations2.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-111"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Metcalfe</surname><given-names>TS</given-names></name></person-group>:
<article-title>The citation impact of digital preprint archives for solar physics papers.</article-title><source><italic>Sol Phys.</italic></source><year>2006</year>;<volume>239</volume>(<issue>1–2</issue>):<fpage>549</fpage>–<lpage>553</lpage>.
<pub-id pub-id-type="doi">10.1007/s11207-006-0262-7</pub-id></mixed-citation></ref><ref id="ref-112"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Metcalfe</surname><given-names>TS</given-names></name></person-group>:
<article-title>The rise and citation impact of astroph in major journals</article-title>.
<italic>arXiv preprint astro-ph/0503519</italic><year>2005</year><ext-link ext-link-type="uri" xlink:href="http://arxiv.org/pdf/astro-ph/0503519.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-113"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Moed</surname><given-names>H</given-names></name></person-group>:
<article-title>The effect of “open access” upon citation impact: an analysis of arxiv’s condensed matter section</article-title>.<year>2006</year><ext-link ext-link-type="uri" xlink:href="http://arxiv.org/abs/cs.DL/0611060">Reference Source</ext-link></mixed-citation></ref><ref id="ref-114"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mohammadi</surname><given-names>E</given-names></name><name><surname>Thelwall</surname><given-names>M</given-names></name><name><surname>Haustein</surname><given-names>S</given-names></name><etal></etal></person-group>:
<article-title>Who reads research articles? an altmetrics analysis of Mendeley user categories.</article-title><source><italic>J Assoc Inf Sci Technol.</italic></source><year>2015</year>;<volume>66</volume>(<issue>9</issue>):<fpage>1832</fpage>–<lpage>1846</lpage>.
<pub-id pub-id-type="doi">10.1002/asi.23286</pub-id></mixed-citation></ref><ref id="ref-115"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Müller-Langer</surname><given-names>F</given-names></name><name><surname>Watt</surname><given-names>R</given-names></name></person-group>:
<article-title>Copyright and open access for academic works</article-title>.
<italic>Review of Economic Research on Copyright Issues</italic><year>2010</year>;<volume>7</volume>(<issue>1</issue>):<fpage>45</fpage>–<lpage>65</lpage>.
<ext-link ext-link-type="uri" xlink:href="http://www.serci.org/2010/frank.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-116"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Natarajan</surname><given-names>J</given-names></name><name><surname>Berrar</surname><given-names>D</given-names></name><name><surname>Dubitzky</surname><given-names>W</given-names></name><etal></etal></person-group>:
<article-title>Text mining of full-text journal articles combined with gene expression analysis reveals a relationship between sphingosine-1-phosphate and invasiveness of a glioblastoma cell line.</article-title><source><italic>BMC Bioinformatics.</italic></source><year>2006</year>;<volume>7</volume>(<issue>1</issue>):<fpage>373</fpage>.
<pub-id pub-id-type="doi">10.1186/1471-2105-7-373</pub-id><pmc-comment>1557675 </pmc-comment>
<pub-id pub-id-type="pmid">16901352</pub-id></mixed-citation></ref><ref id="ref-117"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Neto</surname><given-names>SC</given-names></name><name><surname>Willinsky</surname><given-names>J</given-names></name><name><surname>Alperin</surname><given-names>J</given-names></name></person-group>:
<article-title>Measuring, rating, supporting, and strengthening open access scholarly publishing in brazil.</article-title><source><italic>Educ Policy Anal Arch.</italic></source><year>2016</year>;<volume>24</volume>(<issue>0</issue>):<fpage>54</fpage> ISSN 1068-2341.
<pub-id pub-id-type="doi">10.14507/epaa.24.2391</pub-id></mixed-citation></ref><ref id="ref-118"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Norris</surname><given-names>M</given-names></name><name><surname>Oppenheim</surname><given-names>C</given-names></name><name><surname>Rowland</surname><given-names>F</given-names></name></person-group>:
<article-title>Open access citation rates and developing countries.</article-title>In
<italic>ELPUB</italic><year>2008</year>;<fpage>335</fpage>–<lpage>342</lpage>.
<ext-link ext-link-type="uri" xlink:href="https://www.google.co.in/url?sa=t&rct&j&q=&esrc=s&source=web&cd=3&cad=rja&uact=8&ved=0ahUKEwj5ptrx6u_LAhWEGY4KHfyhAF4QFggqMAI&url=http%3A%2F%2Felpub.scix.net%2Fdata%2Fworks%2Fatt%2F335_elpub2008.content.pdf&usg=AFQjCNFWvDHPl58bTwqurceoj6Fadq-eTw">Reference Source</ext-link></mixed-citation></ref><ref id="ref-119"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Nosek</surname><given-names>BA</given-names></name><name><surname>Bar-Anan</surname><given-names>Y</given-names></name></person-group>:
<article-title>Scientific utopia: I. opening scientific communication.</article-title><source><italic>Psychol Inq.</italic></source><year>2012</year>;<volume>23</volume>(<issue>3</issue>):<fpage>217</fpage>–<lpage>243</lpage>.
<pub-id pub-id-type="doi">10.1080/1047840X.2012.692215</pub-id></mixed-citation></ref><ref id="ref-120"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Nuijten</surname><given-names>MB</given-names></name><name><surname>Hartgerink</surname><given-names>CH</given-names></name><name><surname>van Assen</surname><given-names>MA</given-names></name><etal></etal></person-group>:
<article-title>The prevalence of statistical reporting errors in psychology (1985–2013).</article-title><source><italic>Behav Res Methods.</italic></source><year>2015</year>;<fpage>1</fpage>–<lpage>22</lpage>. ISSN 1554-351X, 1554-3528.
<pub-id pub-id-type="doi">10.3758/s13428-015-0664-2</pub-id><pub-id pub-id-type="pmid">24683129</pub-id></mixed-citation></ref><ref id="ref-121"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Odlyzko</surname><given-names>A</given-names></name></person-group>:
<article-title>Economic costs of toll access.</article-title><source><italic>Open Access: Key Strategic, Technical and Economic Aspects.</italic></source><year>2006</year>;<volume>4</volume>:<fpage>39</fpage>–<lpage>43</lpage>.
<pub-id pub-id-type="doi">10.1016/B978-1-84334-203-8.50004-2</pub-id></mixed-citation></ref><ref id="ref-122"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Odlyzko</surname><given-names>AM</given-names></name></person-group>:
<article-title>Open Access, library and publisher competition, and the evolution of general commerce.</article-title><source><italic>CoRR.</italic></source>abs/1302.1105,<year>2013</year><ext-link ext-link-type="uri" xlink:href="http://arxiv.org/pdf/1302.1105v1.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-123"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Okerson</surname><given-names>A</given-names></name></person-group>:
<article-title>With feathers: Effects of copyright and ownership on scholarly publishing.</article-title><source><italic>Coll Res Libr.</italic></source><year>1991</year>;<volume>52</volume>(<issue>5</issue>):<fpage>425</fpage>–<lpage>38</lpage>.
<pub-id pub-id-type="doi">10.5860/crl_52_05_425</pub-id></mixed-citation></ref><ref id="ref-124"><mixed-citation publication-type="journal"><collab>Open Access NL</collab>:
<article-title>Amendment to copyright act</article-title>.<year>2015</year>; Accessed: 2016-4-27.
<ext-link ext-link-type="uri" xlink:href="https://web.archive.org/web/20160427064302/http://www.openaccess.nl/en/events/amendment-to-copyright-act">Reference Source</ext-link></mixed-citation></ref><ref id="ref-125"><mixed-citation publication-type="journal"><collab>Open Science Collaboration</collab>:
<article-title>PSYCHOLOGY. Estimating the reproducibility of psychological science.</article-title><source><italic>Science.</italic></source><year>2015</year>;<volume>349</volume>(<issue>6251</issue>):<fpage>aac4716</fpage>.
<pub-id pub-id-type="doi">10.1126/science.aac4716</pub-id><pub-id pub-id-type="pmid">26315443</pub-id></mixed-citation></ref><ref id="ref-126"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Packer</surname><given-names>AL</given-names></name></person-group>:
<article-title>The SciELO Open Access: A Gold Way from the South.</article-title><source><italic>Can J High Educ.</italic></source><year>2009</year>;<volume>39</volume>(<issue>3</issue>):<fpage>111</fpage>–<lpage>126</lpage>.
<ext-link ext-link-type="uri" xlink:href="http://journals.sfu.ca/cjhe/index.php/cjhe/article/view/479/504">Reference Source</ext-link></mixed-citation></ref><ref id="ref-127"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Piwowar</surname><given-names>H</given-names></name></person-group>:
<article-title>Altmetrics: Value all research products.</article-title><source><italic>Nature.</italic></source><year>2013</year>;<volume>493</volume>(<issue>7431</issue>):<fpage>159</fpage>.
<pub-id pub-id-type="doi">10.1038/493159a</pub-id><pub-id pub-id-type="pmid">23302843</pub-id></mixed-citation></ref><ref id="ref-128"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Piwowar</surname><given-names>HA</given-names></name><name><surname>Day</surname><given-names>RS</given-names></name><name><surname>Fridsma</surname><given-names>DB</given-names></name></person-group>:
<article-title>Sharing detailed research data is associated with increased citation rate.</article-title><source><italic>PLoS One.</italic></source><year>2007</year>;<volume>2</volume>(<issue>3</issue>):<fpage>e308</fpage>.
<pub-id pub-id-type="doi">10.1371/journal.pone.0000308</pub-id><pmc-comment>1817752 </pmc-comment>
<pub-id pub-id-type="pmid">17375194</pub-id></mixed-citation></ref><ref id="ref-129"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Piwowar</surname><given-names>HA</given-names></name><name><surname>Vision</surname><given-names>TJ</given-names></name></person-group>:
<article-title>Data reuse and the open data citation advantage.</article-title><source><italic>PeerJ.</italic></source><year>2013</year>;<volume>1</volume>:<fpage>e175. ISSN 2167</fpage>-<lpage>8359</lpage>.
<pub-id pub-id-type="doi">10.7717/peerj.175</pub-id><pmc-comment>3792178 </pmc-comment>
<pub-id pub-id-type="pmid">24109559</pub-id></mixed-citation></ref><ref id="ref-130"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pomerantz</surname><given-names>J</given-names></name><name><surname>Peek</surname><given-names>R</given-names></name></person-group>:
<article-title>Fifty shades of open.</article-title><source><italic>First Monday.</italic></source><year>2016</year>;<volume>21</volume>(<issue>5</issue>): ISSN 13960466.
<pub-id pub-id-type="doi">10.5210/fm.v21i5.6360</pub-id></mixed-citation></ref><ref id="ref-131"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Porter</surname><given-names>AL</given-names></name><name><surname>Kongthon</surname><given-names>A</given-names></name><name><surname>Lu</surname><given-names>JC</given-names></name></person-group>:
<article-title>Research profiling: Improving the literature review.</article-title><source><italic>Scientometrics.</italic></source><year>2002</year>;<volume>53</volume>(<issue>3</issue>):<fpage>351</fpage>–<lpage>370</lpage>.
<pub-id pub-id-type="doi">10.1023/A:1014873029258</pub-id></mixed-citation></ref><ref id="ref-132"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pöschl</surname><given-names>U</given-names></name></person-group>:
<article-title>Multi-stage open peer review: scientific evaluation integrating the strengths of traditional peer review with the virtues of transparency and self-regulation.</article-title><source><italic>Front Comput Neurosci.</italic></source><year>2012</year>;<volume>6</volume>:<fpage>33</fpage>.
<pub-id pub-id-type="doi">10.3389/fncom.2012.00033</pub-id><pmc-comment>3389610 </pmc-comment>
<pub-id pub-id-type="pmid">22783183</pub-id></mixed-citation></ref><ref id="ref-133"><mixed-citation publication-type="journal"><collab>Research Information Network</collab>:
<article-title>Activities, costs and funding flows in the scholarly communications system in the UK.</article-title>Technical report,<year>2008</year><ext-link ext-link-type="uri" xlink:href="http://www.rin.ac.uk/system/files/attachments/Activites-costs-flows-report.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-134"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Rosenwald</surname><given-names>MS</given-names></name></person-group>:
<article-title>This student put 50 million stolen research articles online. And they’re free</article-title>.<year>2016</year>; Accessed: 2016-4-26.
<ext-link ext-link-type="uri" xlink:href="https://www.washingtonpost.com/local/this-student-put-50-million-stolenresearch-articles-online-and-theyrefree/2016/03/30/7714ffb4-eaf7-11e5-b0fd-073d5930a7b7_story.html">Reference Source</ext-link></mixed-citation></ref><ref id="ref-135"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sahu</surname><given-names>DK</given-names></name><name><surname>Gogtay</surname><given-names>NJ</given-names></name><name><surname>Bavdekar</surname><given-names>SB</given-names></name></person-group>:
<article-title>Effect of open access on citation rates for a small biomedical journal</article-title>.
<italic>Fifth International Congress on Peer Review and Biomedical Publication, Chicago, September 16-18</italic>,<year>2005</year><ext-link ext-link-type="uri" xlink:href="https://www.researchgate.net/publication/36446808_Effect_of_open_access_on_citation_rates_for_a_small_biomedical_journal">Reference Source</ext-link></mixed-citation></ref><ref id="ref-136"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Satyanarayana</surname><given-names>K</given-names></name></person-group>:
<article-title>Journal publishing: the changing landscape.</article-title><source><italic>Indian J Med Res.</italic></source><year>2013</year>;<volume>138</volume>(<issue>1</issue>):<fpage>4</fpage>–<lpage>7</lpage>.
<pmc-comment>3767268 </pmc-comment>
<pub-id pub-id-type="pmid">24056548</pub-id></mixed-citation></ref><ref id="ref-137"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Scheufen</surname><given-names>M</given-names></name></person-group>:
<article-title>Copyright Versus Open Access: On the Organisation and International Political Economy of Access to Scientific Knowledge.</article-title>Springer,<year>2015</year><pub-id pub-id-type="doi">10.1007/978-3-319-12739-2</pub-id></mixed-citation></ref><ref id="ref-138"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schimmer</surname><given-names>R</given-names></name><name><surname>Geschuhn</surname><given-names>KK</given-names></name><name><surname>Vogler</surname><given-names>A</given-names></name></person-group>:
<article-title>Disrupting the subscription journals’ business model for the necessary large-scale transformation to open access</article-title>.<year>2015</year><pub-id pub-id-type="doi">10.17617/1.3</pub-id></mixed-citation></ref><ref id="ref-139"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schimmer</surname><given-names>R</given-names></name><name><surname>Geschuhn</surname><given-names>KK</given-names></name><name><surname>Vogler</surname><given-names>A</given-names></name></person-group>:
<article-title>Disrupting the subscription journals’ business model for the necessary large-scale transformation to open access</article-title>.<year>2015</year><pub-id pub-id-type="doi">10.17617/1.3</pub-id></mixed-citation></ref><ref id="ref-140"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schroter</surname><given-names>S</given-names></name><name><surname>Tite</surname><given-names>L</given-names></name><name><surname>Smith</surname><given-names>R</given-names></name></person-group>:
<article-title>Perceptions of open access publishing: interviews with journal authors.</article-title><source><italic>BMJ.</italic></source><year>2005</year>;<volume>330</volume>(<issue>7494</issue>):<fpage>756</fpage>.
<pub-id pub-id-type="doi">10.1136/bmj.38359.695220.82</pub-id><pmc-comment>555876 </pmc-comment>
<pub-id pub-id-type="pmid">15677363</pub-id></mixed-citation></ref><ref id="ref-141"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schroter</surname><given-names>S</given-names></name><name><surname>Tite</surname><given-names>L</given-names></name></person-group>:
<article-title>Open access publishing and author-pays business models: a survey of authors' knowledge and perceptions.</article-title><source><italic>J R Soc Med.</italic></source><year>2006</year>;<volume>99</volume>(<issue>3</issue>):<fpage>141</fpage>–<lpage>148</lpage>.
<pub-id pub-id-type="doi">10.1258/jrsm.99.3.141</pub-id><pmc-comment>1383760 </pmc-comment>
<pub-id pub-id-type="pmid">16508053</pub-id></mixed-citation></ref><ref id="ref-142"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schwarz</surname><given-names>GJ</given-names></name><name><surname>Kennicutt</surname><given-names>RC</given-names><suffix>Jr</suffix></name></person-group>:
<article-title>Demographic and citation trends in astrophysical journal papers and preprints</article-title>. arXiv preprint astro-ph/0411275,<year>2004</year><ext-link ext-link-type="uri" xlink:href="http://arxiv.org/pdf/astro-ph/0411275v1.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-143"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shatkay</surname><given-names>H</given-names></name><name><surname>Pan</surname><given-names>F</given-names></name><name><surname>Rzhetsky</surname><given-names>A</given-names></name><etal></etal></person-group>:
<article-title>Multi-dimensional classification of biomedical text: toward automated, practical provision of high-utility text to diverse users.</article-title><source><italic>Bioinformatics.</italic></source><year>2008</year>;<volume>24</volume>(<issue>18</issue>):<fpage>2086</fpage>–<lpage>2093</lpage>.
<pub-id pub-id-type="doi">10.1093/bioinformatics/btn381</pub-id><pmc-comment>2530883 </pmc-comment>
<pub-id pub-id-type="pmid">18718948</pub-id></mixed-citation></ref><ref id="ref-144"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shavell</surname><given-names>S</given-names></name></person-group>:
<article-title>Should copyright of academic works be abolished?</article-title><source><italic>J Legal Analysis.</italic></source><year>2010</year>;<volume>2</volume>(<issue>1</issue>):<fpage>301</fpage>–<lpage>358</lpage>.
<pub-id pub-id-type="doi">10.1093/jla/2.1.301</pub-id></mixed-citation></ref><ref id="ref-145"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shen</surname><given-names>C</given-names></name><name><surname>Björk</surname><given-names>BC</given-names></name></person-group>:
<article-title>‘predatory’ open access: a longitudinal study of article volumes and market characteristics.</article-title><source><italic>BMC Med.</italic></source><year>2015</year>;<volume>13</volume>(<issue>1</issue>):<fpage>230</fpage>.
<pub-id pub-id-type="doi">10.1186/s12916-015-0469-2</pub-id><pmc-comment>4589914 </pmc-comment>
<pub-id pub-id-type="pmid">26423063</pub-id></mixed-citation></ref><ref id="ref-146"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shieber</surname><given-names>S</given-names></name><name><surname>Suber</surname><given-names>P</given-names></name></person-group>:
<article-title>Good practices for university open-access policies</article-title>.<year>2016</year>; Accessed: 2016-9-12.
<ext-link ext-link-type="uri" xlink:href="https://cyber.harvard.edu/hoap/Good_practices_for_university_open-access_policies">Reference Source</ext-link></mixed-citation></ref><ref id="ref-147"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Simmons</surname><given-names>JP</given-names></name><name><surname>Nelson</surname><given-names>LD</given-names></name><name><surname>Simonsohn</surname><given-names>U</given-names></name></person-group>:
<article-title>False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant.</article-title><source><italic>Psychol Sci.</italic></source><year>2011</year>;<volume>22</volume>(<issue>11</issue>):<fpage>1359</fpage>–<lpage>66</lpage>.
<pub-id pub-id-type="doi">10.1177/0956797611417632</pub-id><pub-id pub-id-type="pmid">22006061</pub-id></mixed-citation></ref><ref id="ref-148"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Solomon</surname><given-names>DJ</given-names></name><name><surname>Björk</surname><given-names>BC</given-names></name></person-group>:
<article-title>A study of open access journals using article processing charges.</article-title><source><italic>J Am Soc Inf Sci Technol.</italic></source><year>2012</year>;<volume>63</volume>(<issue>8</issue>):<fpage>1485</fpage>–<lpage>1495</lpage>.
<pub-id pub-id-type="doi">10.1002/asi.22673</pub-id></mixed-citation></ref><ref id="ref-149"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Solomon</surname><given-names>DJ</given-names></name><name><surname>Björk</surname><given-names>BC</given-names></name></person-group>:
<article-title>Publication fees in open access publishing: Sources of funding and factors influencing choice of journal.</article-title><source><italic> J Am Soc Inf Sci Technol.</italic></source><year>2012</year>;<volume>63</volume>(<issue>1</issue>):<fpage>98</fpage>–<lpage>107</lpage>.
<pub-id pub-id-type="doi">10.1002/asi.21660</pub-id></mixed-citation></ref><ref id="ref-150"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stodden</surname><given-names>V</given-names></name></person-group>:
<article-title>Open science: policy implications for the evolving phenomenon of user-led scientific innovation.</article-title><source><italic>Journal of Science Communication.</italic></source><year>2010</year>;<volume>9</volume>(<issue>1</issue>):<fpage>A05</fpage><ext-link ext-link-type="uri" xlink:href="http://jcom.sissa.it/sites/default/files/documents/Jcom0901%282010%29A05.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-151"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stott</surname><given-names>A</given-names></name></person-group>:
<article-title>Open data for economic growth</article-title>. Washington
DC: World Bank,<year>2014</year><ext-link ext-link-type="uri" xlink:href="http://www.worldbank.org/content/dam/Worldbank/document/Open-Data-for-Economic-Growth.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-152"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Suber</surname><given-names>P</given-names></name></person-group>:
<article-title>Open Access</article-title>. MIT Press, Cambridge, Mass,<year>2012</year><ext-link ext-link-type="uri" xlink:href="https://mitpress.mit.edu/books/open-access">Reference Source</ext-link></mixed-citation></ref><ref id="ref-153"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sutton</surname><given-names>C</given-names></name></person-group>:
<article-title>Is free inevitable in scholarly communication? the economics of open access.</article-title><source><italic>College & Research Libraries News.</italic></source><year>2011</year>;<volume>72</volume>(<issue>11</issue>):<fpage>642</fpage>–<lpage>645</lpage>.
<ext-link ext-link-type="uri" xlink:href="http://crln.acrl.org/content/72/11/642.full.pdf+html">Reference Source</ext-link></mixed-citation></ref><ref id="ref-154"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Swan</surname><given-names>A</given-names></name><name><surname>Brown</surname><given-names>S</given-names></name></person-group>:
<article-title>Authors and open access publishing.</article-title><source><italic>Learn Publ.</italic></source><year>2004</year>;<volume>17</volume>(<issue>3</issue>):<fpage>219</fpage>–<lpage>224</lpage>.
<pub-id pub-id-type="doi">10.1087/095315104323159649</pub-id></mixed-citation></ref><ref id="ref-155"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Swan</surname><given-names>A</given-names></name><name><surname>Brown</surname><given-names>S</given-names></name></person-group>:
<article-title>Open access self-archiving: An author study</article-title>.<year>2005</year><ext-link ext-link-type="uri" xlink:href="http://cogprints.org/4385/1/jisc2.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-156"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Swan</surname><given-names>A</given-names></name></person-group>:
<article-title>The open access citation advantage: Studies and results to date</article-title>.<year>2010</year><ext-link ext-link-type="uri" xlink:href="http://eprints.soton.ac.uk/268516/">Reference Source</ext-link></mixed-citation></ref><ref id="ref-157"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Swanson</surname><given-names>DR</given-names></name></person-group>:
<article-title>Two medical literatures that are logically but not bibliographically connected.</article-title><source><italic>J Am Soc Inf Sci.</italic></source><year>1987</year>;<volume>38</volume>(<issue>4</issue>):<fpage>228</fpage>–<lpage>233</lpage>.
<pub-id pub-id-type="doi">10.1002/(SICI)1097-4571(198707)38:4<228::AID-ASI2>3.0.CO;2-G</pub-id></mixed-citation></ref><ref id="ref-158"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Tate</surname><given-names>D</given-names></name></person-group>:
<article-title>Open access and research assessment: Dealing with uk open access requirements in practice</article-title>.<year>2015</year>;<fpage>58</fpage>–<lpage>62</lpage>.
<pub-id pub-id-type="doi">10.3233/978-1-61499-562-3-58</pub-id></mixed-citation></ref><ref id="ref-159"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Turner</surname><given-names>JA</given-names></name><name><surname>Laird</surname><given-names>AR</given-names></name></person-group>:
<article-title>The cognitive paradigm ontology: design and application.</article-title><source><italic>Neuroinformatics.</italic></source><year>2012</year>;<volume>10</volume>(<issue>1</issue>):<fpage>57</fpage>–<lpage>66</lpage>.
<pub-id pub-id-type="doi">10.1007/s12021-011-9126-x</pub-id><pmc-comment>3682219 </pmc-comment>
<pub-id pub-id-type="pmid">21643732</pub-id></mixed-citation></ref><ref id="ref-160"><mixed-citation publication-type="book"><collab>United Nations</collab>:
<article-title>Universal declaration of human rights</article-title>.<year>1948</year><ext-link ext-link-type="uri" xlink:href="http://watchlist.org/wordpress/wp-content/uploads/Universal-declaration-of-human-rights.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-161"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>van Assen</surname><given-names>MA</given-names></name><name><surname>van Aert</surname><given-names>RC</given-names></name><name><surname>Nuijten</surname><given-names>MB</given-names></name><etal></etal></person-group>:
<article-title>Why publishing everything is more effective than selective publishing of statistically significant results.</article-title><source><italic>PLoS One.</italic></source><year>2014</year>;<volume>9</volume>(<issue>1</issue>):<fpage>e84896</fpage>.
<pub-id pub-id-type="doi">10.1371/journal.pone.0084896</pub-id><pmc-comment>3894961 </pmc-comment>
<pub-id pub-id-type="pmid">24465448</pub-id></mixed-citation></ref><ref id="ref-162"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Van Noorden</surname><given-names>R</given-names></name></person-group>:
<article-title>Elsevier opens its papers to text-mining.</article-title><source><italic>Nature.</italic></source><year>2014</year>;<volume>506</volume>(<issue>7486</issue>):<fpage>17</fpage>.
<pub-id pub-id-type="doi">10.1038/506017a</pub-id><pub-id pub-id-type="pmid">24499898</pub-id></mixed-citation></ref><ref id="ref-163"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Van Noorden</surname><given-names>R</given-names></name></person-group>:
<article-title>Open access: The true cost of science publishing.</article-title><source><italic>Nature.</italic></source><year>2013</year>;<volume>495</volume>(<issue>7442</issue>):<fpage>426</fpage>–<lpage>429</lpage>.
<pub-id pub-id-type="doi">10.1038/495426a</pub-id><pub-id pub-id-type="pmid">23538808</pub-id></mixed-citation></ref><ref id="ref-164"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Van Noorden</surname><given-names>R</given-names></name></person-group>:
<article-title>Trouble at the text mine.</article-title><source><italic>Nature.</italic></source><year>2012</year>;<volume>483</volume>(<issue>7388</issue>):<fpage>134</fpage>–<lpage>135</lpage>.
<pub-id pub-id-type="doi">10.1038/483134a</pub-id><pub-id pub-id-type="pmid">22398532</pub-id></mixed-citation></ref><ref id="ref-165"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>van Rooyen</surname><given-names>S</given-names></name><name><surname>Godlee</surname><given-names>F</given-names></name><name><surname>Evans</surname><given-names>S</given-names></name><etal></etal></person-group>:
<article-title>Effect of open peer review on quality of reviews and on reviewers' recommendations: a randomised trial.</article-title><source><italic>BMJ.</italic></source><year>1999</year>;<volume>318</volume>(<issue>7175</issue>):<fpage>23</fpage>–<lpage>27</lpage>.
<pub-id pub-id-type="doi">10.1136/bmj.318.7175.23</pub-id><pmc-comment>27670 </pmc-comment>
<pub-id pub-id-type="pmid">9872878</pub-id></mixed-citation></ref><ref id="ref-166"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vanclay</surname><given-names>JK</given-names></name></person-group>:
<article-title>Factors affecting citation rates in environmental science.</article-title><source><italic>J Informetr.</italic></source><year>2013</year>;<volume>7</volume>(<issue>2</issue>):<fpage>265</fpage>–<lpage>271</lpage>.
<pub-id pub-id-type="doi">10.1016/j.joi.2012.11.009</pub-id></mixed-citation></ref><ref id="ref-167"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Veletsianos</surname><given-names>G</given-names></name><name><surname>Kimmons</surname><given-names>R</given-names></name></person-group>:
<article-title>Assumptions and challenges of open scholarship.</article-title><source><italic>The International Review of Research in Open and Distributed Learning.</italic></source><year>2012</year>;<volume>13</volume>(<issue>4</issue>):<fpage>166</fpage>–<lpage>189</lpage>.
<ext-link ext-link-type="uri" xlink:href="https://oerknowledgecloud.org/sites/oerknowledgecloud.org/files/1313-10780-1-PB.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-168"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vickery</surname><given-names>G</given-names></name></person-group>:
<article-title>Review of recent studies on psi re-use and related market developments.</article-title><source><italic>Information Economics.</italic></source><year>2011</year><ext-link ext-link-type="uri" xlink:href="https://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&ved=0ahUKEwiJtvq2sobNAhUBLY8KHfumBDkQFggfMAA&url=http%3A%2F%2Fec.europa.eu%2Fnewsroom%2Fdocument.cfm%3Fdoc_id%3D1093&usg=AFQjCNG_k__xE7dOfB6g2AYOsV0oedDo3Q">Reference Source</ext-link></mixed-citation></ref><ref id="ref-169"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vincent-Lamarre</surname><given-names>P</given-names></name><name><surname>Boivin</surname><given-names>J</given-names></name><name><surname>Gargouri</surname><given-names>Y</given-names></name><etal></etal></person-group>:
<article-title>Estimating open access mandate effectiveness: The melibea score.</article-title><source><italic>J Assoc Inf Sci Technol.</italic></source><year>2016</year><pub-id pub-id-type="doi">10.1002/asi.23601</pub-id></mixed-citation></ref><ref id="ref-170"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wagenmakers</surname><given-names>EJ</given-names></name><name><surname>Wetzels</surname><given-names>R</given-names></name><name><surname>Borsboom</surname><given-names>D</given-names></name><etal></etal></person-group>:
<article-title>An agenda for purely confirmatory research.</article-title><source><italic>Perspect Psychol Sci.</italic></source><year>2012</year>;<volume>7</volume>(<issue>6</issue>):<fpage>632</fpage>–<lpage>638</lpage>.
<pub-id pub-id-type="doi">10.1177/1745691612463078</pub-id><pub-id pub-id-type="pmid">26168122</pub-id></mixed-citation></ref><ref id="ref-171"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wagner</surname><given-names>B</given-names></name></person-group>:
<article-title>Open access citation advantage: An annotated bibliography.</article-title><source><italic>Issues Sci Technol Librarianship.</italic></source><year>2010</year>; (<issue>60</issue>):<fpage>2</fpage><pub-id pub-id-type="doi">10.5062/F4Q81B0W</pub-id></mixed-citation></ref><ref id="ref-172"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Walters</surname><given-names>WH</given-names></name><name><surname>Linvill</surname><given-names>A</given-names></name></person-group>:
<article-title>Characteristics of open access journals in six subject areas.</article-title><source><italic>Coll Res Libr.</italic></source><year>2011</year>;<volume>72</volume>(<issue>4</issue>):<fpage>372</fpage>–<lpage>392</lpage>.
<pub-id pub-id-type="doi">10.5860/crl-132</pub-id></mixed-citation></ref><ref id="ref-173"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname><given-names>X</given-names></name><name><surname>Liu</surname><given-names>C</given-names></name><name><surname>Mao</surname><given-names>W</given-names></name><etal></etal></person-group>:
<article-title>The open access advantage considering citation, article usage and social media attention.</article-title><source><italic>Scientometrics.</italic></source><year>2015</year>;<volume>103</volume>(<issue>2</issue>):<fpage>555</fpage>–<lpage>564</lpage>.
<pub-id pub-id-type="doi">10.1007/s11192-015-1547-0</pub-id></mixed-citation></ref><ref id="ref-174"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Watson</surname><given-names>M</given-names></name></person-group>:
<article-title>When will ‘open science’ become simply ‘science’?</article-title><source><italic>Genome Biol.</italic></source><year>2015</year>;<volume>16</volume>(<issue>1</issue>):<fpage>101</fpage>, ISSN 1465-6906.
<pub-id pub-id-type="doi">10.1186/s13059-015-0669-2</pub-id><pmc-comment>4436110 </pmc-comment>
<pub-id pub-id-type="pmid">25986601</pub-id></mixed-citation></ref><ref id="ref-175"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wicherts</surname><given-names>JM</given-names></name><name><surname>Bakker</surname><given-names>M</given-names></name><name><surname>Molenaar</surname><given-names>D</given-names></name></person-group>:
<article-title>Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results.</article-title><source><italic>PLoS One.</italic></source><year>2011</year>;<volume>6</volume>(<issue>11</issue>):<fpage>e26828</fpage>.
<pub-id pub-id-type="doi">10.1371/journal.pone.0026828</pub-id><pmc-comment>3206853 </pmc-comment>
<pub-id pub-id-type="pmid">22073203</pub-id></mixed-citation></ref><ref id="ref-176"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wicherts</surname><given-names>JM</given-names></name></person-group>:
<article-title>Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals.</article-title><source><italic>PLoS One.</italic></source><year>2016</year>;<volume>11</volume>(<issue>1</issue>):<fpage>e0147913</fpage>.
<pub-id pub-id-type="doi">10.1371/journal.pone.0147913</pub-id><pmc-comment>4732690 </pmc-comment>
<pub-id pub-id-type="pmid">26824759</pub-id></mixed-citation></ref><ref id="ref-177"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Willinsky</surname><given-names>J</given-names></name></person-group>:
<article-title>Copyright contradictions in scholarly publishing</article-title>.
<italic>First Monday</italic><year>2002</year>;<volume>7</volume>(<issue>11</issue>).
<pub-id pub-id-type="doi">10.5210/fm.v7i11.1006</pub-id></mixed-citation></ref><ref id="ref-178"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Willinsky</surname><given-names>J</given-names></name></person-group>:
<article-title>The Access Principle: The Case for Open Access to Research and Scholarship</article-title>. MIT Press, Cambridge, Mass,<year>2006</year><ext-link ext-link-type="uri" xlink:href="http://arizona.openrepository.com/arizona/handle/10150/106529">Reference Source</ext-link></mixed-citation></ref><ref id="ref-179"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Wohlrabe</surname><given-names>K</given-names></name><name><surname>Birkmeier</surname><given-names>D</given-names></name></person-group>:
<article-title>Do open access articles in economics have a citation advantage?</article-title><source><italic>Munich Personal RePEc Archive.</italic></source><year>2014</year><ext-link ext-link-type="uri" xlink:href="https://mpra.ub.uni-muenchen.de/56842/1/MPRA_paper_56842.pdf">Reference Source</ext-link></mixed-citation></ref><ref id="ref-180"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Xia</surname><given-names>J</given-names></name><name><surname>Harmon</surname><given-names>JL</given-names></name><name><surname>Connolly</surname><given-names>KG</given-names></name><etal></etal></person-group>:
<article-title>Who publishes in “predatory” journals?</article-title><source><italic>J Assoc Inf Sci Technol.</italic></source><year>2015</year>;<volume>66</volume>(<issue>7</issue>):<fpage>1406</fpage>–<lpage>1417</lpage>.
<pub-id pub-id-type="doi">10.1002/asi.23265</pub-id></mixed-citation></ref><ref id="ref-181"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Xia</surname><given-names>J</given-names></name></person-group>:
<article-title>Predatory journals and their article publishing charges.</article-title><source><italic>Learn Publ.</italic></source><year>2015</year>;<volume>28</volume>(<issue>1</issue>):<fpage>69</fpage>–<lpage>74</lpage>.
<pub-id pub-id-type="doi">10.1087/20150111</pub-id></mixed-citation></ref><ref id="ref-182"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Xu</surname><given-names>L</given-names></name><name><surname>Liu</surname><given-names>J</given-names></name><name><surname>Fang</surname><given-names>Q</given-names></name></person-group>:
<article-title>Analysis on open access citation advantage: an empirical study based on oxford open journals.</article-title>In
<italic>Proceedings of the 2011 iConference.</italic>ACM,<year>2011</year>;<fpage>426</fpage>–<lpage>432</lpage>.
<pub-id pub-id-type="doi">10.1145/1940761.1940819</pub-id></mixed-citation></ref><ref id="ref-183"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname><given-names>Y</given-names></name></person-group>:
<article-title>The effect of open access on citation impact: a comparison study based on web citation analysis.</article-title><source><italic>Libri.</italic></source><year>2006</year>;<volume>56</volume>(<issue>3</issue>):<fpage>145</fpage>–<lpage>156</lpage>.
<pub-id pub-id-type="doi">10.1515/LIBR.2006.145</pub-id></mixed-citation></ref><ref id="ref-184"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname><given-names>D</given-names></name></person-group>:
<article-title>Characteristics and impact of grant-funded research: a case study of the library and information
science field.</article-title><source><italic>Scientometrics.</italic></source><year>2010</year>;<volume>84</volume>(<issue>2</issue>):<fpage>293</fpage>–<lpage>306</lpage>.
<pub-id pub-id-type="doi">10.1007/s11192-010-0191-y</pub-id></mixed-citation></ref><ref id="ref-185"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zuccala</surname><given-names>A</given-names></name></person-group>:
<article-title>Open access and civic scientific information literacy.</article-title><source><italic>Information Research: An International Electronic Journal.</italic></source><year>2010</year>;<volume>15</volume>(<issue>1</issue>).
<ext-link ext-link-type="uri" xlink:href="http://individual.utoronto.ca/azuccala_web/OA-ScientificLiteracy-Zuccala.pdf">Reference Source</ext-link></mixed-citation></ref></ref-list></back><sub-article id="report16583" article-type="peer-review"><front-stub><article-id pub-id-type="doi">10.5256/f1000research.10376.r16583</article-id><title-group><article-title>Referee response for version 3</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Suber</surname><given-names>Peter</given-names></name><xref ref-type="aff" rid="r16583a1">1</xref><role>Referee</role></contrib><aff id="r16583a1"><label>1</label>Berkman Center for Internet & Society, Harvard University, Cambridge, MA, USA</aff></contrib-group><author-notes><fn fn-type="COI-statement"><p><bold>Competing interests: </bold>No competing interests were disclosed.</p></fn></author-notes><pub-date pub-type="epub"><day>26</day><month>9</month><year>2016</year></pub-date><related-article id="d36e9230" related-article-type="peer-reviewed-article" ext-link-type="doi" xlink:href="10.12688/f1000research.8460.3">Version 3</related-article><custom-meta-group><custom-meta><meta-name>recommendation</meta-name><meta-value>approve-with-reservations</meta-value></custom-meta></custom-meta-group></front-stub><body><p>I'm commenting on this sentence from the first paragraph of Version 3 of the article:</p><p> The Green route is also enabled through author rights retention, in which authors pre-emptively grant non-exclusive rights to their institutions before publishing any works. The institution then has the ability to make articles by these authors OA without seeking permission from the publishers (e.g., this is the case of the Dutch Taverne amendment that has declared self-archival of research after ‘a reasonable period of time’ a legal right (
<ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/DdxhBa8oeFg">Open Access NL, 2015</ext-link>)).</p><p> The authors added the bulk of this at my request in an earlier comment. I'm glad they did, but it's still only partially true. It's true that universities can adopt rights-retention OA policies that make it unnecessary to seek permission from publishers. But it's not true that Dutch Taverne amendment is an example. It's not a university policy, but legislation. It's legislation that gives authors permission for green OA regardless of the contracts they signed, and regardless of the rights they might have retained through a university policy. It's a very good idea and I recommend it everywhere. (There is already a similar law in Germany, and one is now emerging in France.) But what the authors need here is an example of a university rights-retention OA policy, or a thorough explanation of this kind of OA policy.</p><p> I'm not seeking a citation to my own university's activity, though it adopted the first OA policies of this kind. Nor am I seeking a citation to the good-practices guide that I maintain with Stuart Shieber, though it's the standard reference on this kind of policy. In fact, I was reluctant to follow up the authors' response to my prior suggestion because I didn't want to appear to seek additional citations. </p><p> But since I've gone this far, I'll mention these two sources anyway:</p><p> The Harvard open-access policies</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/8eQsBero8SK">https://osc.hul.harvard.edu/policies/</ext-link></p><p> Good practices for university open-access policies</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/QNehBQLNDi2">http://bit.ly/goodoa</ext-link> </p><p> Of the two, I'd recommend the second in this situation. But even if the authors include no citation on this point, at least they should stop citing the Dutch law as an example, and treat it separately as another path to the same goal.</p><p>I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p></body></sub-article><sub-article id="report14274" article-type="peer-review"><front-stub><article-id pub-id-type="doi">10.5256/f1000research.9609.r14274</article-id><title-group><article-title>Referee response for version 2</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Lockwood</surname><given-names>Gwilym</given-names></name><xref ref-type="aff" rid="r14274a1">1</xref><role>Referee</role></contrib><aff id="r14274a1"><label>1</label>Neurobiology of Language Department, Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands</aff></contrib-group><author-notes><fn fn-type="COI-statement"><p><bold>Competing interests: </bold>Since I submitted my first review, I have been commissioned by Altmetric to write blogs using their data. However, all my reviewing was done before knowing about this opportunity, and so my original comments on the alternative metrics section were therefore unaffected.</p></fn></author-notes><pub-date pub-type="epub"><day>25</day><month>8</month><year>2016</year></pub-date><related-article id="d36e9305" related-article-type="peer-reviewed-article" ext-link-type="doi" xlink:href="10.12688/f1000research.8460.2">Version 2</related-article><custom-meta-group><custom-meta><meta-name>recommendation</meta-name><meta-value>approve</meta-value></custom-meta></custom-meta-group></front-stub><body><p>I have no further comments; my points or concerns have been addressed, and other issues are highlighted in further depth by other reviewers.</p><p>I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p></body></sub-article><sub-article id="report14275" article-type="peer-review"><front-stub><article-id pub-id-type="doi">10.5256/f1000research.9609.r14275</article-id><title-group><article-title>Referee response for version 2</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Suber</surname><given-names>Peter</given-names></name><xref ref-type="aff" rid="r14275a1">1</xref><role>Referee</role></contrib><aff id="r14275a1"><label>1</label>Berkman Center for Internet & Society, Harvard University, Cambridge, MA, USA</aff></contrib-group><author-notes><fn fn-type="COI-statement"><p><bold>Competing interests: </bold>No competing interests were disclosed.</p></fn></author-notes><pub-date pub-type="epub"><day>27</day><month>6</month><year>2016</year></pub-date><related-article id="d36e9353" related-article-type="peer-reviewed-article" ext-link-type="doi" xlink:href="10.12688/f1000research.8460.2">Version 2</related-article><custom-meta-group><custom-meta><meta-name>recommendation</meta-name><meta-value>approve-with-reservations</meta-value></custom-meta></custom-meta-group></front-stub><body><p>In the first version I reviewed, you said, "This [green] route is dependent on journal or publisher policies on self-archiving (sherpa.ac.uk/romeo)."</p><p> That was untrue or incomplete and I offered this comment: It overlooks rights retention. Some individual authors retain enough rights to authorize green OA on their own. While this may be fairly rare, rights-retention OA policies at universities are increasingly common. More than 80 institutions in North America, Europe, Africa, and Asia have now adopted rights-retention OA policies. Under these policies, the faculty grant non-exclusive rights to their institution before they sign future publishing contracts. The institution then has permission to make those future articles OA without having to seek permission from publishers. (The institutions also grant the same non-exclusive rights back to authors.) For more detail on rights-retention OA policies, see Stuart Shieber and Peter Suber, "Good Practices for University OA Policies."</p><p> http://bit.ly/goodoa</p><p> You revised the text in a way that missed my point and misstated my position: "While academics themselves may have little power in debates regarding copyright, institutes could claim ownership of the work they likely already own by invoking their rights under the work made-for-hire doctrine (Denicola, 2006). However, it is difficult to imagine researchers favoring university-held rather than journal-held copyright, and a system of non-exclusive rights is preferred, as is reflected in OA policies and OA journals (Suber, 2012)."</p><p> Here's the main point: More than 80 universities around the world have adopted rights-retention OA policies. These policies are adopted by faculty votes, not administrative edicts. At these institutions the rights needed to authorize OA are not seized from faculty by the institution, or claimed by the institution through work-for-hire. These policies presuppose that the rights initially belong to faculty, not the institution. If the institution is to exercise them, faculty must voluntarily grant them. (There are details we needn't go into here, for example, that we're only talking about non-exclusive rights, and that these policies generally include waiver options when faculty don't want the institution to have rights to a given work.) At Harvard, which pioneered this type of policy, four of the school-level votes were unanimous. In short, it's not at all "difficult to imagine researchers favoring university-held...copyright." On the contrary, it's easy to imagine and widely attested. Green OA does not always depend on permission from publishers. Increasingly it depends on rights retention by authors, through carefully drafted and widely supported university policies. That's a fact. My opinion is that that's a good thing. </p><p> You needn't share my opinion, and needn't mention the fact. But please don't misrepresent the fact or reverse my opinion.</p><p>I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p></body></sub-article><sub-article id="report14273" article-type="peer-review"><front-stub><article-id pub-id-type="doi">10.5256/f1000research.9609.r14273</article-id><title-group><article-title>Referee response for version 2</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Chambers</surname><given-names>Chris</given-names></name><xref ref-type="aff" rid="r14273a1">1</xref><role>Referee</role></contrib><aff id="r14273a1"><label>1</label>School of Psychology, Cardiff University, Cardiff, UK</aff></contrib-group><author-notes><fn fn-type="COI-statement"><p><bold>Competing interests: </bold>No competing interests were disclosed.</p></fn></author-notes><pub-date pub-type="epub"><day>10</day><month>6</month><year>2016</year></pub-date><related-article id="d36e9419" related-article-type="peer-reviewed-article" ext-link-type="doi" xlink:href="10.12688/f1000research.8460.2">Version 2</related-article><custom-meta-group><custom-meta><meta-name>recommendation</meta-name><meta-value>approve</meta-value></custom-meta></custom-meta-group></front-stub><body><p>All my suggestions have been addressed. I'm very happy approve this interesting and useful addition to the literature.</p><p>I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p></body></sub-article><sub-article id="report13295" article-type="peer-review"><front-stub><article-id pub-id-type="doi">10.5256/f1000research.9110.r13295</article-id><title-group><article-title>Referee response for version 1</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Chambers</surname><given-names>Chris</given-names></name><xref ref-type="aff" rid="r13295a1">1</xref><role>Referee</role></contrib><aff id="r13295a1"><label>1</label>School of Psychology, Cardiff University, Cardiff, UK</aff></contrib-group><author-notes><fn fn-type="COI-statement"><p><bold>Competing interests: </bold>No competing interests were disclosed.</p></fn></author-notes><pub-date pub-type="epub"><day>28</day><month>4</month><year>2016</year></pub-date><related-article id="d36e9467" related-article-type="peer-reviewed-article" ext-link-type="doi" xlink:href="10.12688/f1000research.8460.1">Version 1</related-article><custom-meta-group><custom-meta><meta-name>recommendation</meta-name><meta-value>approve</meta-value></custom-meta></custom-meta-group></front-stub><body><p>Tennant
<italic>et al </italic>offer a timely and insightful review of the various effects of open access publishing on science and society. The paper is well structured and enjoyable to read. Although I am not an expert on open access publishing, I also found the discussion of the literature quite balanced and evidence-based.</p><p>I have just three recommendations for revisions:
<list list-type="order"><list-item><p>In the discussion of the OA citation advantage (which is excellent), the authors are very careful to avoid asserting a causal link between the OA status of a paper and the number of citations it generates. However, in my view, the conclusion of the Gargouri (2010) paper should be caveated. While the results of Gargouri are consistent with the absence of a self-selection bias in producing the OA advantage, they cannot rule it out. It might be the case that funders or institutions that mandate OA are also those that are more likely to support/host higher impact research. Furthermore, given that OA mandates are never 100% effective, perhaps authors are more likely to comply with a mandate for work they perceive to be of high impact. A useful addition to this section would be specify the conditions under which we
<italic>could</italic> determine whether or not OA causally influences citations. This would require a randomised controlled trial in which articles are randomly are assigned to OA and non-OA routes. To my knowledge, no such a trial has yet been undertaken, although the authors will be in a more informed position to know whether this is the case.</p></list-item><list-item><p>There is not much discussion in the paper of the distinction between full OA and hybrid OA. Given that the APCs for hybrid OA articles tend to be substantially higher than those for full OA articles, this may warrant more prominent coverage in the economic case for OA. It is also relevant to the brief mention of the Finch Report, which (controversially) favours gold OA (including the hybrid route) over green OA.</p></list-item><list-item><p>I was glad to see the link formed between OA and open science more generally, as many researchers and advocates draw a distinct (and somewhat arbitrary) line between these initiatives. In this context, it would perhaps be relevant to mention the TOP guidelines (
<ext-link ext-link-type="uri" xlink:href="https://cos.io/top/">https://cos.io/top/</ext-link>). TOP is very much an evolving entity so it would be interesting to consider the inclusion of an OA standard in future revisons of TOP.</p></list-item></list>Minor</p><p>p13 This sentence is difficult to parse: "Whereas this is hyper-variable, and strongly dependent on a range of factors, it is the fact that any public interest in science that is of importance."</p><p>I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p></body></sub-article><sub-article id="report13292" article-type="peer-review"><front-stub><article-id pub-id-type="doi">10.5256/f1000research.9110.r13292</article-id><title-group><article-title>Referee response for version 1</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Tierney</surname><given-names>Anne</given-names></name><xref ref-type="aff" rid="r13292a1">1</xref><role>Referee</role></contrib><aff id="r13292a1"><label>1</label>Department of Learning and Teaching Enhancement, Edinburgh Napier University, Edinburgh, UK</aff></contrib-group><author-notes><fn fn-type="COI-statement"><p><bold>Competing interests: </bold>No competing interests were disclosed.</p></fn></author-notes><pub-date pub-type="epub"><day>25</day><month>4</month><year>2016</year></pub-date><related-article id="d36e9539" related-article-type="peer-reviewed-article" ext-link-type="doi" xlink:href="10.12688/f1000research.8460.1">Version 1</related-article><custom-meta-group><custom-meta><meta-name>recommendation</meta-name><meta-value>approve</meta-value></custom-meta></custom-meta-group></front-stub><body><p>This paper is a comprehensive review of the complexities of OA. I have come late to the discussion on this paper, and I find that the previous reviewers have been meticulous in their critique of the paper, to the point I have very little to add. However, there are a couple of points for consideration. What is the effect (if any) of the UK Research Excellence Framework on Open Access? To what extent is disciplinarity a factor in Open Access? I ask this question because of the high impact of the sciences and biomedical research, but wonder about Arts and Humanities (and other areas) as a comparision. As one of the other reviewers said, "this doesn't consider the fact that the prestige of some journals is advertising in and of itself." While this is true of scientific journals, the same can't be said, for example, of education journals, so there is a lack of parity between disciplines. There was also an assumption of the willingness of reviewers to continue to offer their services freely. This aspect of OA (and subscription-based) publishing is hardly ever critiqued, but it assumed to be part of the process.</p><p>All in all, this paper gives a lot of food for thought. I don't expect a rewrite of the paper, based on my comments, but I would welcome further discussion on where the authors (and readers) see OA going in the future.</p><p>I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p></body></sub-article><sub-article id="report13291" article-type="peer-review"><front-stub><article-id pub-id-type="doi">10.5256/f1000research.9110.r13291</article-id><title-group><article-title>Referee response for version 1</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Brown Jarreau</surname><given-names>Paige</given-names></name><xref ref-type="aff" rid="r13291a1">1</xref><role>Referee</role></contrib><aff id="r13291a1"><label>1</label>Manship School of Mass Communication, Louisiana State University, Baton Rouge, LA, USA</aff></contrib-group><author-notes><fn fn-type="COI-statement"><p><bold>Competing interests: </bold>No competing interests were disclosed.</p></fn></author-notes><pub-date pub-type="epub"><day>22</day><month>4</month><year>2016</year></pub-date><related-article id="d36e9589" related-article-type="peer-reviewed-article" ext-link-type="doi" xlink:href="10.12688/f1000research.8460.1">Version 1</related-article><custom-meta-group><custom-meta><meta-name>recommendation</meta-name><meta-value>approve-with-reservations</meta-value></custom-meta></custom-meta-group></front-stub><body><p>This is an interesting and timely review of the issue of open access to scientific literature.</p><p>The two other reviewers have highlighted specific issues that should be addressed in the revision of this article, and I agree with these issues. I've added other notes below. I think this review article would benefit from a re-write to correct potentially biased language in support of open access and to round out the review with further evidence of open access impacts on citation rates, altmetrics, scientific literacy / public engagement and research quality. </p><p><bold>Notes:</bold></p><p>The authors cite
<italic> “fostering a culture of greater scientific literacy”</italic> as a benefit of open access. While this is theoretically a benefit, has more or less open access in particular scientific fields been tied to greater or lesser scientific literacy in those areas? Is this potential benefit supported by research literature? The authors should be clear on what the evidence-based benefits of open access are, and also what the potential drawbacks are. References to related research should be provided on this topic.</p><p>The structure the authors use for laying out their evidence and the language they use (e.g.
<italic>“[the] case for Open Access”</italic>) appear to lean more toward the positive impacts / benefits of open access from the outset. The authors should be very careful to review the evidence first before making value-based statements or arguments about open access, even if the evidence-based benefits outweigh any potential drawbacks, or lack of significant benefits, in the end.</p><p>Correct the typo in the following sentence:
<italic>“[In] A longitudinal study Eysenbach (2006) compared…”</italic></p><p>The authors write:
<italic>“One alternative explanation for the citation advantage could be that researchers choose to publish OA when a finding is more impactful, but empirical evidence contradicts this selection effect. Gargouri et al. (2010) compared citation counts within a cohort of OA articles that had either been self-selected as OA or mandated as OA (e.g., by funders). The study concluded that both were cited significantly more than non-OA articles. As such, these findings rule out a selection bias from authors as the cause for the citation advantage (Gargouri et al., 2010).” </italic>However, couldn’t funded research also have a tendency to be considered “more impactful,” because it was chosen in the first place to be funded and mandated as OA? The authors should discuss this, and whether there is any research that experimentally investigates whether open access provides a citation advantage. This could perhaps be suggested as future research. The authors should also discuss how/why some studies have found no citation advantage for OA papers.</p><p>Related to social media mentions of research papers and citation counts, the authors might also consider citing Liang, X., Su, L. Y. F., Yeo, S. K., Scheufele, D. A., Brossard, D., Xenos, M., ... & Corley, E. A. (2014). Building Buzz (Scientists) Communicating Science in New Media Environments.
<italic>Journalism & Mass Communication Quarterly</italic>, 1077699014550092. [
<ext-link ext-link-type="uri" xlink:href="https://www.researchgate.net/profile/Xuan_Liang3/publication/265785507_Building_Buzz/links/541b270b0cf2218008c025bc.pdf">PDF</ext-link>]</p><p> </p><p>In discussing the economics of OA, the authors should also discuss any evidence of potential drawbacks for various stakeholders, such as where funds for pay-to-publish fees will come from and how these fees may affect individual researchers. Pay-to-publish models of OA may also burden early career researchers and researchers working in fields where research grants are more difficult to obtain. </p><p>The authors do not discuss the potential impact of OA on research quality or reproducibility (reproducibility is only mentioned in the context of open data). As this has been a controversial issue in the past (e.g. the mentioned 'sting' operations) the authors should discuss any research that has investigated the impact of open access on the rigor of peer reviews, research quality, presence of replication studies / reproducibility, etc. There has also been some discussion of whether open peer review (like that used by F1000Research) affects the quality of reviews, e.g. (Rooyen
<italic>et al. </italic>1999). The authors should mention this and/or subsequent literature when addressing open peer review.</p><p>There have also been studies on scientists' / journal article authors' perceptions and attitudes toward open access, e.g. Schroter and Tite (2005; 2006). The authors might considering summarizing some of this research, as it gives context to some of the existing barriers to open access and perceived drawbacks among researchers.</p><p>Summary:</p><p>In summary, the topic of this review is important and timely. However, this paper falls short of what I would expect from a systematic review in terms of systematically summarizing previous research findings related to the impact of open access on scientific publishing, public engagement with science, science literacy and altmetrics. The authors should be careful to hold back value judgements / arguments related to the case for open access until having systemically reviewed the evidence-based benefits, drawbacks, and/or lack of significant benefits. The authors should also provide some discussion of how we might objectively weigh any evidence-based benefits with potential drawbacks for various stakeholders including researchers and especially early career researchers. The authors should avoid summarizing mostly the findings of previous studies that find positive impacts of open access on the various domains of potential impact they consider in their paper. The evidence already presented in the paper is rigorous and detailed. However, I would recommend a revision that rounds this review out with more systematic evidence.</p><p>I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p></body><back><ref-list><title>References</title><ref id="rep-ref-13291-1"><label>1</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Liang</surname><given-names>X</given-names></name><name><surname>Su</surname><given-names>L</given-names></name><name><surname>Yeo</surname><given-names>S</given-names></name><name><surname>Scheufele</surname><given-names>D</given-names></name><name><surname>Brossard</surname><given-names>D</given-names></name><name><surname>Xenos</surname><given-names>M</given-names></name><name><surname>Nealey</surname><given-names>P</given-names></name><name><surname>Corley</surname><given-names>E</given-names></name></person-group>:
<article-title>Building Buzz: (Scientists) Communicating Science in New Media Environments</article-title>.
<source><italic>Journalism & Mass Communication Quarterly</italic></source>.<year>2014</year>;<volume>91</volume>(<issue>4</issue>) :
<elocation-id>632</elocation-id><fpage>772</fpage>-<lpage>791</lpage><pub-id pub-id-type="doi">10.1177/1077699014550092</pub-id></mixed-citation></ref><ref id="rep-ref-13291-2"><label>2</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>van Rooyen</surname><given-names>S</given-names></name><name><surname>Godlee</surname><given-names>F</given-names></name><name><surname>Evans</surname><given-names>S</given-names></name><name><surname>Black</surname><given-names>N</given-names></name><name><surname>Smith</surname><given-names>R</given-names></name></person-group>:
<article-title>Effect of open peer review on quality of reviews and on reviewers' recommendations: a randomised trial</article-title>.
<source><italic>BMJ</italic></source>.<year>1999</year>;<volume>318</volume>(<issue>7175</issue>) :
<elocation-id>632</elocation-id><fpage>23</fpage>-<lpage>27</lpage><pub-id pub-id-type="doi">10.1136/bmj.318.7175.23</pub-id><pub-id pub-id-type="pmid">10066202</pub-id></mixed-citation></ref><ref id="rep-ref-13291-3"><label>3</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schroter</surname><given-names>S</given-names></name><name><surname>Tite</surname><given-names>L</given-names></name><name><surname>Smith</surname><given-names>R</given-names></name></person-group>:
<article-title>Perceptions of open access publishing: interviews with journal authors.</article-title><source><italic>BMJ</italic></source>.<year>2005</year>;<volume>330</volume>(<issue>7494</issue>) :
<elocation-id>632</elocation-id><fpage>756</fpage><pub-id pub-id-type="doi">10.1136/bmj.38359.695220.82</pub-id><pub-id pub-id-type="pmid">15774992</pub-id></mixed-citation></ref><ref id="rep-ref-13291-4"><label>4</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schroter</surname><given-names>S</given-names></name><name><surname>Tite</surname><given-names>L</given-names></name></person-group>:
<article-title>Open access publishing and author-pays business models: a survey of authors' knowledge and perceptions.</article-title><source><italic>J R Soc Med</italic></source>.<year>2006</year>;<volume>99</volume>(<issue>3</issue>) :
<elocation-id>632</elocation-id><fpage>141</fpage>-<lpage>8</lpage><pub-id pub-id-type="doi">10.1258/jrsm.99.3.141</pub-id><pub-id pub-id-type="pmid">17139067</pub-id></mixed-citation></ref></ref-list></back></sub-article><sub-article id="report13430" article-type="peer-review"><front-stub><article-id pub-id-type="doi">10.5256/f1000research.9110.r13430</article-id><title-group><article-title>Referee response for version 1</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Suber</surname><given-names>Peter</given-names></name><xref ref-type="aff" rid="r13430a1">1</xref><role>Referee</role></contrib><aff id="r13430a1"><label>1</label>Berkman Center for Internet & Society, Harvard University, Cambridge, MA, USA</aff></contrib-group><author-notes><fn fn-type="COI-statement"><p><bold>Competing interests: </bold>No competing interests were disclosed.</p></fn></author-notes><pub-date pub-type="epub"><day>18</day><month>4</month><year>2016</year></pub-date><related-article id="d36e9929" related-article-type="peer-reviewed-article" ext-link-type="doi" xlink:href="10.12688/f1000research.8460.1">Version 1</related-article><custom-meta-group><custom-meta><meta-name>recommendation</meta-name><meta-value>approve</meta-value></custom-meta></custom-meta-group></front-stub><body><p>The article is very well-done, unusually thorough and detailed. Here are a few ways to improve it.</p><p>When I refer to page numbers, I mean the page numbers in the PDF of v1, April 11, 2016.</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/KpRIBKpZ6cZ">http://f1000research.com/articles/5-632/v1</ext-link></p><p>"You" refers to the authors.</p><p>Apologies in advance if I sometimes cite my own work in these comments. </p><p>p. 1. In the abstract you say, "The economic case for Open Access is less well-understood, although it is clear that access to the research literature is key for innovative enterprises, and a range of governmental and non-governmental services." </p><p>This understates the economic case. For example, some subscription journals convert to OA precisely for economic benefits.</p><p>See the preliminary version of David Solomon, Bo-Christer Björk, and Mikael Laakso, "Converting Scholarly Journals to Open Access: A Review of Approaches and Experiences" now open for public comment. (The final version will be published this summer.)</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/eaYtBOvXlSm">https://osc.hul.harvard.edu/programs/journal-flipping/public-consultation/</ext-link></p><p>See especially section 4.6, "Increased revenue and financial viability."</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/WozFBLNgdFV">https://osc.hul.harvard.edu/programs/journal-flipping/public-consultation/4/6/</ext-link></p><p>p. 3. You say, "The Green route refers to author self-archiving, in which a version of the peer-reviewed article is posted online to a repository or website."</p><p>Green OA also applies to preprints, which are not peer-reviewed.</p><p>p. 3. You say, "This [green] route is dependent on journal or publisher policies on self-archiving (
<ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/0QzCBw0AEtM">sherpa.ac.uk/romeo)</ext-link>."</p><p>This is importantly incomplete. It overlooks rights retention. Some individual authors retain enough rights to authorize green OA on their own. While this may be fairly rare, rights-retention OA policies at universities are increasingly common. More than 80 institutions in North America, Europe, Africa, and Asia have now adopted rights-retention OA policies. Under these policies, the faculty grant non-exclusive rights to their institution before they sign future publishing contracts. The institution then has permission to make those future articles OA without having to seek permission from publishers. (The institutions also grant the same non-exclusive rights back to authors.)</p><p>For more detail on rights-retention OA policies, see Stuart Shieber and Peter Suber, "Good Practices for University OA Policies." </p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/wGWsBdZvetl">http://bit.ly/goodoa</ext-link> </p><p>p. 3. You say, "A subscription to all peer-reviewed journals is not affordable for any single individual, research institute or university (Odlyzko, 2006)." </p><p>This is true and important, but it's a pity you don't cite more recent evidence than 2006. </p><p>An important kind of evidence for this proposition is that not even Harvard University can afford all the journals needed by its faculty and students, and must cancel journals every year for budgetary reasons alone. I've collected seven public statements from Harvard to this effect (2008-2012) in the supplements to p. 30 of my 2012 book (Open Access, MIT Press, 2012).</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/aLGhBkvZaCM">http://bit.ly/oa-book#p30.2</ext-link></p><p>p. 3. You say, "Much of the driving force behind this global change has been through a combination of direct, grassroots advocacy initiatives in conjunction with policy changes from funders and governments."</p><p>Please add *university policies* to this list. They're on a par with funder policies in importance, and they're far more numerous. ROARMAP shows that 7+ times more universities have OA policies than funders. </p><p>p. 3. You say, "The Open Access movement is intrinsically tied to the development of the Internet and how it redefined communication and publishing (Laakso et al., 2011)."</p><p>For more documentation on how the OA movement arose as soon as the internet arose, see my Timeline of the Open Access Movement.</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/29lcBOXaWSQ">http://legacy.earlham.edu/~peters/fos/timeline.htm</ext-link></p><p>In 2009, I moved the timeline to the Open Access Directory wiki, and you should probably cite that version:</p><p>Timeline of the open access movement...</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/6LQhBWJkOtz">http://oad.simmons.edu/oadwiki/Timeline</ext-link></p><p>...especially subsection on developments before 2000.</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/NW6SBoJe6F3">http://oad.simmons.edu/oadwiki/Timeline_before_2000</ext-link></p><p>(You might cite this timeline again on p. 5, when you introduce your own timeline.)</p><p>p. 3. You say, "One result of the growing OA movement is the rise of OA-only publishers...."</p><p>Somewhere in this paragraph, I'd mention that some OA publishers are for-profit (e.g. BMC) and some are non-profit (e.g. PLoS).</p><p>p. 4. Your section on the impact advantage is very well-done. Most treatments are much briefer, less careful, and less detailed than yours.</p><p>I have just these suggestions. You cite authors of individual studies, and Alma Swan's 2010 literature review. But you don't cite the mother lode of literature on this topic: Steve Hitchcock's annotated bibliography, "The effect of open access and downloads ('hits') on citation impact: a bibliography of studies."</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/bYlSBevnMCK">http://eprints.soton.ac.uk/354006/1/oacitation-biblio-snapshot0613.html</ext-link></p><p>Or more precisely, you cite it once, 10 paragraphs before the section on the impact advantage begins. You should cite it again within the section on the impact advantage. You should mention that it's comprehensive and annotated.</p><p>Hitchcock stopped updating it in 2013. But you should mention that SPARC Europe has committed to update it through its Open Access Citation Advantage Service.</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/Jm6cBn0g7S2">http://sparceurope.org/oaca/</ext-link></p><p>Finally, in the same place where you cite Swan's literature review, you should cite Ben Wagner's literature review, "Open Access Citation Advantage: An Annotated Bibliography," Issues in Science and Technology Librarianship, Winter 2010.</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/X3vFB2aG0hK">http://www.istl.org/10-winter/article2.html</ext-link></p><p>p. 5. In the timeline entry for 2002, the BOAI was released on February 14, not January 14.</p><p>p. 6. In the timeline entry for 2013, I'd say that the suicide of Aaron Swartz "increases" (not "gains") international attention for the OA movement, or "draws new attention" to the OA movement. The current language suggests that the OA movement didn't have international attention before that, which is very far from the truth.</p><p>p. 9. You say, "Shifting copyright to stay with the author allows for wider re-use, including TDM, and forms the basis for a robust and developing public domain." </p><p>You shouldn't use "public domain" here. In copyright law, the term has a specific meaning which you don't mean here.</p><p>p. 10. You say, "Only recently has any transparency into the detailed costs of subscriptions been gained by using Freedom of Information Requests to bypass non-disclosure agreements between libraries and publishers (Lawson & Meghreblian, 2015)."</p><p>Here you overlook the earlier Big Deal Contract Project in the US, from Ted Bergstrom, Paul Courant, and Preston McAfee. It too used public records laws and Freedom of Information requests. I'm not sure when it launched, but it was before 2009.</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/7YwSBgG0oFg">http://www.econ.ucsb.edu/~tedb/Journals/BundleContracts.html</ext-link></p><p>p. 10. You say, "The average production cost for one paper is estimated to be around $3500–$4000 (Van Noorden, 2013)."</p><p>I've seen dozens of widely varying estimates of this cost, most of them much lower than Van Noorden's. Unfortunately I don't have time to hunt them down. I hope you can introduce at least a few more, if only to show that estimates differ widely here.</p><p>p. 10. You say, "Philip Campbell (Editor-in-Chief of Nature) stated that his journal’s internal costs were at $20,000–$30,000 per paper...."</p><p>To clarify, I think he meant that this was the cost per
<bold>published </bold>paper. If Nature rejects x articles for every one it publishes, then this includes the cost of peer reviewing x rejected articles. Since Nature is very selective, x is high. But this "cost per published paper" should not be compared to costs for peer-reviewing a single paper or the production costs of publishing an accepted paper.</p><p>p. 10. You say, "OA publishing is most prevalent in the form of ‘pay-to-publish’...."</p><p>This is either false or misleading. About 70% of peer-reviewed OA journals charge no APCs at all. In that sense, the fee-based model is not the most prevalent. It's a minority model. On the other hand, about 50% of the articles published in peer-reviewed OA journals are published in the fee-based variety. </p><p>On my claim that most OA journals charge no APCs: </p><p>See my article, "Good facts, bad predictions," SPARC Open Access Newsletter, June 2006.</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/E8NIBo0laFe">https://dash.harvard.edu/handle/1/4391309</ext-link></p><p>And my article, "No-fee open-access journals," SPARC Open Access Newsletter, November 2, 2006.
<ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/zwXSBxV17S2">https://dash.harvard.edu/handle/1/4552050</ext-link></p><p>The DOAJ used to make it easy to see what percentage of listed journals were fee-based and what percentage were no-fee. But it has temporarily made that difficult by combining the categories of "no-fee journals" and "journals for which we don't have enough information to say."</p><p>On my claim that about half the articles published in peer-reviewed OA journals are published in the fee-based variety, see the updates to p. 170 of my 2012 book. There I cite three studies and quote the relevant excerpts.</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/RJWuBO1nLSq">http://bit.ly/oa-book#p170</ext-link></p><p>p. 10. When you describe ways in which fee-based OA journals mitigate some problems arising from the model, you mention the firewall between the editorial and business side of the journal (good), and you mention fee waivers (good).</p><p>You should also mention fee discounts, which many journals give in lieu of fee waivers. </p><p>You should also mention that most fees charged by fee-based journals are paid by funders (59%), or the author's employer (24%), and only 12% are paid by authors themselves. These numbers are from Suenje Dallmeier-Tiessen et al., "Highlights from the SOAP project survey. What Scientists Think about Open Access Publishing," arXiv, January 29, 2011, Table 4.</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/vpeIBgDKGFN">http://arxiv.org/abs/1101.5260</ext-link></p><p>p. 12. You say, "In his article Sutton (2011)..."</p><p>please change "his" to "her". The article is by Caroline Sutton.</p><p>p. 12. You say, "While OA is not a solution to all aspects of research accessibility (e.g., language barriers and disability access remain continuing issues to be addressed)...."</p><p>See my 2012 book (Open Access, MIT Press, 2012,
<ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/nqouBl5WGsK">http://bit.ly/oa-book</ext-link>), at pp. 26-27, where I make much the same point. "OA isn't universal access" and by itself doesn't overcome "filtering and censorship barriers", "language barriers", "handicap access barriers", or "connectivity barriers".</p><p>p. 13. You refer to "the fact that access to knowledge is actively prohibited in fields like public health...."</p><p>I don't know what you mean here by "actively prohibited".</p><p>p. 13. You say, "Some traditional publishers, and some academics, have argued that public access to research is not required because research papers cannot be understood by non-specialists...."</p><p>Here you might want to cite Section 5.5.1 ("OA for Lay Readers," pp. 115-119) of my 2012 book.</p><p>p. 13. You say, "The shift from a ‘reader pays’ to an ‘author pays’ mode...."</p><p>I recommend avoiding the term "author pays" for the reasons I gave in my fourth comment to p. 10 above. Most OA journals don't charge author-side fees, and among those who do, most fees are not paid by authors. </p><p>p. 13. You say, "This has been at least partially mitigated with waiver fees for authors from developing countries and additional provisions in research grants...."</p><p>Yes. But again, don't forget that the majority of peer-reviewed journals are no-fee journals. See my fourth comment to p. 10 above. </p><p>pp. 15-15. You say, "Fortunately, it seems that funders and research organisations are moving in that direction. Since 2005, the number policies supporting OA publishing increased steadily. Consequently, it is now the responsibility of researchers to ensure OA to their publications either by choosing the green or the gold road."</p><p>Since you're recapitulating some grounds for optimism here, I'd also reiterate the growth of rights-retention OA policies. See my second comment on p. 3 above. </p><p>p. 16. You say, "As Peter Suber, a leading voice in the OA movement, stated: 'As long as they do not have the power to stop Open Access, the toll-access publishers are not the enemy'."</p><p>Thanks for quoting me. I wanted to give you the source to cite. Unfortunately, I don't think you're using an exact quote. Here's the closest one I can find:</p><p>"TA [toll-access] publishers are not the enemy. They are only unpersuaded. Even when they are opposed, and not merely unpersuaded, they are only enemies if they have the power to stop OA. No publisher has this power, or at least not by virtue of publishing under a TA business model. If we have enemies, they are those who can obstruct progress to OA. The only people who fit this description are friends of OA who are distracted from providing OA by other work or other priorities."</p><p>It's from "Two distractions," SPARC Open Access Newsletter, May 3, 2004.</p><p><ext-link ext-link-type="uri" xlink:href="https://protect-eu.mimecast.com/s/1MrIBZLbAFG">https://dash.harvard.edu/handle/1/4391169</ext-link></p><p>I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p></body><sub-article id="comment1971" article-type="response"><front-stub><contrib-group><contrib contrib-type="author"><name><surname>Tennant</surname><given-names>Jon</given-names></name><aff>Imperial College London, UK</aff></contrib></contrib-group><author-notes><fn fn-type="COI-statement"><p><bold>Competing interests: </bold>I work with Alexander at ScienceOpen.</p></fn></author-notes><pub-date pub-type="epub"><day>10</day><month>5</month><year>2016</year></pub-date></front-stub><body><p>Hi Alexander,</p><p>I've been looking into this, and the most up-to-date statistics for this based on the DOAJ come from this source:
<ext-link ext-link-type="uri" xlink:href="http://citesandinsights.info/civ16i4.pdf">http://citesandinsights.info/civ16i4.pdf</ext-link>. Figures here seem to suggest that 71% of journals in the DOAJ do not levy an APC. This is likely to change slightly with the updated 'crackdown' from the DOAJ (
<ext-link ext-link-type="uri" xlink:href="http://www.nature.com/news/open-access-index-delists-thousands-of-journals-1.19871">http://www.nature.com/news/open-access-index-delists-thousands-of-journals-1.19871</ext-link>), but I'll add a reference to this in.</p><p>Jon</p></body></sub-article><sub-article id="comment1997" article-type="response"><front-stub><contrib-group><contrib contrib-type="author"><name><surname>Suber</surname><given-names>Peter</given-names></name><aff>Harvard University, USA</aff></contrib></contrib-group><author-notes><fn fn-type="COI-statement"><p><bold>Competing interests: </bold>No competing interests were disclosed.</p></fn></author-notes><pub-date pub-type="epub"><day>24</day><month>5</month><year>2016</year></pub-date></front-stub><body><p>Here are the latest stats from the DOAJ (May 24, 2016).</p><p><ext-link ext-link-type="uri" xlink:href="https://goo.gl/LejTAw">https://goo.gl/LejTAw</ext-link></p></body></sub-article><sub-article id="comment1998" article-type="response"><front-stub><contrib-group><contrib contrib-type="author"><name><surname>Tennant</surname><given-names>Jon</given-names></name><aff>Imperial College London, UK</aff></contrib></contrib-group><author-notes><fn fn-type="COI-statement"><p><bold>Competing interests: </bold>No competing interests were disclosed.</p></fn></author-notes><pub-date pub-type="epub"><day>25</day><month>5</month><year>2016</year></pub-date></front-stub><body><p>Dear Alexander,</p><p> I'm just posting the link that Peter was kind enough to send us yesterday, with updated statistics on this matter:
<ext-link ext-link-type="uri" xlink:href="https://plus.google.com/+PeterSuber/posts/HjrRDcrZS8p">https://plus.google.com/+PeterSuber/posts/HjrRDcrZS8p</ext-link></p><p> Important points:</p><p> Here are the numbers as of May 24, 2016:</p><p> Total number of journals listed in DOAJ = 8,858</p><p> Yes (fee-based) = 1,424 = 16%</p><p> No (no-fee) = 2,601 = 29%</p><p> No info = 4,833 = 55%</p><p> Further references and information are provided in that post, and will be integrated into the next version of this manuscript.</p><p> Best,</p><p> Jon</p></body></sub-article></sub-article><sub-article id="report13293" article-type="peer-review"><front-stub><article-id pub-id-type="doi">10.5256/f1000research.9110.r13293</article-id><title-group><article-title>Referee response for version 1</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Lockwood</surname><given-names>Gwilym</given-names></name><xref ref-type="aff" rid="r13293a1">1</xref><role>Referee</role></contrib><aff id="r13293a1"><label>1</label>Neurobiology of Language Department, Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands</aff></contrib-group><author-notes><fn fn-type="COI-statement"><p><bold>Competing interests: </bold>Non-financial: I'm an Open Access advocate, and so I have a vested ideological interest in seeing papers like this succeed and reach wide audiences. However, if anything, I believe that makes my peer review more critical, as I want this paper to be the best paper it can be.</p></fn></author-notes><pub-date pub-type="epub"><day>15</day><month>4</month><year>2016</year></pub-date><related-article id="d36e10350" related-article-type="peer-reviewed-article" ext-link-type="doi" xlink:href="10.12688/f1000research.8460.1">Version 1</related-article><custom-meta-group><custom-meta><meta-name>recommendation</meta-name><meta-value>approve</meta-value></custom-meta></custom-meta-group></front-stub><body><p>This is the first time I've written an open peer review, although I always sign private peer reviews. Normally I'd make comments directed to the authors and the authors alone, but since this is open, I've also included a section for other readers of this paper. This may sound a bit like an Amazon or Airbnb review or something.</p><p><underline>Short summary for readers</underline></p><p>This is an excellent paper about the academic, economic, and societal benefits and impacts of Open Access. It's a good introductory text for people who don't know much about OA and would like to know more. It's also a good persuasive text for stakeholders in policy, universities, publishing, funding, etc. positions who may be interested in including OA in their decision making.</p><p>In addition to its attention to detail, its main strengths are its focus, its brevity, and its relative impartiality.</p><p>One of the difficulties with writing about OA is that there are so many overlapping issues; this paper is very good at giving a brief overview or description of the other issues, pointing the reader in the direction of somewhere with more information, and then getting back onto the topic.</p><p>Another thing about OA is that its advocates are very passionate about it. As with any cause, that's a good thing for its supporters, but overwhelmingly pro-OA resources can seem potentially off-putting to neutrals. This paper does an excellent job of presenting an evidence-based pro-OA viewpoint in a measured tone and without coming across as ideological.</p><p>One possible caveat is that the paper presents extensive evidence of what OA does, but it doesn't tackle the meatier issue of how to implement it successfully. However, I feel that's a separate issue which is beyond the scope and purpose of this paper.</p><p><underline>Suggestions and comments for authors</underline></p><p>First of all, great article! Well done and thank you for pulling together what is a disparate collection of links and literature into a one-stop shop which is both useful and coherent. I like this article a lot... but my role here is to criticise and make it better, so the rest of this review will focus on that.</p><p>This article is well-written and well-structured. That's made it much easier as a reviewer to simply go through the article and highlight my issues with it paragraph by paragraph, rather than having to make it coherent first and then sort out the smaller things.</p><p>The vast majority of the issues I have with this paper are minor ones, so it didn't make sense to have separate major/minor sections; rather, I'll just go through them in order in the text.</p><p>(I printed this out to underline/comment on, so for me, tables 1 and 2 came during the academic case for OA section. Online, they're supplementary materials, and I think it's best that way, but this is why I'm commenting on the tables during that section)</p><p><bold>Abstract</bold></p><p>"We recommend that OA supporters focus their efforts on working to establish viable new models and systems of scholarly communication, rather than trying to undermine the existing ones..."</p><p>In general, I agree with this sentiment. However, I feel that its inclusion in the abstract is a bit jarring as the text of the article doesn't really cover recommendations to OA supporters at all, other than in the very last paragraph. I think that's good, as I feel this paper is best suited as relatively neutral source of information rather than a preaching to the converted or ideology discussion kind of purpose. So, I think this part can be left out of the abstract; it doesn't refer to any particular "recommendations to OA supporters" bit in the text and potentially clouds the strength of the relative impartiality of the paper.</p><p><bold>A brief history of OA</bold></p><p>"BioMed Central and ... PLOS were founded in the early 2000s and remain successful businesses to date." (p3, col2)</p><p>Technically, PLOS is a non-profit. I suggest changing
<italic>successful businesses</italic> to successful business models. This both highlights the financial sustainability of OA (increased APCs at PLOS notwithstanding) and also sets it apart from traditional publishers, which are definitely successful businesses.</p><p><bold>The academic case for OA </bold></p><p>figure 1 (p4, top)</p><p>I have difficulty interpreting the y-axis on figure 1. It's labelled as cumulative number of PubMed articles relative to 2000, but I'm not sure how to read it. Reading off 2014, non-OA is c.22 on the y-axis, and OA is c.33 on the y-axis. Based on the figure 1 caption about the ratio, I'm interpreting this as meaning that, in 2014, the ratio of cumulative PubMed articles was approx 33:22 OA to non-OA, or in other words, 60% of PubMed articles in 2000-2014 were OA. However, I'm not sure if this is how it's meant to be interpreted. I think that it's well visualised, and really makes it clear how OA has taken off, but exactly what the numbers represent on the y-axis is unclear to me: number of articles? number of times more articles? It could use some relabelling.</p><p>"Napster moment" (p4, col1)</p><p>I like the comparison, but it could use a citation (even just the Napster wikipedia article) and/or a little more explanation to clarify what that means.</p><p>Table 1:</p><p>"1991 ... by the American physician Paul Ginsparg"</p><p>He's a physicist, not a physician.</p><p>Table 2:</p><p>Xu et al (2011)</p><p>I don't think this reference was very well cited. Firstly,
<italic>Oxford Open Journals</italic> are listed as a discipline, when they're the source of papers across disciplines. The actual disciplines were Medicine, Social Sciences, Mathematics & Physical Sciences, Life Sciences, and Humanities. Secondly, you list the citation advantage as 138.87%. However, one of the main findings of this paper was the disparity in citation advantages; it ranged from 163.16% for OA articles in Mathematics & Physical Sciences to an actual citation disadvantage of -49.24% for OA articles in Humanities. Given the pro-OA nature of the paper, I feel like you have an extra responsibility to report the few anti-OA pieces of evidence.</p><p>Gargouri et al (2010) (page 8, col1)</p><p>This paragraph is about a possible confound for the OA citation advantage, where it could be that researchers choose to publish OA for extra cool findings, and you use the Gargouri et al. study to counter this... which is totally correct. You write:</p><p>"Gargouri et al. (2010) compared citation counts [for articles which were] self-selected as OA or mandated as OA. The study concluded that both were cited significantly more than non-OA articles. As such, these findings rule out a selection bias"</p><p>This is true that both OA types were cited more than non-OA. However, it's also missing the crucial point that there was no difference in citation between self-selected OA articles and mandatory OA articles. Including this would strengthen your point to show that it's OA itself which leads to the citation advantage.</p><p>The whole section about altmetrics (subhead societal impact of the academic case for OA, p8, col2) could use some attention. It's not clear until much later what the difference is between alternative metrics (i.e. altmetrics), i.e. the various types of metrics which are alternative to journal impact factors, and Altmetric, i.e. the company which is often confusingly referred to as Altmetrics (not in this paper, to be fair, but elsewhere). A quick disambiguating sentence or two would be really useful here.</p><p>In the following paragraph (page 8, col2), you write about OA altmetrics advantage, and say that there's a logical assumption that OA articles should have one. However, this doesn't consider the fact that the prestige of some journals is advertising in and of itself. You can, and do, get a lot of closed-access papers which generate high altmetrics (social media attention, Mendeley readhership) from academics who do have access. And sure enough, in the next paragraph, (page 8 and 9), the Wang et al. 2015 article finds that the OA altmetric advantage doesn't extend to the most impactful articles. I think this section can be made more nuanced and informative by quickly discussing the role of journal prestige. Nothing in depth, just as something that exists and needs to change (for example, you could point people to Brembs
<italic>et al. </italic>and the Deep Impact paper in Frontiers).</p><p>"Essentially, copyright is a tool wielded by traditional publishers for financial gain rather than fostering creativity..."</p><p>I don't disagree with this. However, I feel it comes on too strong. I think it's fair to say that most people's immediate opinion of copyright is "well, I'd like my stuff to be copyrighted, as that means people can't steal it and pass it off as their own". I think that you need a little more detail here, even just two or three sentences to explain how and why copyright is used for financial gain rather than author protection. Otherwise, it just sounds political/ideological, and counterintuitive for people who haven't read much about copyright.</p><p>Glenisson et al. (2005) citation (page 9, col2).</p><p>You write that TDM has "proven to be useful for a large variety of applications", and use the Glenisson citation to back this up. I have to say here that I know very little about TDM; however, following through to the Glenisson paper, I don't see how it supports that conclusion. I read it and it seems to show a proof-of-concept kind of study: that TDM can group a set of papers into themes in the same way that an expert can. This is really cool and everything, but I don't think that that substantiates your point that TDM is useful for a large variety of applications. Rather, I'd like to see a couple of specific examples, which you then describe more fully in the next paragraph. One good one is Swanson 1987 (I think - taken from here:
<ext-link ext-link-type="uri" xlink:href="http://people.ischool.berkeley.edu/~hearst/papers/acl99/acl99-tdm.html">http://people.ischool.berkeley.edu/~hearst/papers/acl99/acl99-tdm.html</ext-link>), who used TDM to make the link between migraines and magnesium deficiency.</p><p>"...simply because one can no longer keep up with the published literature".</p><p>Small point, but I think it's worth stressing that this is due to the amount of literature that there is.</p><p><bold>The economic case for OA</bold></p><p>the pay-to-publish part (p10, col2)</p><p>I feel this glosses over problems with pay-to-publish. You come back to predatory OA later, but this isn't quite the same: I think it could use a couple of extra sentences describing what the conflict of interest for researchers is, and also stress that pay-to-publish makes it potentially in a journal's interest to accept more papers than they necessarily should. One of the most common anti-OA arguments I see in non-scientific media is that OA is pay-to-publish, which is often misrepresented as "pay-to-publish is publication bribery". I think this section needs a little more substance to it to acknowledge/address this.</p><p>"making publication costs dependent on the value added..." (page 11, col1)</p><p>When talking about the value added by journals, this paragraph ignores the elephant in the room: journal prestige. Again, I know that this isn't the purpose of this article, but I think it could really be strengthened by mentioning it before moving on.</p><p>"Much primary research actually takes place outside of academia inside research and development departments" (page 11, col2)</p><p>The part following this sentence is muddy. First, you talk about R&D outside academia (i.e. presumably private research), and then you talk about access to research results because they're publicly financed public goods. So, what does that mean, that R&D from private businesses who've invested their own capital in it should be made available to all? (maybe I agree with that, in some cases, but a lot of people sure won't)</p><p>I think this paragraph could be honed a bit; otherwise, it's straying into the ideological territory of saying that all private research should be made public for the public good. That transcends OA in scholarly publishing, and makes OA in scholarly publishing too easy to dismiss.</p><p>The cancer research paragraph (page 12, col1) is also unclear. It took me a while to figure out it's talking about UK expenditure - my first assumption of "total expenditure" meant worldwide. It's also not totally clear what the point is - the geographical origin of research is unrelated to its open status. I think that it's quite a leap to write (apologies for paraphrasing) "83% of UK economic benefit from cancer research comes from research outside UK, therefore open access is good", because I think it conflates two different things.</p><p>Also, small point, "17% of the annual net-monetary was estimated" is missing the word benefit after net-monetary.</p><p><bold>The societal case for OA</bold></p><p>Small point: as somebody who wears a linguistics hat quite often, it rankles to read on page 11 "Examples of [non-academic] groups who might benefit include... those who work in linguistics and translation". Translation, for sure, but linguistics is an academic field - you even mention the Lingua to Glossa movement organised by academic linguists later in the manuscript! To me, this is like writing "...those who work in biology and vets", lumping the academic field and a practical use of that field together. Just referring to translation is fine.</p><p>Citizen engagement (page 13, col 1)</p><p>I agree that these are great examples of citizen engagement with science, but at the risk of sounding like an Elsevier representative, interest in projects like Galaxy Zoo does not entail desire to download and read papers. In fact, you could even make the (spurious) argument that those projects come into existence precisely because citizens aren't interested in downloading and reading papers. I don't actually agree with that, I agree with your general point... but I think that citizen science project interest and citizen science paper interest. Obviously I think it is in the public interest to have science journals OA, but this isn't the right argument (and I think the sentence "Such statements conflate a lack of desire or need for access with the denial of opportunity to access research" is perfect). I think a stronger argument would be to look at existing OA journals, such as PLOS and Frontiers, and see how many views and downloads come from people who aren't academics. If you can point to, say, some of the most viewed/downloaded PLOS papers and say "look, 30% (or whatever, that's a random number) of these readers aren't academics, they're real people who are interested in it", that would make for a stronger argument.</p><p>Quibble about the "yes, we were warned about Ebola" example: the finding from that paper (that Liberians have Ebola antibodies in their blood, suggesting the endemic presence of Ebola) is actually written on the first page preview of the paper (
<ext-link ext-link-type="uri" xlink:href="http://www.sciencedirect.com/science/article/pii/S0769261782800282/part/first-page-pdf">http://www.sciencedirect.com/science/article/pii/S0769261782800282/part/first-page-pdf</ext-link>, accessed from my laptop outside my institution). It could be argued that anybody could see this finding anywhere in the world, meaning that it's not a problem of OA, it's a problem about searching and indexing. A good counterargument to
<italic>that </italic>is obviously that this paper would have been unsearchable with TDM at the start of the outbreak when people were combing through all West African Ebola literature.</p><p>" 'green' model of OA adoption" (page 13, col2)</p><p>You generally refer to Green and Gold routes, with the colours capitalised. Just a small terminology thing to keep consistent.</p><p>A much more important thing is also on page 13, col2:</p><p>"The pay-to-publish system is a potentially greater burden for authors in
<bold>developed </bold>countries, considering that they are not used to paying publication costs, and funding systems for OA are not as well-established as those in the Western world."</p><p>--> developing countries, not developed countries!</p><p>Predatory publishers (page 14, col1)</p><p>I agree with Ross Mounce's comment on the paper: you give Beall too much importance. I think it can be a useful list and should be mentioned, but definitely include some caveats like the ones Ross writes, or the fact that he added Frontiers to the list because of a couple of editorial mistakes.</p><p><bold>Conclusions</bold></p><p>Peter Suber (page 16, col1)</p><p>You describe him as "a leading voice in the OA movement", but I think you should write what his positions are (see
<ext-link ext-link-type="uri" xlink:href="http://cyber.law.harvard.edu/~psuber/wiki/Peter_Suber">http://cyber.law.harvard.edu/~psuber/wiki/Peter_Suber</ext-link>) in order to justify his importance.</p><p><bold>Other general things</bold></p><p>There are no proposed solutions in this paper, which is totally fine, because it's beyond the scope of the paper. I feel it could benefit by putting in a couple of sentences here and there about who is needed for driving this change: academics, funders, governments, etc.</p><p>I was disappointed not to see anything about the Dutch government and university library organisations' collective drive towards OA. They've changed the national law on copyright, they've reached agreements with most major publishing groups, they may well introduce mandatory OA publishing in the Netherlands in 2016, and they've made it one of the main priorities of their EU presidency this year. It's like the best example of how a whole country can take the lead and sort it out. I think including a quick reference to the Netherlands as an example of excellent OA policy (in the same way that you mention sciELO in Latin America) would go a long way towards convincing the people who are reading this thinking, "ah, yes, I guess OA makes sense in the developing world, but we're doing fine here in the West and it would be too difficult to change things". A good summary of that is here:
<ext-link ext-link-type="uri" xlink:href="http://openaccess.nl/en/in-the-netherlands/current-situation">http://openaccess.nl/en/in-the-netherlands/current-situation</ext-link></p><p><underline>Final remarks</underline></p><p>That's the end of my 2800-odd word review. I really enjoyed reading this paper, going through it, and trying to find ways to improve it. Thanks to the authors for writing an excellent paper.</p><p>I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p></body><back><ref-list><title>References</title><ref id="rep-ref-13293-1"><label>1</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brembs</surname><given-names>B</given-names></name><name><surname>Button</surname><given-names>K</given-names></name><name><surname>Munafò</surname><given-names>M</given-names></name></person-group>:
<article-title>Deep impact: unintended consequences of journal rank.</article-title><source><italic>Front Hum Neurosci</italic></source>.<year>2013</year>;<volume>7</volume>:
<elocation-id>632</elocation-id><fpage>291</fpage><pub-id pub-id-type="doi">10.3389/fnhum.2013.00291</pub-id><pub-id pub-id-type="pmid">24115925</pub-id></mixed-citation></ref><ref id="rep-ref-13293-2"><label>2</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Swanson</surname><given-names>D</given-names></name></person-group>:
<article-title>Two medical literatures that are logically but not bibliographically connected</article-title>.
<source><italic>Journal of the American Society for Information Science</italic></source>.<year>1987</year>;<volume>38</volume>(<issue>4</issue>) :
<elocation-id>632</elocation-id><fpage>228</fpage>-<lpage>233</lpage><pub-id pub-id-type="doi">10.1002/(SICI)1097-4571(198707)38:4<228::AID-ASI2>3.0.CO;2-G</pub-id></mixed-citation></ref></ref-list></back></sub-article></pmc></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Belgique/explor/OpenAccessBelV2/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000463 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 000463 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Belgique
|area= OpenAccessBelV2
|flux= Pmc
|étape= Corpus
|type= RBID
|clé=
|texte=
}}
| This area was generated with Dilib version V0.6.25. |  |