Citation success of different publication types: a case study on all references in psychology publications from the German-speaking countries (D–A–CH–L–L) in 2009, 2010, and 2011
Identifieur interne : 000067 ( Pmc/Corpus ); précédent : 000066; suivant : 000068Citation success of different publication types: a case study on all references in psychology publications from the German-speaking countries (D–A–CH–L–L) in 2009, 2010, and 2011
Auteurs : Günter Krampen ; Peter Weiland ; Jürgen WiesenhütterSource :
- Scientometrics [ 0138-9130 ] ; 2015.
Abstract
Scientometric data on the citation success of different publication types and publication genres in psychology publications are presented. Data refer to references that are cited in these scientific publications and that are documented in PSYNDEX, the exhaustive database of psychology publications from the German-speaking countries either published in German or in English language. Firstly, data analyses refer to the references that are cited in publications of 2009 versus 2010 versus 2011. With reference to all cited references, the portion of journal articles ranges from 57 to 61 %, of books from 22 to 24 %, and of book chapters from 14 to 15 %, with a rather high stability across the three publication years analysed. Secondly, data analyses refer to the numbers of cited references from the German-speaking countries, which are also documented in PSYNDEX. These compose about 11 % of all cited references indicating that nearly 90 % of the references cited are of international and/or interdisciplinary publications not stemming from the German-speaking countries. The subsample shows the proportion of journal articles, books, and chapters, and these are very similar to the percentages identified for all references that are cited. Thirdly, analyses refer to document type, scientific genre, and psychological sub-discipline of the most frequently cited references in the psychology publications. The frequency of top-cited references of books and book chapters is almost equal to that of journal articles; two-thirds of the top-cited references are non-empirical publications, only one-third are empirical publications. Top-cited references stem particularly from clinical psychology, experimental psychology, as well as tests, testing and psychometrics. In summary, the results point to the fact that citation analyses, which are limited to journal papers, tend to neglect very high portions of references that are cited in scientific publications.
Url:
DOI: 10.1007/s11192-015-1573-y
PubMed: 26257449
PubMed Central: 4526583
Links to Exploration step
PMC:4526583Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Citation success of different publication types: a case study on all references in psychology publications from the German-speaking countries (D–A–CH–L–L) in 2009, 2010, and 2011</title><author><name sortKey="Krampen, Gunter" sort="Krampen, Gunter" uniqKey="Krampen G" first="Günter" last="Krampen">Günter Krampen</name><affiliation><nlm:aff id="Aff1">Leibniz Institute for Psychology Information (ZPID), Trier, Germany</nlm:aff></affiliation><affiliation><nlm:aff id="Aff2">Department of Psychology, University of Trier, Trier, Germany</nlm:aff></affiliation></author><author><name sortKey="Weiland, Peter" sort="Weiland, Peter" uniqKey="Weiland P" first="Peter" last="Weiland">Peter Weiland</name><affiliation><nlm:aff id="Aff1">Leibniz Institute for Psychology Information (ZPID), Trier, Germany</nlm:aff></affiliation></author><author><name sortKey="Wiesenhutter, Jurgen" sort="Wiesenhutter, Jurgen" uniqKey="Wiesenhutter J" first="Jürgen" last="Wiesenhütter">Jürgen Wiesenhütter</name><affiliation><nlm:aff id="Aff1">Leibniz Institute for Psychology Information (ZPID), Trier, Germany</nlm:aff></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">26257449</idno><idno type="pmc">4526583</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4526583</idno><idno type="RBID">PMC:4526583</idno><idno type="doi">10.1007/s11192-015-1573-y</idno><date when="2015">2015</date><idno type="wicri:Area/Pmc/Corpus">000067</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Corpus" wicri:corpus="PMC">000067</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Citation success of different publication types: a case study on all references in psychology publications from the German-speaking countries (D–A–CH–L–L) in 2009, 2010, and 2011</title><author><name sortKey="Krampen, Gunter" sort="Krampen, Gunter" uniqKey="Krampen G" first="Günter" last="Krampen">Günter Krampen</name><affiliation><nlm:aff id="Aff1">Leibniz Institute for Psychology Information (ZPID), Trier, Germany</nlm:aff></affiliation><affiliation><nlm:aff id="Aff2">Department of Psychology, University of Trier, Trier, Germany</nlm:aff></affiliation></author><author><name sortKey="Weiland, Peter" sort="Weiland, Peter" uniqKey="Weiland P" first="Peter" last="Weiland">Peter Weiland</name><affiliation><nlm:aff id="Aff1">Leibniz Institute for Psychology Information (ZPID), Trier, Germany</nlm:aff></affiliation></author><author><name sortKey="Wiesenhutter, Jurgen" sort="Wiesenhutter, Jurgen" uniqKey="Wiesenhutter J" first="Jürgen" last="Wiesenhütter">Jürgen Wiesenhütter</name><affiliation><nlm:aff id="Aff1">Leibniz Institute for Psychology Information (ZPID), Trier, Germany</nlm:aff></affiliation></author></analytic><series><title level="j">Scientometrics</title><idno type="ISSN">0138-9130</idno><idno type="eISSN">1588-2861</idno><imprint><date when="2015">2015</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>Scientometric data on the citation success of different publication types and publication genres in psychology publications are presented. Data refer to references that are cited in these scientific publications and that are documented in PSYNDEX, the exhaustive database of psychology publications from the German-speaking countries either published in German or in English language. Firstly, data analyses refer to the references that are cited in publications of 2009 versus 2010 versus 2011. With reference to all cited references, the portion of journal articles ranges from 57 to 61 %, of books from 22 to 24 %, and of book chapters from 14 to 15 %, with a rather high stability across the three publication years analysed. Secondly, data analyses refer to the numbers of cited references from the German-speaking countries, which are also documented in PSYNDEX. These compose about 11 % of all cited references indicating that nearly 90 % of the references cited are of international and/or interdisciplinary publications not stemming from the German-speaking countries. The subsample shows the proportion of journal articles, books, and chapters, and these are very similar to the percentages identified for all references that are cited. Thirdly, analyses refer to document type, scientific genre, and psychological sub-discipline of the most frequently cited references in the psychology publications. The frequency of top-cited references of books and book chapters is almost equal to that of journal articles; two-thirds of the top-cited references are non-empirical publications, only one-third are empirical publications. Top-cited references stem particularly from clinical psychology, experimental psychology, as well as tests, testing and psychometrics. In summary, the results point to the fact that citation analyses, which are limited to journal papers, tend to neglect very high portions of references that are cited in scientific publications.</p></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Aguillo, If" uniqKey="Aguillo I">IF Aguillo</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Albarran, P" uniqKey="Albarran P">P Albarrán</name></author><author><name sortKey="Crespo, Ja" uniqKey="Crespo J">JA Crespo</name></author><author><name sortKey="Ortu O, I" uniqKey="Ortu O I">I Ortuño</name></author><author><name sortKey="Ruiz Castillo, J" uniqKey="Ruiz Castillo J">J Ruiz-Castillo</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Alves, Ad" uniqKey="Alves A">AD Alves</name></author><author><name sortKey="Yanasse, Hh" uniqKey="Yanasse H">HH Yanasse</name></author><author><name sortKey="Soma, Ny" uniqKey="Soma N">NY Soma</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Beel, J" uniqKey="Beel J">J Beel</name></author><author><name sortKey="Gipp, B" uniqKey="Gipp B">B Gipp</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bornmann, L" uniqKey="Bornmann L">L Bornmann</name></author><author><name sortKey="Leydesdorff, L" uniqKey="Leydesdorff L">L Leydesdorff</name></author><author><name sortKey="Krampen, G" uniqKey="Krampen G">G Krampen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bornmann, L" uniqKey="Bornmann L">L Bornmann</name></author><author><name sortKey="Leydesdorff, L" uniqKey="Leydesdorff L">L Leydesdorff</name></author><author><name sortKey="Wang, J" uniqKey="Wang J">J Wang</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cavacini, A" uniqKey="Cavacini A">A Cavacini</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Chi, P S" uniqKey="Chi P">P-S Chi</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="De Winter, Jcf" uniqKey="De Winter J">JCF de Winter</name></author><author><name sortKey="Zadpoor, Aa" uniqKey="Zadpoor A">AA Zadpoor</name></author><author><name sortKey="Dodou, D" uniqKey="Dodou D">D Dodou</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gallagher Tuleya, L" uniqKey="Gallagher Tuleya L">L Gallagher Tuleya</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gl Nzel, W" uniqKey="Gl Nzel W">W Glänzel</name></author><author><name sortKey="Moed, Hf" uniqKey="Moed H">HF Moed</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gonzalez Alcaide, G" uniqKey="Gonzalez Alcaide G">G González-Alcaide</name></author><author><name sortKey="Valderrama Zurian, Jc" uniqKey="Valderrama Zurian J">JC Valderrama-Zurián</name></author><author><name sortKey="Aleixandre Benavent, R" uniqKey="Aleixandre Benavent R">R Aleixandre-Benavent</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hicks, D" uniqKey="Hicks D">D Hicks</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Johnston, Dw" uniqKey="Johnston D">DW Johnston</name></author><author><name sortKey="Piatti, M" uniqKey="Piatti M">M Piatti</name></author><author><name sortKey="Torgler, B" uniqKey="Torgler B">B Torgler</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kliegl, R" uniqKey="Kliegl R">R Kliegl</name></author><author><name sortKey="Bates, D" uniqKey="Bates D">D Bates</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Krampen, G" uniqKey="Krampen G">G Krampen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Krampen, G" uniqKey="Krampen G">G Krampen</name></author><author><name sortKey="Montada, L" uniqKey="Montada L">L Montada</name></author><author><name sortKey="Muller, Mm" uniqKey="Muller M">MM Müller</name></author><author><name sortKey="Schui, G" uniqKey="Schui G">G Schui</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Larsen, Po" uniqKey="Larsen P">PO Larsen</name></author><author><name sortKey="Von Ins, M" uniqKey="Von Ins M">M von Ins</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mayr, P" uniqKey="Mayr P">P Mayr</name></author><author><name sortKey="Walter, A K" uniqKey="Walter A">A-K Walter</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Michels, C" uniqKey="Michels C">C Michels</name></author><author><name sortKey="Schmoch, U" uniqKey="Schmoch U">U Schmoch</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mingers, J" uniqKey="Mingers J">J Mingers</name></author><author><name sortKey="Lipitakis, Eaecg" uniqKey="Lipitakis E">EAECG Lipitakis</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Moed, Hf" uniqKey="Moed H">HF Moed</name></author><author><name sortKey="Halevi, G" uniqKey="Halevi G">G Halevi</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ossenblok, T" uniqKey="Ossenblok T">T Ossenblok</name></author><author><name sortKey="Engels, T" uniqKey="Engels T">T Engels</name></author><author><name sortKey="Sivertsen, G" uniqKey="Sivertsen G">G Sivertsen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Van Leeuwen, T" uniqKey="Van Leeuwen T">T Van Leeuwen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wray, Kb" uniqKey="Wray K">KB Wray</name></author><author><name sortKey="Bornmann, L" uniqKey="Bornmann L">L Bornmann</name></author></analytic></biblStruct><biblStruct></biblStruct></listBibl></div1></back></TEI><pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Scientometrics</journal-id><journal-id journal-id-type="iso-abbrev">Scientometrics</journal-id><journal-title-group><journal-title>Scientometrics</journal-title></journal-title-group><issn pub-type="ppub">0138-9130</issn><issn pub-type="epub">1588-2861</issn><publisher><publisher-name>Springer Netherlands</publisher-name><publisher-loc>Dordrecht</publisher-loc></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">26257449</article-id><article-id pub-id-type="pmc">4526583</article-id><article-id pub-id-type="publisher-id">1573</article-id><article-id pub-id-type="doi">10.1007/s11192-015-1573-y</article-id><article-categories><subj-group subj-group-type="heading"><subject>Article</subject></subj-group></article-categories><title-group><article-title>Citation success of different publication types: a case study on all references in psychology publications from the German-speaking countries (D–A–CH–L–L) in 2009, 2010, and 2011</article-title></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name><surname>Krampen</surname><given-names>Günter</given-names></name><address><email>krampen@uni-trier.de</email></address><xref ref-type="aff" rid="Aff1"></xref><xref ref-type="aff" rid="Aff2"></xref></contrib><contrib contrib-type="author"><name><surname>Weiland</surname><given-names>Peter</given-names></name><xref ref-type="aff" rid="Aff1"></xref></contrib><contrib contrib-type="author"><name><surname>Wiesenhütter</surname><given-names>Jürgen</given-names></name><xref ref-type="aff" rid="Aff1"></xref></contrib><aff id="Aff1"><label></label>Leibniz Institute for Psychology Information (ZPID), Trier, Germany</aff><aff id="Aff2"><label></label>Department of Psychology, University of Trier, Trier, Germany</aff></contrib-group><pub-date pub-type="epub"><day>1</day><month>4</month><year>2015</year></pub-date><pub-date pub-type="pmc-release"><day>1</day><month>4</month><year>2015</year></pub-date><pub-date pub-type="ppub"><year>2015</year></pub-date><volume>104</volume><issue>3</issue><fpage>827</fpage><lpage>840</lpage><history><date date-type="received"><day>21</day><month>1</month><year>2015</year></date></history><permissions><copyright-statement>© The Author(s) 2015</copyright-statement><license license-type="OpenAccess"><license-p><bold>Open Access</bold>This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.</license-p></license></permissions><abstract id="Abs1"><p>Scientometric data on the citation success of different publication types and publication genres in psychology publications are presented. Data refer to references that are cited in these scientific publications and that are documented in PSYNDEX, the exhaustive database of psychology publications from the German-speaking countries either published in German or in English language. Firstly, data analyses refer to the references that are cited in publications of 2009 versus 2010 versus 2011. With reference to all cited references, the portion of journal articles ranges from 57 to 61 %, of books from 22 to 24 %, and of book chapters from 14 to 15 %, with a rather high stability across the three publication years analysed. Secondly, data analyses refer to the numbers of cited references from the German-speaking countries, which are also documented in PSYNDEX. These compose about 11 % of all cited references indicating that nearly 90 % of the references cited are of international and/or interdisciplinary publications not stemming from the German-speaking countries. The subsample shows the proportion of journal articles, books, and chapters, and these are very similar to the percentages identified for all references that are cited. Thirdly, analyses refer to document type, scientific genre, and psychological sub-discipline of the most frequently cited references in the psychology publications. The frequency of top-cited references of books and book chapters is almost equal to that of journal articles; two-thirds of the top-cited references are non-empirical publications, only one-third are empirical publications. Top-cited references stem particularly from clinical psychology, experimental psychology, as well as tests, testing and psychometrics. In summary, the results point to the fact that citation analyses, which are limited to journal papers, tend to neglect very high portions of references that are cited in scientific publications.</p></abstract><kwd-group xml:lang="en"><title>Keywords</title><kwd>Citation analysis</kwd><kwd>Publication success</kwd><kwd>Publication type</kwd><kwd>Publication genre</kwd><kwd>Bibliometry</kwd><kwd>Scientometry</kwd><kwd>Psychology</kwd></kwd-group><custom-meta-group><custom-meta><meta-name>issue-copyright-statement</meta-name><meta-value>© Akadémiai Kiadó, Budapest, Hungary 2015</meta-value></custom-meta></custom-meta-group></article-meta></front><body><sec id="Sec1" sec-type="intro"><title>Introduction</title><p>Limitations of the databases that are used in citation analyses hinder and complicate evaluations of the citation success of different scientific publication types (e.g., books, chapters, journal articles, test manuals, and therapy manuals) and publication genres (e.g., theoretical, methodological, or empirical studies, literature reviews/overview, textbooks, monographs, etc.). This can result in serious unfairness in scientometric evaluations of individual scientists, research teams, departments, institutions, and nations as well, because some of their scientific and scholarly work is underrepresented or—even worse—neglected.</p><p>This problem applies—for example—to textbooks and teaching materials published in book chapters, because these publications appertain to the scholarly performance of scientists, which report and integrate primary research results and theory building in (more or less) creative and—more important—didactically clear, structured form, which is motivating for students in education and further training. At least in medicine and psychology, this applies also to test manuals, therapy and prevention manuals as well as diagnostic and therapeutic guidelines, because of their outstanding significance not only for education and training, but also for applied diagnostic and therapeutic work in medical and psychotherapeutic treatments. Thus, these scientific publication types and publication genres must be considered in evaluations of scientists and science as well as primary research reports. Besides other criteria and indicator variables of scientific productivity and performance (e.g., research funding, invited talks at international congresses, innovations, and letter patents), this belongs to the criteria of scientific and scholarly publication output which constitute multiple bibliometric indicators and—if cited—scientometric indicators of productivity and its impact in the sciences (see, e.g., Glänzel and Moed <xref ref-type="bibr" rid="CR11">2013</xref>; Moed and Halevi <xref ref-type="bibr" rid="CR22">2014</xref>).</p><p>The problem is that the selectivity of international and interdisciplinary databases (e.g., <italic>Web of Science</italic> and <italic>Scopus</italic>) that are used in citation analyses hinders evaluations of the citation success of different scientific publication types (e.g., books, chapters, journal articles, test manuals, and therapy manuals) and publication genres (e.g., theoretical, methodological, or empirical studies, literature reviews/overview, textbooks, monographs, etc.), and this is a situation which can result in serious unfairness in scientometric evaluations. For example, the <italic>Web of Science</italic> (<italic>WoS</italic>) and <italic>Scopus</italic>, surely the most frequently used citation databases, pushes journal articles (mainly English-language papers from the Anglo-American research community; see, e.g., Albarrán et al. <xref ref-type="bibr" rid="CR2">2010</xref>; González-Alcaide et al. <xref ref-type="bibr" rid="CR12">2012</xref>; Krampen <xref ref-type="bibr" rid="CR16">2009</xref>) and ignore widely—with very few and really only English-language exceptions—books, book chapters, test manuals, and intervention (therapy) manuals in its documentation of publications and of reference lists (see, e.g., Chi <xref ref-type="bibr" rid="CR8">2014</xref>; Ossenblok et al. <xref ref-type="bibr" rid="CR23">2013</xref>; van Leeuwen <xref ref-type="bibr" rid="CR24">2013</xref>). More than that, comparative scientometric results document significant differences in the coverage, e.g., of <italic>WoS</italic> and <italic>Scopus</italic> (Alves et al. <xref ref-type="bibr" rid="CR3">2014</xref>) and others as well (see, e.g., Cavacini <xref ref-type="bibr" rid="CR7">2015</xref>, for computer sciences).</p><p>At the other extreme, <italic>Google Scholar</italic> checks the “complete” Internet for citations of publication titles (or author names) including all and perhaps nothing, because the references identified refer not only to citations in scientific publications, but to these at homepages of individuals, institutions, and organizations, in excerpts, homework of high school and college students, examination schedules and exam papers, self-presentations, advertising and advertisements, etc. without any type of quality control. Therefore, citation success according to <italic>Google Scholar</italic> can be manipulated very easily and, therefore, can be considered poor and not very useful for scientometrics (see, e.g., Aguillo <xref ref-type="bibr" rid="CR1">2012</xref>; Beel and Gipp <xref ref-type="bibr" rid="CR4">2010</xref>; Mayr and Walter <xref ref-type="bibr" rid="CR19">2007</xref>; Mingers and Lipitakis <xref ref-type="bibr" rid="CR21">2010</xref>; for a recent discussion of the weaknesses of <italic>Google Scholar</italic> and its comparison with the <italic>WoS</italic> see, e.g., de Winter et al. <xref ref-type="bibr" rid="CR9">2014</xref>). In addition, there are huge problems with homonyms and identical or similar titles of publications. Somewhat in between of the high selective, restrictive <italic>WoS</italic> and the not selective, but complete open <italic>Google Scholar</italic> without any professional specialist quality control and scientific quality management are databases like <italic>Ovid</italic>, which are dominated by publishers and/or database providers because they tend to selectively include primarily their “own” products (see, e.g., Larsen and von Ins <xref ref-type="bibr" rid="CR18">2010</xref>; Mingers and Lipitakis <xref ref-type="bibr" rid="CR21">2010</xref>). Thus, the argument is that these are selective, or bad quality or publisher controlled databases but yet no complete, open, quality databases.</p><p>Therefore, for more profound and serious citation analyses we need databases that cover all types and genres of scientific and scholarly publications including their complete reference lists. Because of a better manageable population of scientists and their publications it is more feasible to work first of all with local and disciplinary databases, which may be merged or combined to international multidimensional databases subsequently. Citation analyses, which refer to such exhaustive databases, can show what proportions of publication output are neglected in citation analyses, which refer to the multidimensional, international databases (as the <italic>WoS, Scopus,</italic> etc.; see, e.g., Hicks <xref ref-type="bibr" rid="CR13">2005</xref>, on publication types; Chi <xref ref-type="bibr" rid="CR8">2014</xref>, on publication languages). Furthermore, it can be expected that the results of such citation analyses will have better acceptance not only by the evaluators but also and especially by the evaluated scientists, that is, by the scientific community.</p><p>Since the publication year 2009, PSYNDEX, the database of psychology publications from Austria, Germany, Liechtenstein, and the German-speaking regions of Luxemburg and Switzerland published either in German or in English language, includes the complete reference lists of publications documented. Thus, PSYNDEX is a local disciplinary database for psychology and its neighbouring disciplines. Access to PSYNDEX is provided, e.g., by the platforms Ovid and Ebsco as well as <ext-link ext-link-type="uri" xlink:href="http://www.zpid.de">www.zpid.de</ext-link>, open access is possible for individual users in PubPsych (<ext-link ext-link-type="uri" xlink:href="http://www.zpid.de/index.php?wahl=products&uwahl=pubpsych">http://www.zpid.de/index.php?wahl=products&uwahl=pubpsych</ext-link>).</p><p>PSYNDEX is a domain-specific literature database which covers the scientific literature of a discipline better than citation databases such as the multidisciplinary <italic>WoS</italic> (coverage ≤20 % of the PSYNDEX-documents in the WoS; see, e.g., Krampen <xref ref-type="bibr" rid="CR16">2009</xref>), for which Larsen and von Ins (<xref ref-type="bibr" rid="CR18">2010</xref>) report in addition a general decline in coverage of scientific publications. A special feature of PSYNDEX is its completeness for the psychology publication output of its defined area, that is, the German-speaking countries of the world, which have sometimes been called the “D–A–CH–L–L” countries (D = Germany, A = Austria, CH = Switzerland, L = Luxembourg, L = Liechtenstein). Thus, the following scientometric analyses refer to all the references that are cited in the psychology publications documented in PSYNDEX for the publication years 2009, 2010, and 2011. Analyses are conducted separately for the references cited in the publications documented in PSYNDEX with the publication year (1) 2009, (2) 2010, and (3) 2011. This has the advantage that cross-sectional time comparisons are possible thus allowing conclusions to be made on the stability of the results.</p><p>Main objective of our scientometric study is to analyse the frequencies by which different publication types and publication genres are cited. Because this question can not be answered up to now by the use of multidisciplinary international databases (focus at journals, neglect or even ignorance of book chapters, books, test manuals, etc.), we conduct a case study with the local disciplinary databases PSYNDEX. The <italic>first research question</italic> refers to (1) the frequencies of different publication types (i.e., journal articles, books, book chapters) to which reference is given by citations in the publications of the years 2009, 2010, and 2011. The <italic>second research question</italic> refers to (2) the replication of the first analysis; however, data refer only to the cited references in publications from the German-speaking countries that are also documented in PSYNDEX (11 % of all cited references) and whose PSYNDEX documentation contains meta-data about the publication genre and on the psychological sub-discipline to which they belong. The <italic>third research question</italic> refers to (3) the characteristics of the most frequently cited references in the psychology publications from the German speaking countries published in 2009, 2010, and 2011. These top-cited references are analysed with the help of PSYNDEX meta-data for the relative frequencies of (3a) different document types, i.e., journal articles, books, chapters, (3b) different scientific publication genres, i.e., empirical and non-empirical publications, and (3c) different psychological sub-disciplines following the classification codes (CC) of the <italic>Thesaurus of Psychological Index Terms</italic> of the <italic>American Psychological Association</italic> (APA; Gallagher Tuleya <xref ref-type="bibr" rid="CR10">2007</xref>), i.e., methodology, basic psychology, and applied psychology, etc. In addition, the citation success over time of the top-cited publications (see, e.g., Johnston et al. <xref ref-type="bibr" rid="CR14">2013</xref>) is briefly described.</p></sec><sec id="Sec2" sec-type="methods"><title>Methods</title><p>For the scientometric analysis, we use the raw frequencies of the documents included in PSYNDEX published in 2009, 2010, and 2011. PSYNDEX includes 7358 documents with reference lists published in 2009, 8484 documents published in 2010, and 8059 documents published in 2011. For the citation analysis, we use the reference lists of these documents, which sum up to 402,830 references cited in 2009, 426,014 references cited in 2010, and 475,935 references cited in 2011. PSYNDEX and PubPsych documents include various meta-data (e.g., full bibliographic specification, publication type, controlled method, abstract, descriptors, classification categories, etc.; Gallagher Tuleya <xref ref-type="bibr" rid="CR10">2007</xref>; ZPID <xref ref-type="bibr" rid="CR26">2011</xref>) and the complete reference lists of publications documented.</p></sec><sec id="Sec3" sec-type="results"><title>Results</title><sec id="Sec4"><title>Number and publication types of all the references cited</title><p>Mean number of references cited per publication is <italic>M</italic> = 54.7 in 2009, <italic>M</italic> = 50.2 in 2010, and <italic>M</italic> = 59.0 in 2011; all average values with very large ranges reaching from zero to several thousands references cited in one publication. The very long references lists are typical for textbooks and handbooks as well as—at least partially—for dissertation theses and some monographs.</p><p>The distributions of the references cited in the 2009, the 2010, and the 2011 publications across different document/publication types (DT) are reported in the upper part of Table <xref rid="Tab1" ref-type="table">1</xref>. Absolute and relative frequencies show that approximately 60 % of the references cited are journal articles, around 23 % are books, and 15 % are book chapters. The rest of the “other” references cited could not be automatically identified because information such as title of publication, journal title, editors, and/or page numbers is missing. Results point to a rather time-stable pattern of this distribution across different publication types and to the fact that citation analyses, which concentrate on journal articles, neglect citations of approximately 40 % of the scientific and scholarly publication output in psychology, i.e., all citations of books, book chapters, test manuals, etc. This result shows that recent psychology is definitely neither a “journal science” (alike the natural sciences) nor a “book science” (alike the humanities and social sciences; see, e.g., Wray and Bornmann <xref ref-type="bibr" rid="CR25">2015</xref>), but just in between of these two scientific publication cultures.<table-wrap id="Tab1"><label>Table 1</label><caption><p>Document type (DT) of cited references in the psychology publications from the German-speaking countries published in 2009, 2010, and 2011</p></caption><table frame="hsides" rules="groups"><thead><tr><th align="left" rowspan="3">Document type (DT) of the cited references</th><th align="left" colspan="6">Number (N) and publication year (PY) of the citing publications</th></tr><tr><th align="left" colspan="2"><italic>N</italic> = 7758 in 2009</th><th align="left" colspan="2"><italic>N</italic> = 8484 in 2010</th><th align="left" colspan="2"><italic>N</italic> = 8059 in 2011</th></tr><tr><th align="left"><italic>f</italic></th><th align="left">%</th><th align="left"><italic>f</italic></th><th align="left">%</th><th align="left"><italic>f</italic></th><th align="left">%</th></tr></thead><tbody><tr><td align="left">All cited references</td><td char="." align="char" colspan="2">402,830</td><td char="." align="char" colspan="2">426,014</td><td char="." align="char" colspan="2">475,935</td></tr><tr><td align="left"> Journal articles</td><td char="." align="char">230,923</td><td char="." align="char">57.3</td><td char="." align="char">258,724</td><td char="." align="char">60.7</td><td char="." align="char">290,783</td><td char="." align="char">61.1</td></tr><tr><td align="left"> Books</td><td char="." align="char">97,402</td><td char="." align="char">24.2</td><td char="." align="char">94,377</td><td char="." align="char">22.2</td><td char="." align="char">103,644</td><td char="." align="char">21.8</td></tr><tr><td align="left"> Book chapters</td><td char="." align="char">62,225</td><td char="." align="char">15.4</td><td char="." align="char">60,634</td><td char="." align="char">14.2</td><td char="." align="char">67,397</td><td char="." align="char">14.2</td></tr><tr><td align="left"> Other<sup>a</sup></td><td char="." align="char">12,280</td><td char="." align="char">3.1</td><td char="." align="char">12,279</td><td char="." align="char">2.9</td><td char="." align="char">14,111</td><td char="." align="char">2.9</td></tr><tr><td align="left">Number of cited references from the German-speaking countries, that are documented in PSYNDEX</td><td char="." align="char">46,819</td><td char="." align="char">11.6<sup>b</sup></td><td char="." align="char">46,179</td><td char="." align="char">10.8<sup>b</sup></td><td char="." align="char">53,627</td><td char="." align="char">11.3<sup>b</sup></td></tr><tr><td align="left"> Journal articles</td><td char="." align="char">27,061</td><td char="." align="char">57.8</td><td char="." align="char">28,008</td><td char="." align="char">60.7</td><td char="." align="char">33,246</td><td char="." align="char">62.0</td></tr><tr><td align="left"> Books</td><td char="." align="char">10,020</td><td char="." align="char">21.4</td><td char="." align="char">9007</td><td char="." align="char">19.5</td><td char="." align="char">9861</td><td char="." align="char">18.4</td></tr><tr><td align="left"> Book chapters</td><td char="." align="char">8488</td><td char="." align="char">18.1</td><td char="." align="char">7980</td><td char="." align="char">17.3</td><td char="." align="char">9171</td><td char="." align="char">17.1</td></tr><tr><td align="left"> Other<sup>c</sup></td><td char="." align="char">1250</td><td char="." align="char">2.7</td><td char="." align="char">1184</td><td char="." align="char">2.5</td><td char="." align="char">1349</td><td char="." align="char">2.5</td></tr></tbody></table><table-wrap-foot><p><sup>a</sup>DT not automatically identifiable by search routine</p><p><sup>b</sup>Percentage (%) of all cited references (see above, first line of Table)</p><p><sup>c</sup>Institutional reports, audio-visual media, addenda, dissertations</p></table-wrap-foot></table-wrap></p></sec><sec id="Sec5"><title>Number and publication types of the references cited and documented in PSYNDEX</title><p>The subsets of references cited from the German-speaking countries, which are also documented in PSYNDEX, are presented in the lower part of Table <xref rid="Tab1" ref-type="table">1</xref>. These compose approximately 11 % of all cited references (for the percentages per publication year see Table <xref rid="Tab1" ref-type="table">1</xref>). This result reveals that nearly 90 % of the references cited in publications documented in PSYNDEX are international and/or interdisciplinary publications not originating from the German-speaking countries (because they are not documented in PSYNDEX).</p><p>Specifically, the proportions of journal articles (around 60 %), books (around 20 %), and book chapters (around 17 %) in these subsets are very similar to the percentages identified for all references that are cited (see above and contrast the upper and the lower parts of Table <xref rid="Tab1" ref-type="table">1</xref>). We can conclude that these subsets of cited references are representative for all references cited with reference to their distribution across different publication types. Therefore, we can use the subsets for more detailed scientometric analyses with the help of meta-data available in the PSYNDEX documents. We can even use the percentages of the cited references categorized as “other” for further scientometric analysis, because they can be identified with the help of PSYNDEX meta-data as citations of institutional reports, audio-visual media, addenda, and dissertations.</p></sec><sec id="Sec6"><title>Features of the top-cited references in 2009, 2010, and 2011 publications</title><p>We use the frequency <italic>f</italic> > 14 citations per publication year as definition of top-cited references because the commonly used top-100 references definition led to an inflation of bounded rank positions. The <italic>f</italic> > 14 criteria led to the top-65 cited references in the publication year PY = 2009, the top-61 cited references in PY = 2010, and the top-93 cited references in PY = 2011. The rise of the number can not be explained by the growth of the publication sets in the PY, because it is random and—therefore—can not be the explanation for the slight differences in the cited time window reported in the next paragraph. Since also the popular top-100-criteria is somewhat arbitrary and proved (because of an inflation of bounded rank positions) not to be very selective, we think the <italic>f</italic> > 14 criterion is justifiable in an exploratory approximation.</p><sec id="Sec7"><title>Time window of top-cited references in 2009, 2010, and 2011 publications</title><p>The frequency distributions across the publication years of the most frequently cited references in psychology publications from the German-speaking countries in 2009, 2010, and 2011 are graphically presented in Fig. <xref rid="Fig1" ref-type="fig">1</xref>. All three frequency distributions are skewed to the left, which points to the result that recent publications dominate the reference lists. Oldest references cited go back to the late 1970s to the late 1980s. In comparison with the humanities this indicates a rather weak historical citation pattern and in comparison to the natural sciences, however, a quite long time window—at least within the top-cited references in psychology.<fig id="Fig1"><label>Fig. 1</label><caption><p>Publication years of the most frequency cited references (<italic>f</italic> > 14) in psychology publication from the German-speaking countries in 2009, 2010, and 2011</p></caption><graphic xlink:href="11192_2015_1573_Fig1_HTML" id="MO1"></graphic></fig></p><p>Most top-cited references in the 2009 publications stem from a rather narrow time frame of only 4 years (2001–2005; see Fig. <xref rid="Fig1" ref-type="fig">1</xref>). The time frame becomes somewhat broader for the top cited references in the 2010 publications (6 years from 2001 to 2006) and in the 2011 publications (9 years from 1999 to 2007), but remains rather limited to recent publications of <10 years before the publication. With the exception of a slight trend to more recently published references ranging from about 2 years prior to or even in the year of the publication of the citing paper in the publication year 2011, these results are rather stable over time. Overall, the results are in good agreement with the descriptions of a narrow time frame (6–7 years) for the references cited that was verified by Johnston et al. (<xref ref-type="bibr" rid="CR14">2013</xref>) for other sciences than psychology.</p></sec><sec id="Sec8"><title>Publication type and publication genre of top-cited references in 2009, 2010, and 2011 publications</title><p>The distributions across different publication types and across different publication genres of the most frequently cited references in psychology publications from the German-speaking countries in 2009, 2010, and 2011 are presented in Table <xref rid="Tab2" ref-type="table">2</xref>. Within the top-cited references in all three publication years analysed here, the frequencies of the <italic>publication/document types</italic> (<italic>DT</italic>) of books and book chapters on the one side and journal articles on the other side are represented very similarly (see Table <xref rid="Tab2" ref-type="table">2</xref>, upper part). On average, the proportion is 50:50 with only a slight trend in favour of journal articles in the 2010 and 2011 publications. With reference to the recent debate in the psychology research community in the German-speaking and other non-English-speaking countries (for a summary, see, e.g., Bornmann et al. <xref ref-type="bibr" rid="CR5">2012</xref> or Krampen <xref ref-type="bibr" rid="CR16">2009</xref>; see in addition, e.g., González-Alcaide et al. <xref ref-type="bibr" rid="CR12">2012</xref>), it is of interest that the number of English-language journal articles that are the top cited markedly exceeds the number of German-language journal articles that are top cited (from all the German-speaking countries).<table-wrap id="Tab2"><label>Table 2</label><caption><p>Document type (DT) and scientific genre (controlled method, CM) of the most frequently cited references (<italic>f</italic> > 14 citations) in the psychology publications from the German-speaking countries published in 2009, 2010, and 2011</p></caption><table frame="hsides" rules="groups"><thead><tr><th align="left" rowspan="3">Characteristics of the most frequently cited references</th><th align="left" colspan="6">Most frequently cited references (<italic>f</italic> > 14) in psychology publications from the German-speaking countries in the publication years (PY)</th></tr><tr><th align="left" colspan="2">PY = 2009<sup>a</sup></th><th align="left" colspan="2">PY = 2010<sup>b</sup></th><th align="left" colspan="2">PY = 2011<sup>c</sup></th></tr><tr><th align="left"><italic>f</italic></th><th align="left">%</th><th align="left"><italic>f</italic></th><th align="left">%</th><th align="left"><italic>f</italic></th><th align="left">%</th></tr></thead><tbody><tr><td align="left" colspan="7">Document type (DT)</td></tr><tr><td align="left"> Books (all German-language)</td><td char="." align="char">26</td><td char="." align="char">40</td><td char="." align="char">21</td><td char="." align="char">34</td><td char="." align="char">30</td><td char="." align="char">32</td></tr><tr><td align="left"> Editions (all German-language)</td><td char="." align="char">4</td><td char="." align="char">6</td><td char="." align="char">1</td><td char="." align="char">2</td><td char="." align="char">0</td><td char="." align="char">0</td></tr><tr><td align="left"> English-language chapters</td><td char="." align="char">2</td><td char="." align="char">3</td><td char="." align="char">4</td><td char="." align="char">7</td><td char="." align="char">5</td><td char="." align="char">5</td></tr><tr><td align="left"> German-language chapters</td><td char="." align="char">2</td><td char="." align="char">3</td><td char="." align="char">2</td><td char="." align="char">3</td><td char="." align="char">3</td><td char="." align="char">3</td></tr><tr><td align="left">Σ books and book chapters</td><td align="left"></td><td char="." align="char">52</td><td align="left"></td><td char="." align="char">46</td><td align="left"></td><td char="." align="char">41</td></tr><tr><td align="left"> English-language journal articles</td><td char="." align="char">22</td><td char="." align="char">34</td><td char="." align="char">26</td><td char="." align="char">43</td><td char="." align="char">42</td><td char="." align="char">45</td></tr><tr><td align="left"> German-language journal articles</td><td char="." align="char">9</td><td char="." align="char">14</td><td char="." align="char">7</td><td char="." align="char">11</td><td char="." align="char">13</td><td char="." align="char">14</td></tr><tr><td align="left">Σ journal articles</td><td align="left"></td><td char="." align="char">48</td><td align="left"></td><td char="." align="char">54</td><td align="left"></td><td char="." align="char">59</td></tr><tr><td align="left">Scientific genre/controlled method (CM)</td><td align="left"></td><td align="left"></td><td align="left"></td><td align="left"></td><td align="left"></td><td align="left"></td></tr><tr><td align="left"> Textbooks/handbooks</td><td char="." align="char">14</td><td char="." align="char">22</td><td char="." align="char">9</td><td char="." align="char">15</td><td char="." align="char">15</td><td char="." align="char">16</td></tr><tr><td align="left"> Test manuals</td><td char="." align="char">2</td><td char="." align="char">3</td><td char="." align="char">2</td><td char="." align="char">3</td><td char="." align="char">4</td><td char="." align="char">4</td></tr><tr><td align="left"> Intervention (therapy) manuals</td><td char="." align="char">5</td><td char="." align="char">8</td><td char="." align="char">3</td><td char="." align="char">5</td><td char="." align="char">3</td><td char="." align="char">3</td></tr><tr><td align="left"> Literature overviews/reviews</td><td char="." align="char">17</td><td char="." align="char">26</td><td char="." align="char">17</td><td char="." align="char">28</td><td char="." align="char">28</td><td char="." align="char">30</td></tr><tr><td align="left"> Theoretical studies</td><td char="." align="char">6</td><td char="." align="char">9</td><td char="." align="char">7</td><td char="." align="char">11</td><td char="." align="char">10</td><td char="." align="char">11</td></tr><tr><td align="left">Σ non-empirical publications</td><td align="left"></td><td char="." align="char">68</td><td align="left"></td><td char="." align="char">62</td><td align="left"></td><td char="." align="char">65</td></tr><tr><td align="left"> Methodological studies</td><td char="." align="char">3</td><td char="." align="char">5</td><td char="." align="char">4</td><td char="." align="char">7</td><td char="." align="char">6</td><td char="." align="char">6</td></tr><tr><td align="left"> Empirical (field) studies</td><td char="." align="char">10</td><td char="." align="char">15</td><td char="." align="char">12</td><td char="." align="char">20</td><td char="." align="char">15</td><td char="." align="char">16</td></tr><tr><td align="left"> Experimental studies</td><td char="." align="char">4</td><td char="." align="char">6</td><td char="." align="char">4</td><td char="." align="char">7</td><td char="." align="char">10</td><td char="." align="char">11</td></tr><tr><td align="left"> Meta-analyses</td><td char="." align="char">4</td><td char="." align="char">6</td><td char="." align="char">3</td><td char="." align="char">5</td><td char="." align="char">2</td><td char="." align="char">2</td></tr><tr><td align="left">Σ empirical publications</td><td align="left"></td><td char="." align="char">32</td><td align="left"></td><td char="." align="char">38</td><td align="left"></td><td char="." align="char">35</td></tr></tbody></table><table-wrap-foot><p><sup>a</sup><italic>N</italic> = 65 most frequently cited references (<italic>f</italic> > 14 citations) in publications of 2009</p><p><sup>b</sup><italic>N</italic> = 61 most frequently cited references (<italic>f</italic> > 14 citations) in publications of 2010</p><p><sup>c</sup><italic>N</italic> = 93 most frequently cited references (<italic>f</italic> > 14 citations) in publications of 2011</p></table-wrap-foot></table-wrap></p><p>The distribution of the top-cited references across <italic>different publication genres</italic> (i.e., controlled method, CM, according to the APA Thesaurus of Psychological Index Terms; Gallagher Tuleya <xref ref-type="bibr" rid="CR10">2007</xref>) is presented in the lower part of Table <xref rid="Tab2" ref-type="table">2</xref>. A very consistent finding across the three publication years under study is that the non-empirical publications dominate in the top-cited references with an average proportion of 66 %, that is, two-thirds. Most represented genres are literature reviews, overview as well as handbooks and textbooks, and somewhat less in focus are theoretical studies and manuals. Empirical publications compose one-third of the top-cited references with empirical (field) studies (i.e., correlation studies, questionnaire studies, pre-experimental studies, etc.) at the top of this list. A striking result is that experimental studies are equally seldom found in the top-cited references as methodological studies and meta-analyses (see Table <xref rid="Tab2" ref-type="table">2</xref>).</p></sec><sec id="Sec9"><title>Psychological sub-disciplines of top-cited references in 2009, 2010, and 2011 publications</title><p>The distributions across the different psychological sub-disciplines (<italic>Classification Codes,</italic> CC, in the APA-<italic>Thesaurus of Psychological Index</italic> Terms; Gallagher Tuleya <xref ref-type="bibr" rid="CR10">2007</xref>; ZPID <xref ref-type="bibr" rid="CR26">2011</xref>) of the most frequently cited references in the psychology publications from the German-speaking countries published in 2009, 2010, and 2011 are presented in Table <xref rid="Tab3" ref-type="table">3</xref>. The results show that top-cited references particularly stem from and belong to the comparable larger research domains of clinical psychology and experimental psychology with more personnel and research funding resources as well as more publication media than other psychological sub-disciplines.<table-wrap id="Tab3"><label>Table 3</label><caption><p>Psychological subdiscipline (classification category, CC) of the most frequently cited references (<italic>f</italic> > 14 citations) in the psychology publications from the German-speaking countries published in 2009, 2010, and 2011</p></caption><table frame="hsides" rules="groups"><thead><tr><th align="left" rowspan="3">Classification category of the most frequently cited references (CC)<sup>d</sup></th><th align="left" colspan="6">Most frequently cited references (<italic>f</italic> > 14) in psychology publications from the German-speaking countries in the publication years (PY)</th></tr><tr><th align="left" colspan="2">PY = 2009<sup>a</sup></th><th align="left" colspan="2">PY = 2010<sup>b</sup></th><th align="left" colspan="2">PY = 2011<sup>c</sup></th></tr><tr><th align="left"><italic>f</italic></th><th align="left">%</th><th align="left"><italic>f</italic></th><th align="left">%</th><th align="left"><italic>f</italic></th><th align="left">%</th></tr></thead><tbody><tr><td align="left">Tests and testing, psychometrics</td><td char="." align="char">10</td><td char="." align="char">15</td><td char="." align="char">8</td><td char="." align="char">13</td><td char="." align="char">12</td><td char="." align="char">13</td></tr><tr><td align="left">Statistics and mathematics</td><td char="." align="char">2</td><td char="." align="char">3</td><td char="." align="char">4</td><td char="." align="char">7</td><td char="." align="char">5</td><td char="." align="char">5</td></tr><tr><td align="left">Research methods and experimental design</td><td char="." align="char">4</td><td char="." align="char">6</td><td char="." align="char">2</td><td char="." align="char">3</td><td char="." align="char">4</td><td char="." align="char">4</td></tr><tr><td align="left">Σ Methodology</td><td align="left"></td><td char="." align="char">25</td><td align="left"></td><td char="." align="char">23</td><td align="left"></td><td char="." align="char">22</td></tr><tr><td align="left"> Human experimental psychology</td><td char="." align="char">11</td><td char="." align="char">17</td><td char="." align="char">11</td><td char="." align="char">18</td><td char="." align="char">18</td><td char="." align="char">19</td></tr><tr><td align="left"> Physiological psychology and neuroscience</td><td char="." align="char">2</td><td char="." align="char">3</td><td char="." align="char">1</td><td char="." align="char">1</td><td char="." align="char">8</td><td char="." align="char">9</td></tr><tr><td align="left"> Developmental psychology</td><td char="." align="char">6</td><td char="." align="char">9</td><td char="." align="char">4</td><td char="." align="char">7</td><td char="." align="char">6</td><td char="." align="char">6</td></tr><tr><td align="left"> Social psychology</td><td char="." align="char">1</td><td char="." align="char">1</td><td char="." align="char">2</td><td char="." align="char">3</td><td char="." align="char">3</td><td char="." align="char">3</td></tr><tr><td align="left"> Personality psychology</td><td char="." align="char">1</td><td char="." align="char">2</td><td char="." align="char">2</td><td char="." align="char">3</td><td char="." align="char">2</td><td char="." align="char">2</td></tr><tr><td align="left">Σ Basic psychology</td><td align="left"></td><td char="." align="char">32</td><td align="left"></td><td char="." align="char">32</td><td align="left"></td><td char="." align="char">39</td></tr><tr><td align="left"> Clinical psychology</td><td char="." align="char">22</td><td char="." align="char">34</td><td char="." align="char">20</td><td char="." align="char">33</td><td char="." align="char">25</td><td char="." align="char">27</td></tr><tr><td align="left"> Educational psychology</td><td char="." align="char">1</td><td char="." align="char">2</td><td char="." align="char">4</td><td char="." align="char">7</td><td char="." align="char">2</td><td char="." align="char">2</td></tr><tr><td align="left"> Industrial and organizational psychology</td><td char="." align="char">2</td><td char="." align="char">3</td><td char="." align="char">3</td><td char="." align="char">5</td><td char="." align="char">7</td><td char="." align="char">8</td></tr><tr><td align="left">Σ (Larger) applied psychologies</td><td align="left"></td><td char="." align="char">39</td><td align="left"></td><td char="." align="char">45</td><td align="left"></td><td char="." align="char">37</td></tr><tr><td align="left">Various CC</td><td align="left"></td><td align="left"></td><td align="left"></td><td align="left"></td><td align="left"></td><td align="left"></td></tr><tr><td align="left"> History and systems</td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td></tr><tr><td align="left"> Psychology and the humanities</td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td></tr><tr><td align="left"> Communication systems</td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td></tr><tr><td align="left"> Social processes and social issues</td><td char="." align="char">3</td><td char="." align="char">5</td><td char="." align="char">0</td><td char="." align="char">0</td><td char="." align="char">1</td><td char="." align="char">1</td></tr><tr><td align="left"> Animal (…) psychology</td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td></tr><tr><td align="left">(Specific) applied psychologies</td><td align="left"></td><td align="left"></td><td align="left"></td><td align="left"></td><td align="left"></td><td align="left"></td></tr><tr><td align="left"> Sport psychology and leisure</td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td></tr><tr><td align="left"> Military psychology</td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td></tr><tr><td align="left"> Consumer psychology</td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td></tr><tr><td align="left"> Engineering and environmental psychology</td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td></tr><tr><td align="left"> Intelligent systems</td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td></tr><tr><td align="left"> Forensic psychology and legal issues</td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td><td char="." align="char">0</td><td align="left"></td></tr></tbody></table><table-wrap-foot><p><sup>a</sup><italic>N</italic> = 65 most frequently cited references (<italic>f</italic> > 14 citations) in publications of 2009</p><p><sup>b</sup><italic>N</italic> = 61 most frequently cited references (<italic>f</italic> > 14 citations) in publications of 2010</p><p><sup>c</sup><italic>N</italic> = 93 most frequently cited references (<italic>f</italic> > 14 citations) in publications of 2011</p><p><sup>d</sup>Classification categories (CC) according to the <italic>APA thesaurus of psychological index terms</italic></p></table-wrap-foot></table-wrap></p><p>At first glance this result seems to be rather trivial. However, it must be noted that the proportions of experimental psychology publications as well as publications on tests, testing, psychometrics, and test development in the top-cited references are higher than is expected with reference to the complete relative publication output of these sub-disciplines: For example, the expected proportion (<italic>p</italic><sub>e</sub>) of all experimental psychology publications documented in PSYNDEX is <italic>p</italic><sub>e</sub> = 10.4 %, their observed proportion (<italic>p</italic><sub><italic>o</italic></sub>) in the top-cited references is <italic>mean p</italic><sub>o</sub> = 18.0 % (see Table <xref rid="Tab3" ref-type="table">3</xref>). With reference to the complete PSYNDEX database, the expectancy value for publications on tests and psychometrics is <italic>p</italic><sub>e</sub> = 5.5 %, their observed proportion in the top-cited is around <italic>mean p</italic><sub>o</sub> = 14.0 %. At a lower level this is similar for psychology publications on statistics and mathematics (<italic>p</italic><sub>e</sub> = 1.3 %; <italic>mean p</italic><sub>o</sub> = 5.0 %). Thus, in comparison to the publication output of experimental psychology, of research on tests and psychometrics as well as of psychology publications on statistics and mathematics, these sub-disciplines are visibly overrepresented in the top-cited references.</p><p>Contrary to these results for publications on experimental psychology, tests and psychometrics as well as on statistics and mathematics are the relations between the expected and in the top-cited observed relative frequencies for publications on clinical psychology (<italic>p</italic><sub>e</sub> = 46 %; <italic>mean p</italic><sub>o</sub> = 31 %), educational psychology (<italic>p</italic><sub>e</sub> = 9 %; <italic>mean p</italic><sub>o</sub> = 4 %), industrial and organizational psychology (<italic>p</italic><sub>e</sub> = 8 %; <italic>mean p</italic><sub>o</sub> = 5 %), personality psychology (<italic>p</italic><sub>e</sub> = 6 %; <italic>mean p</italic><sub>o</sub> = 2 %) as well as on social processes and social issues (<italic>p</italic><sub>e</sub> = 13 %; <italic>mean p</italic><sub>o</sub> = 2 %). Thus, in comparison to their publication output, publications on these psychological sub-disciplines are markedly underrepresented in the top-cited reference lists. For completion, it is reported that the relations between expected relative frequencies and the observed relative frequencies in the top-cited reference lists are balanced for publications on research methods and experimental design, physiological psychology and neuroscience, developmental psychology as well as social psychology (see Table <xref rid="Tab3" ref-type="table">3</xref>). All other classification categories (CC) are not represented in the top-cited reference lists (see lower part of Table <xref rid="Tab3" ref-type="table">3</xref>); however, their portions of the complete publication output documented in PSYNDEX are rather small.</p><p>Last, but not the least, it should be noted that—summed up—the applied psychological sub-disciplines possess the highest proportions at the top-cited references (<italic>mean p</italic><sub>o</sub> = 40 %); nevertheless, this is less than is expected according to their proportions of the complete publication output (<italic>p</italic><sub>e</sub> = 63 %). The basic psychological sub-disciplines are ranked second (<italic>mean p</italic><sub>o</sub> = 34 %) and publications on methodology are ranked third (<italic>mean p</italic><sub>o</sub> = 23 %) in the top-cited references. Thereby, it must be considered that psychology publications dealing with the applied sub-disciplines and at least some of the basic sub-disciplines (e.g., developmental psychology and social psychology) are of special relevance in the education and training of many other professionals (e.g., teacher education students and teachers, medical personnel, management and marketing personnel, etc.). Thus, the publication output is rather high (and especially higher than the output of psychology publications on methodology, which are of primary interest for psychologists), but these publications are less cited in psychology publications because they address other target groups.</p></sec></sec></sec><sec id="Sec10"><title>Discussion and conclusions</title><p>The results of the present case study confirm serious deficits in citation analyses, which refer exclusively to selective databases including only journal articles, only publications of certain publishers or publishing groups or—at the other extreme—everything that can be detected on the World Wide Web. Our data refer to all the references cited in the scientific and scholarly psychology publications that are documented in PSYNDEX, the local disciplinary database of psychology publications from Austria, Germany, Liechtenstein, and the German-speaking regions of Luxemburg and Switzerland, in either the German or English language. With reference to all of the more than 1,303,000 cited references, the proportion of cited journal articles ranges from 57 to 61 %, of cited books from 22 to 24 %, and of cited book chapters from 14 to 15 %, with a rather high stability across the three different publication years analysed. Thus, evaluations of scientists and sciences, which rely solely or primarily journal articles including citation databases (like the <italic>Web of Science</italic> or <italic>Scopus</italic>), neglect at least about 40 % of the scientific and scholarly publications and result in extremely biased scientometric results that are unfair for individual scientists, scientific teams, departments, institutions, and nations.</p><p>It is noteworthy to see that about 90 % of all references in the German- and English-language publications from the German-speaking countries stem <italic>not</italic> from the German-speaking countries, but rather from the Anglo-American (most of them) or other countries. Thus, psychology in the D–A–CH–L–L states is a very strongly international oriented working and publishing research community. This scientometric result conforms to these on an increasing international collaboration (Kliegl and Bates <xref ref-type="bibr" rid="CR15">2011</xref>) and on the strong increase of English-language journal-publications in psychology in the German-speaking countries (Krampen et al. <xref ref-type="bibr" rid="CR17">2005</xref>; Michels and Schmoch <xref ref-type="bibr" rid="CR20">2014</xref>).</p><p>More detailed scientometric analyses were possible for the subset of references that are cited <italic>and</italic> are documented in PSYNDEX with their meta-data as well. This subset constitutes about 11 % of all cited references. The proportions of citations of journal articles, books, and chapters in this subset are very similar to the percentages identified for all references that are cited. Thus, this subset samples the complete references that are cited in a representative form.</p><p>A frequency of <italic>f</italic> > 14 citations per publication year turned out to be the best indicator for the most frequently cited top references in the three consecutive publication years under study. This criteria leads to top-65 cited references in the publication year PY = 2009, top-61 cited references in PY = 2010, and top-93 cited references in PY = 2011. Descriptive analyses of the frequency distributions across the publication years of these top-cited references resulted in graphs that are skewed to the right. This skewness reveals that recent publications dominate the reference lists. This result confirms the scientometric results of Bornmann et al. (<xref ref-type="bibr" rid="CR6">2014</xref>) that the years shortly after publication are most significant for the later total citation impact of a publication.</p><p>The oldest cited references go back to the late 1970s, indicating in comparison with the humanities and social sciences a rather weak historical citation pattern—at least within the top-cited references. Most of the top-cited references in the publications stem from a rather narrow time frame of only 4–9 preceding years, with a slight trend toward citing more references published in the prior 2 years or even in the publication year of the citing paper in the publication year 2011. The result shows that in psychology the first years after publication are the decisive ones whether an article will be highly cited or not. Johnston et al. (<xref ref-type="bibr" rid="CR14">2013</xref>) found similar patterns for top economic journals (6–7 years), hence psychology and economy seem to be similar in this regard.</p><p>Citation analyses with reference to a more detailed document type, to the scientific genre, and to the psychological sub-disciplines of the most frequently cited references in the psychology publications from the German-speaking countries published in 2009, 2010, and 2011 were possible with the help of the meta-data available in PSYNDEX. Regarding frequency, books and book chapters are represented almost as equally in the top-cited references as journal articles. Two-thirds of the top-cited references are not empirical publications (most frequently these are literature overviews/reviews and handbooks/textbooks); only one-third are empirical publications (mainly empirical field studies). This result on the publication success of different publication genres in psychology differs from that presented by Johnston et al. (<xref ref-type="bibr" rid="CR14">2013</xref>) for the publication success in economics. The results of Johnston et al. (<xref ref-type="bibr" rid="CR14">2013</xref>, p. 1023) indicate, “that empirical papers attract more citation success than theoretical studies”, a finding that is actually contrary to our scientometric results for psychology.</p><p>An a posteriori hypothesis for our results on the lower citation success of empirical publications in psychology may be the interpretation that empirical studies (in psychology) try to contribute to the solving of empirical problems or—at best—solve such a problem but nevertheless frequently conclude that “further research is needed”. This original empirical study will be cited in some (but rather few) subsequent empirical studies on the same research question, which—at best—advance the research and replace the earlier study, thus remaining only one link in a longer chain of empirical studies (perhaps with some historiographical significance), and in the reference lists of the following publications (maybe with the exceptions of some classics in empirical research). On the contrary, non-empirical publications (i.e., especially literature reviews, overviews, handbooks, and theoretical studies) describe, structure, integrate, and evaluate research in a broader problem domain where, at best, such publications identify significant topics for research, describe research deficits, and motivate (more or less) innovative research in a wider problem domain. This actually results in higher citation success, because many later publications can have direct access to the conclusions made in these non-empirical publications.</p><p>The results show that the top-cited references stem particularly from clinical psychology, experimental psychology, as well as from research on tests, testing and psychometrics. This covaries only partially with the size of the sub-disciplines’ scientific community in terms of personnel and research funding resources as well as publication media. Contrasts of the expected relative frequencies, which are computed with reference to the complete publication output of a sub-discipline and its proportion of indexed documents recorded in PSYNDEX with the observed relative frequencies in the top-cited reference lists, show that publications on clinical psychology, educational psychology, personality psychology, and research on social processes and social issues appear less frequently in the top-cited references than would be expected. This is contrary for the relative frequency of references given to publications on experimental psychology, on research on tests and psychometrics as well as on psychology publications on statistics and mathematics.</p><p>In summary, the results points to the fact that citation analyses, which are limited to journal papers, neglect very high proportions of references that are cited in scientific and scholarly publications. The same is valid for databases that concentrate on books and chapters—at least in psychology publications from the German-speaking countries. Professional—and perhaps special databases for scientific disciplines—databases with high quality control and high coverage of the publications and their complete reference lists are required for serious and reliable citation analyses, which result in fair evaluations of the citation success of scientists, research teams, institutions and nations. Such scientometric results will be accepted with a higher probability in the scientific community.</p><p>The focus on journals when using <italic>WoS</italic> or <italic>Scopus</italic> as databases for citation analysis in psychology not only misses a large part of publication output but the most important one: While books and book chapters account for 30 % percentage of the publication output in psychology, 52 % of the highly cited documents are books or book chapters. Hence, books and book chapters are still an important document type that must not be neglected. If evaluation focuses only on journal articles, most of the highly cited, i.e., important, works are not taken into account.</p></sec></body><back><ref-list id="Bib1"><title>References</title><ref id="CR1"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Aguillo</surname><given-names>IF</given-names></name></person-group><article-title>Is Google Scholar useful for bibliometrics?</article-title><source>Scientometrics</source><year>2012</year><volume>91</volume><issue>2</issue><fpage>343</fpage><lpage>351</lpage><pub-id pub-id-type="doi">10.1007/s11192-011-0582-8</pub-id></element-citation></ref><ref id="CR2"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Albarrán</surname><given-names>P</given-names></name><name><surname>Crespo</surname><given-names>JA</given-names></name><name><surname>Ortuño</surname><given-names>I</given-names></name><name><surname>Ruiz-Castillo</surname><given-names>J</given-names></name></person-group><article-title>A comparison of the scientific performance of the U.S. and the European Union at the turn of the 21st century</article-title><source>Scientometrics</source><year>2010</year><volume>85</volume><issue>1</issue><fpage>329</fpage><lpage>344</lpage><pub-id pub-id-type="doi">10.1007/s11192-010-0223-7</pub-id></element-citation></ref><ref id="CR3"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Alves</surname><given-names>AD</given-names></name><name><surname>Yanasse</surname><given-names>HH</given-names></name><name><surname>Soma</surname><given-names>NY</given-names></name></person-group><article-title>Benford’s law and articles of scientific journals: Comparison of JCR<sup>®</sup> and Scopus data</article-title><source>Scientometrics</source><year>2014</year><volume>98</volume><issue>1</issue><fpage>173</fpage><lpage>184</lpage><pub-id pub-id-type="doi">10.1007/s11192-013-1030-8</pub-id><pub-id pub-id-type="pmid">24415809</pub-id></element-citation></ref><ref id="CR4"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Beel</surname><given-names>J</given-names></name><name><surname>Gipp</surname><given-names>B</given-names></name></person-group><article-title>Academic search engine spam and Google Scholar’s resilience against it</article-title><source>Journal of Electronic Publishing</source><year>2010</year></element-citation></ref><ref id="CR5"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bornmann</surname><given-names>L</given-names></name><name><surname>Leydesdorff</surname><given-names>L</given-names></name><name><surname>Krampen</surname><given-names>G</given-names></name></person-group><article-title>Which are the “best” cities for psychology research worldwide?</article-title><source>Europe’s Journal of Psychology</source><year>2012</year><volume>8</volume><issue>4</issue><fpage>535</fpage><lpage>546</lpage></element-citation></ref><ref id="CR6"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bornmann</surname><given-names>L</given-names></name><name><surname>Leydesdorff</surname><given-names>L</given-names></name><name><surname>Wang</surname><given-names>J</given-names></name></person-group><article-title>How to improve the prediction based on citation impact percentiles for years shortly after the publication date?</article-title><source>Journal of Informetrics</source><year>2014</year><volume>8</volume><fpage>175</fpage><lpage>180</lpage><pub-id pub-id-type="doi">10.1016/j.joi.2013.11.005</pub-id></element-citation></ref><ref id="CR7"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cavacini</surname><given-names>A</given-names></name></person-group><article-title>What is the best database for computer science journal articles?</article-title><source>Scientometrics</source><year>2015</year><volume>102</volume><fpage>2059</fpage><lpage>2071</lpage><pub-id pub-id-type="doi">10.1007/s11192-014-1506-1</pub-id></element-citation></ref><ref id="CR8"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chi</surname><given-names>P-S</given-names></name></person-group><article-title>Which role do non-source items play in the social sciences? A case study in political science in Germany</article-title><source>Scientometrics</source><year>2014</year><volume>101</volume><fpage>1195</fpage><lpage>1213</lpage><pub-id pub-id-type="doi">10.1007/s11192-014-1433-1</pub-id></element-citation></ref><ref id="CR9"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>de Winter</surname><given-names>JCF</given-names></name><name><surname>Zadpoor</surname><given-names>AA</given-names></name><name><surname>Dodou</surname><given-names>D</given-names></name></person-group><article-title>The expansion of Google Scholar versus Web of Science: A longitudinal study</article-title><source>Scientometrics</source><year>2014</year><volume>98</volume><fpage>1547</fpage><lpage>1565</lpage><pub-id pub-id-type="doi">10.1007/s11192-013-1089-2</pub-id></element-citation></ref><ref id="CR10"><element-citation publication-type="book"><person-group person-group-type="editor"><name><surname>Gallagher Tuleya</surname><given-names>L</given-names></name></person-group><source>Thesaurus of psychological index terms</source><year>2007</year><edition>11</edition><publisher-loc>Washington, DC</publisher-loc><publisher-name>American Psychological Association</publisher-name></element-citation></ref><ref id="CR11"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Glänzel</surname><given-names>W</given-names></name><name><surname>Moed</surname><given-names>HF</given-names></name></person-group><article-title>Thoughts and facts on bibliometric indicators</article-title><source>Scientometrics</source><year>2013</year><volume>96</volume><fpage>381</fpage><lpage>394</lpage><pub-id pub-id-type="doi">10.1007/s11192-012-0898-z</pub-id></element-citation></ref><ref id="CR12"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>González-Alcaide</surname><given-names>G</given-names></name><name><surname>Valderrama-Zurián</surname><given-names>JC</given-names></name><name><surname>Aleixandre-Benavent</surname><given-names>R</given-names></name></person-group><article-title>The impact factor in non-English-speaking countries</article-title><source>Scientometrics</source><year>2012</year><volume>92</volume><issue>2</issue><fpage>297</fpage><lpage>311</lpage><pub-id pub-id-type="doi">10.1007/s11192-012-0692-y</pub-id></element-citation></ref><ref id="CR13"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Hicks</surname><given-names>D</given-names></name></person-group><person-group person-group-type="editor"><name><surname>Moed</surname><given-names>HF</given-names></name><name><surname>Glänzel</surname><given-names>W</given-names></name><name><surname>Schmoch</surname><given-names>U</given-names></name></person-group><article-title>The four literatures of social science</article-title><source>Handbook of quantitative science and technology research: The use of publication and patent statistics in studies of S&T systems</source><year>2005</year><publisher-loc>New York, NY</publisher-loc><publisher-name>Springer Science</publisher-name><fpage>473</fpage><lpage>496</lpage></element-citation></ref><ref id="CR14"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Johnston</surname><given-names>DW</given-names></name><name><surname>Piatti</surname><given-names>M</given-names></name><name><surname>Torgler</surname><given-names>B</given-names></name></person-group><article-title>Citation success over time: Theory or empirics?</article-title><source>Scientometrics</source><year>2013</year><volume>95</volume><issue>3</issue><fpage>1023</fpage><lpage>1029</lpage><pub-id pub-id-type="doi">10.1007/s11192-012-0910-7</pub-id></element-citation></ref><ref id="CR15"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kliegl</surname><given-names>R</given-names></name><name><surname>Bates</surname><given-names>D</given-names></name></person-group><article-title>International collaboration in psychology is on the rise</article-title><source>Scientometrics</source><year>2011</year><volume>87</volume><issue>1</issue><fpage>149</fpage><lpage>158</lpage><pub-id pub-id-type="doi">10.1007/s11192-010-0299-0</pub-id></element-citation></ref><ref id="CR16"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Krampen</surname><given-names>G</given-names></name></person-group><article-title>Introduction and some ideas as well as visions on an open access European psychology publication platform</article-title><source>Psychology Science Quarterly</source><year>2009</year><volume>51</volume><issue>Suppl. 1</issue><fpage>3</fpage><lpage>18</lpage></element-citation></ref><ref id="CR17"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Krampen</surname><given-names>G</given-names></name><name><surname>Montada</surname><given-names>L</given-names></name><name><surname>Müller</surname><given-names>MM</given-names></name><name><surname>Schui</surname><given-names>G</given-names></name></person-group><source>Internationalität und Internationalisierung der deutschsprachigen Psychologie (Internationality and internationalization of German-speaking psychology)</source><year>2005</year><publisher-loc>Göttingen</publisher-loc><publisher-name>Hogrefe</publisher-name></element-citation></ref><ref id="CR18"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Larsen</surname><given-names>PO</given-names></name><name><surname>von Ins</surname><given-names>M</given-names></name></person-group><article-title>The rate of growth in scientific publication and the decline in coverage provided by the Science Citation Index</article-title><source>Scientometrics</source><year>2010</year><volume>84</volume><issue>3</issue><fpage>575</fpage><lpage>603</lpage><pub-id pub-id-type="doi">10.1007/s11192-010-0202-z</pub-id><pub-id pub-id-type="pmid">20700371</pub-id></element-citation></ref><ref id="CR19"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mayr</surname><given-names>P</given-names></name><name><surname>Walter</surname><given-names>A-K</given-names></name></person-group><article-title>An exploratory study of Google Scholar</article-title><source>Online Information Review</source><year>2007</year><volume>31</volume><issue>6</issue><fpage>814</fpage><lpage>830</lpage><pub-id pub-id-type="doi">10.1108/14684520710841784</pub-id></element-citation></ref><ref id="CR20"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Michels</surname><given-names>C</given-names></name><name><surname>Schmoch</surname><given-names>U</given-names></name></person-group><article-title>Impact of bibliometric studies on the publication behaviour of authors</article-title><source>Scientometrics</source><year>2014</year><volume>98</volume><issue>1</issue><fpage>369</fpage><lpage>385</lpage><pub-id pub-id-type="doi">10.1007/s11192-013-1015-7</pub-id></element-citation></ref><ref id="CR21"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mingers</surname><given-names>J</given-names></name><name><surname>Lipitakis</surname><given-names>EAECG</given-names></name></person-group><article-title>Counting citations: A comparison of Web of Science and Google Scholar in the field of business and management</article-title><source>Scientometrics</source><year>2010</year><volume>85</volume><issue>2</issue><fpage>613</fpage><lpage>625</lpage><pub-id pub-id-type="doi">10.1007/s11192-010-0270-0</pub-id></element-citation></ref><ref id="CR22"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Moed</surname><given-names>HF</given-names></name><name><surname>Halevi</surname><given-names>G</given-names></name></person-group><article-title>A bibliometric approach to tracking international scientific migration</article-title><source>Scientometrics</source><year>2014</year><volume>101</volume><fpage>1987</fpage><lpage>2001</lpage><pub-id pub-id-type="doi">10.1007/s11192-014-1307-6</pub-id></element-citation></ref><ref id="CR23"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ossenblok</surname><given-names>T</given-names></name><name><surname>Engels</surname><given-names>T</given-names></name><name><surname>Sivertsen</surname><given-names>G</given-names></name></person-group><article-title>The representation of the social sciences and humanities in the Web of Science: A comparison of publication patterns and incentive structures in Flanders and Norway (2005–2009)</article-title><source>Research Evaluation</source><year>2013</year><volume>21</volume><issue>4</issue><fpage>280</fpage><lpage>290</lpage><pub-id pub-id-type="doi">10.1093/reseval/rvs019</pub-id></element-citation></ref><ref id="CR24"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Van Leeuwen</surname><given-names>T</given-names></name></person-group><article-title>Bibliometric research evaluations, Web of Science and the social scinces and humanities: A problematic relationship? <italic>Bibliometrie</italic>—<italic>Praxis und</italic></article-title><source>Forschung</source><year>2013</year><volume>2</volume><issue>8</issue><fpage>1</fpage><lpage>18</lpage></element-citation></ref><ref id="CR25"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wray</surname><given-names>KB</given-names></name><name><surname>Bornmann</surname><given-names>L</given-names></name></person-group><article-title>Philosophy of science viewed through the lense of “referenced publication years spectroscopy” (RPYS)</article-title><source>Scientometrics</source><year>2015</year><volume>102</volume><fpage>1987</fpage><lpage>1996</lpage><pub-id pub-id-type="doi">10.1007/s11192-014-1465-6</pub-id></element-citation></ref><ref id="CR26"><mixed-citation publication-type="other">ZPID - Leibniz-Zentrum für Psychologische Information und Dokumentation (Hrsg.). (2011). <italic>PSYNDEX Terms</italic> (9. Ed.), Trier/Germany: ZPID. <ext-link ext-link-type="uri" xlink:href="http://www.zpid.de/pub/info/PSYNDEXterms2011.pdf">http://www.zpid.de/pub/info/PSYNDEXterms2011.pdf</ext-link></mixed-citation></ref></ref-list></back></pmc></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Rhénanie/explor/UnivTrevesV1/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000067 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 000067 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Rhénanie
|area= UnivTrevesV1
|flux= Pmc
|étape= Corpus
|type= RBID
|clé= PMC:4526583
|texte= Citation success of different publication types: a case study on all references in psychology publications from the German-speaking countries (D–A–CH–L–L) in 2009, 2010, and 2011
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/RBID.i -Sk "pubmed:26257449" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd \
| NlmPubMed2Wicri -a UnivTrevesV1
| This area was generated with Dilib version V0.6.31. |  |