Links to Exploration step
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">World health system performance revisited: the impact of varying the relative importance of health system goals</title><author><name sortKey="Lauer, Jeremy A" sort="Lauer, Jeremy A" uniqKey="Lauer J" first="Jeremy A" last="Lauer">Jeremy A. Lauer</name><affiliation><nlm:aff id="I1">Evidence and Information for Policy, World Health Organization, Geneva, Switzerland</nlm:aff></affiliation></author><author><name sortKey="Lovell, Ca Knox" sort="Lovell, Ca Knox" uniqKey="Lovell C" first="Ca Knox" last="Lovell">Ca Knox Lovell</name><affiliation><nlm:aff id="I2">Department of Economics, University of Georgia, Athens, GA 30602, USA</nlm:aff></affiliation></author><author><name sortKey="Murray, Christopher Jl" sort="Murray, Christopher Jl" uniqKey="Murray C" first="Christopher Jl" last="Murray">Christopher Jl Murray</name><affiliation><nlm:aff id="I1">Evidence and Information for Policy, World Health Organization, Geneva, Switzerland</nlm:aff></affiliation></author><author><name sortKey="Evans, David B" sort="Evans, David B" uniqKey="Evans D" first="David B" last="Evans">David B. Evans</name><affiliation><nlm:aff id="I1">Evidence and Information for Policy, World Health Organization, Geneva, Switzerland</nlm:aff></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">15271220</idno><idno type="pmc">506780</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC506780</idno><idno type="RBID">PMC:506780</idno><idno type="doi">10.1186/1472-6963-4-19</idno><date when="2004">2004</date><idno type="wicri:Area/PubMedCentral/Corpus">000025</idno><idno type="wicri:explorRef" wicri:stream="PubMedCentral" wicri:step="Corpus" wicri:corpus="PMC">000025</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">World health system performance revisited: the impact of varying the relative importance of health system goals</title><author><name sortKey="Lauer, Jeremy A" sort="Lauer, Jeremy A" uniqKey="Lauer J" first="Jeremy A" last="Lauer">Jeremy A. Lauer</name><affiliation><nlm:aff id="I1">Evidence and Information for Policy, World Health Organization, Geneva, Switzerland</nlm:aff></affiliation></author><author><name sortKey="Lovell, Ca Knox" sort="Lovell, Ca Knox" uniqKey="Lovell C" first="Ca Knox" last="Lovell">Ca Knox Lovell</name><affiliation><nlm:aff id="I2">Department of Economics, University of Georgia, Athens, GA 30602, USA</nlm:aff></affiliation></author><author><name sortKey="Murray, Christopher Jl" sort="Murray, Christopher Jl" uniqKey="Murray C" first="Christopher Jl" last="Murray">Christopher Jl Murray</name><affiliation><nlm:aff id="I1">Evidence and Information for Policy, World Health Organization, Geneva, Switzerland</nlm:aff></affiliation></author><author><name sortKey="Evans, David B" sort="Evans, David B" uniqKey="Evans D" first="David B" last="Evans">David B. Evans</name><affiliation><nlm:aff id="I1">Evidence and Information for Policy, World Health Organization, Geneva, Switzerland</nlm:aff></affiliation></author></analytic><series><title level="j">BMC Health Services Research</title><idno type="eISSN">1472-6963</idno><imprint><date when="2004">2004</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><sec><title>Background</title><p>In 2002, the World Health Organization published a health system performance ranking for 191 member countries. The ranking was based on five indicators, with fixed weights common to all countries.</p></sec><sec sec-type="methods"><title>Methods</title><p>We investigate the feasibility and desirability of using mathematical programming techniques that allow weights to vary across countries to reflect their varying circumstances and objectives.</p></sec><sec><title>Results</title><p>By global distributional measures, scores and ranks are found to be not very sensitive to changes in weights, although differences can be large for individual countries.</p></sec><sec><title>Conclusions</title><p>Building the flexibility of variable weights into calculation of the performance index is a useful way to respond to the debates and criticisms appearing since publication of the ranking.</p></sec></div></front><back><div1 type="bibliography"><listBibl><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct><biblStruct></biblStruct></listBibl></div1></back></TEI><pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">BMC Health Serv Res</journal-id><journal-title>BMC Health Services Research</journal-title><issn pub-type="epub">1472-6963</issn><publisher><publisher-name>BioMed Central</publisher-name><publisher-loc>London</publisher-loc></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">15271220</article-id><article-id pub-id-type="pmc">506780</article-id><article-id pub-id-type="publisher-id">1472-6963-4-19</article-id><article-id pub-id-type="doi">10.1186/1472-6963-4-19</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group></article-categories><title-group><article-title>World health system performance revisited: the impact of varying the relative importance of health system goals</article-title></title-group><contrib-group><contrib id="A1" corresp="yes" contrib-type="author"><name><surname>Lauer</surname><given-names>Jeremy A</given-names></name><xref ref-type="aff" rid="I1">1</xref><email>lauerj@who.int</email></contrib><contrib id="A2" contrib-type="author"><name><surname>Lovell</surname><given-names>CA Knox</given-names></name><xref ref-type="aff" rid="I2">2</xref><email>knox@terry.uga.edu</email></contrib><contrib id="A3" contrib-type="author"><name><surname>Murray</surname><given-names>Christopher JL</given-names></name><xref ref-type="aff" rid="I1">1</xref><email>christopher_murray@harvard.edu</email></contrib><contrib id="A4" contrib-type="author"><name><surname>Evans</surname><given-names>David B</given-names></name><xref ref-type="aff" rid="I1">1</xref><email>evansd@who.int</email></contrib></contrib-group><aff id="I1"><label>1</label>Evidence and Information for Policy, World Health Organization, Geneva, Switzerland</aff><aff id="I2"><label>2</label>Department of Economics, University of Georgia, Athens, GA 30602, USA</aff><pub-date pub-type="collection"><year>2004</year></pub-date><pub-date pub-type="epub"><day>22</day><month>7</month><year>2004</year></pub-date><volume>4</volume><fpage>19</fpage><lpage>19</lpage><ext-link ext-link-type="uri" xlink:href="http://www.biomedcentral.com/1472-6963/4/19"></ext-link><history><date date-type="received"><day>12</day><month>11</month><year>2003</year></date><date date-type="accepted"><day>22</day><month>7</month><year>2004</year></date></history><copyright-statement>Copyright © 2004 Lauer et al; licensee BioMed Central Ltd.</copyright-statement><license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/2.0"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/2.0"></ext-link>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</p></license><abstract><sec><title>Background</title><p>In 2002, the World Health Organization published a health system performance ranking for 191 member countries. The ranking was based on five indicators, with fixed weights common to all countries.</p></sec><sec sec-type="methods"><title>Methods</title><p>We investigate the feasibility and desirability of using mathematical programming techniques that allow weights to vary across countries to reflect their varying circumstances and objectives.</p></sec><sec><title>Results</title><p>By global distributional measures, scores and ranks are found to be not very sensitive to changes in weights, although differences can be large for individual countries.</p></sec><sec><title>Conclusions</title><p>Building the flexibility of variable weights into calculation of the performance index is a useful way to respond to the debates and criticisms appearing since publication of the ranking.</p></sec></abstract><kwd-group><kwd>health care provision</kwd><kwd>weighting of indicators</kwd></kwd-group></article-meta></front><body><sec><title>Background</title><p>The World Health Organization recently published a performance ranking of the health systems of its 191 member countries, and intends to update it at regular intervals [<xref ref-type="bibr" rid="B1">1</xref>-<xref ref-type="bibr" rid="B4">4</xref>]. It was based on a framework outlining a set of social goals to which health systems should contribute [<xref ref-type="bibr" rid="B5">5</xref>]. It was argued that systems should contribute to improving population health, be responsive to the people they serve and be financed fairly. Five outcome indicators were defined – the level of population health, inequalities in health, the level of responsiveness, inequalities in responsiveness and fairness in financial contributions. Estimates of attainment on these five indicators were made for the 191 countries that were members of WHO at that time, and a composite (overall) attainment indicator was constructed for each country as a weighted average of attainment on the five individual outcome indicators.</p><p>Publication of the analytical framework and the resulting ranking provoked considerable comment, and a variety of issues concerning the methodology and country positions in the ranking have been raised. A central component of the methodology for measuring overall attainment was the use of fixed weights, common to all countries, to aggregate the five indicators. This feature has been controversial, with some arguing that people in different cultural and social settings value individual health system goals in different ways [<xref ref-type="bibr" rid="B6">6</xref>-<xref ref-type="bibr" rid="B13">13</xref>]. The fixed weights had the virtue of being based on expert opinion, having been derived from the valuations of 1,007 respondents – largely health system professionals – to a WHO survey [<xref ref-type="bibr" rid="B14">14</xref>]. However the weights were common to all countries, regardless of their development status and cultural traditions.</p><p>In this paper we examine the sensitivity of the attainment scores to alternative weighting schemes that allow weights to vary across countries. These country-specific weights may reveal varying objectives of policy makers or constraints under which they operate. Melyn and Moesen [<xref ref-type="bibr" rid="B15">15</xref>] have referred to such weights as 'benefit of the doubt' weights.</p></sec><sec sec-type="methods"><title>Methods</title><p>WHO used fixed weights (0.25, 0.25, 0.125, 0.125, 0.25) to aggregate five health system outputs (respectively, the level of population health, inequality in the distribution of health, the level of health system responsiveness, inequality in the distribution of responsiveness, and fairness in financial contributions) into a scalar health system attainment index. Overall attainment ranged from 35.7 (Sierra Leone) to 93.4 (Japan) on a [0–100] scale.</p><p>We propose here an analytical framework that reduces to the WHO fixed-weight methodology as a special case, but that allows varying degrees of freedom for weights to be defined that – in the sense of Melyn and Moesen – implicitly take into account individual country circumstances. For shorthand, we say countries "choose" such weights, which in reality are determined as solution values of a linear program. If the linear program is a fair representation of the objective function of and constraints faced by decision makers, the weights are indeed "chosen", but even if this condition is not necessarily met, the resulting weights may still be of interest.</p><p>The extent of freedom to choose weights in a linear program can be set by the analyst. The analyst can enforce fixed weights common to all countries, allow countries complete freedom to choose their own weights, or adopt a middle ground in which countries are granted limited freedom to choose weights within bounds thought to be sensible by experts.</p><p>A generic statement of the performance evaluation problem in primal-dual linear programming format is:</p><p><inline-graphic xlink:href="1472-6963-4-19-i1.gif"></inline-graphic></p><p>In these programs y is a country's output vector, x is its input vector, Y is the sample output matrix and X is the sample input matrix. In the present context y is (5 × 1), Y is (5 × 191), x is (n × 1) and X is (n × 191), with n to be specified below.</p><p>The primal program seeks the maximum radial expansion of a country's outputs, provided that it not exceed the standards established by a convex combination (λ ≥ 0, ∑λ = 1) of best-practice countries in the sample. The optimal value of φ provides a distance measure (i.e. an indication of how far a country has to go) to match best practice as observed in the sample. Since φ ≥ 1, the attainment of a country is evaluated as φ<sup>-1 </sup>≤ 1. Best practice countries have φ<sup>-1 </sup>= 1, other countries have φ<sup>-1 </sup>< 1, so φ provides a basis for acomplete ranking of countries on their relative ability to deliver five health system outputs. The dual program seeks a set of nonnegative weights μ,υ attached to a country's outputs and inputs that maximize its attainment. Each country's output weights are normalized by μy = 1, but each is free to select its own set of nonnegative weights.</p><p>In constructing the overall attainment index, WHO identified five output indicators and no inputs, preferring to treat each country's health system as a "health output management unit". Consequently each country's input vector is represented as a scalar with unit value. Under these circumstances the performance evaluation problem simplifies to:</p><p><inline-graphic xlink:href="1472-6963-4-19-i2.gif"></inline-graphic></p><p>where ω = υ + υ<sub>0</sub>. The modified primal program seeks the maximum feasible radial expansion of a country's outputs consistent with best practice observed in the sample. The modified dual program seeks a set of nonnegative weights μ for a country's outputs that put it in the best light. A country can be expected to assign relatively large weights to those outputs at which it excels relative to best practice, and relatively low, possibly zero, weights to those outputs at which it lags behind best practice, subject to the normalization μy = 1. (See Annex for a graphical explanation.)</p><p>By complementary slackness, μ<sub>m</sub>(Y<sub>m</sub>λ - φy<sub>m</sub>) = 0, m = 1, ..., M, so slack in any element of a country's projected output vector φy implies that the country assigns a zero weight to that output. Since it is unreasonable to allow a country to assign a zero weight to any output deemed sufficiently important to have been included in the WHO performance evaluation exercise, it is desirable to restrict weights in some way. This can be accomplished most easily by appending constraints to the dual side of (2) of the form:</p><p>γ<sub>m </sub>≥ μ<sub>m</sub>y<sub>m</sub>/μy ≥ β<sub>m</sub>, m = 1, ..., M. (3)</p><p>Restrictions (3) place lower and upper bounds on the relative importance of each output (as measured by μ<sub>m</sub>) in total output.</p><p>Implementation of the weight-restricted linear program requires specifying the 2M = 10 parameters γ<sub>m</sub>, β<sub>m</sub>. One procedure is to ignore the upper bounds γ<sub>m </sub>and set the lower bounds β<sub>m </sub>> 0. This eliminates the possibility of a country assigning zero weights to those outputs at which it lags behind best practice. A less arbitrary procedure is to follow Takamura and Tone [<xref ref-type="bibr" rid="B16">16</xref>] by adapting Saaty's Analytical Hierarchy Process (AHP) [<xref ref-type="bibr" rid="B17">17</xref>]. This procedure exploits expert judgment, that could be provided for example by the above-mentioned survey of health system professionals, to set lower bounds β<sub>m </sub>> 0 and upper bounds 1 > γ<sub>m</sub>. Although these bounds are common to all countries, they allow countries limited freedom to select weights appropriate to their circumstances.</p></sec><sec><title>Results</title><p>The fixed weights used by WHO)) [<xref ref-type="bibr" rid="B4">4</xref>] to aggregate the five health system indicators gave countries no freedom to choose weights appropriate to their circumstances. We compare the WHO attainment index with three alternative indexes allowing countries varying degrees of freedom to choose weights. The first index is based on the solution to program (2), without weight restrictions, thereby allowing complete freedom to choose. The second index is based on (2), with lower bounds in (3) of β<sub>m </sub>= 0.10 on all weights, allowing substantial freedom to choose. The third index is based on (2), with lower and upper bounds in (3) set by a modified AHP procedure.</p><p>In the modified procedure, "expert opinion" was taken to mean the average values of weights arising from population-representative country surveys, each of which included a module on health system goals [<xref ref-type="bibr" rid="B9">9</xref>]. Respondents were queried about their individual preferences on the five stated health system goals in a total of 51 countries, in some of which multiple surveys were performed, and country means were calculated on the basis of these individual responses [<xref ref-type="bibr" rid="B18">18</xref>]. The survey methods, reliability, validity, representativeness, sample size and respondent characteristics are extensively described in Ustün et al. [<xref ref-type="bibr" rid="B9">9</xref>], and are also reported in summary form in Sadana et al. [<xref ref-type="bibr" rid="B19">19</xref>], Mathers et al. [<xref ref-type="bibr" rid="B20">20</xref>], Mathers et al. [<xref ref-type="bibr" rid="B21">21</xref>] and Sadana et al. [<xref ref-type="bibr" rid="B22">22</xref>]. The survey instruments are available at <ext-link ext-link-type="uri" xlink:href="http://www.who.int/evidence/hhsr-survey/"></ext-link>.</p><p>For each output, the lower bound for calculation of the third index was taken as the minimum of the country average weights, and the upper bound the maximum [<xref ref-type="bibr" rid="B23">23</xref>]. Country mean weights and survey types, as well as survey wide maximum and minimum weights are shown in Table <xref ref-type="table" rid="T1">1</xref>. The lower bounds are accordingly β<sub>m </sub>= (0.19, 0.17, 0.12, 0.11, 0.22) and the upper bounds γ<sub>m </sub>= (0.29, 0.25, 0.18, 0.17, 0.30). This specification allows limited freedom to choose. We refer to the four indexes as WHO, LP1, LP2 and LP3, respectively.</p><p>Summary statistics of the four attainment indexes appear in Table <xref ref-type="table" rid="T2">2</xref>. The three LP distributions have higher means than the WHO distribution, and two of them have lower dispersion. However increasing restrictions on freedom to choose reduce the mean, and increase the dispersion, of the LP attainment indexes toward the mean and dispersion of the WHO attainment index.</p><p>Rank correlations between pairs of attainment rankings appear in Table <xref ref-type="table" rid="T3">3</xref>. Despite the distributional changes due to freedom to choose, rank correlations are positive, high and statistically significant. The lowest correlations involve LP1, the index allowing complete freedom to choose. With the exception of LP1, there is strong agreement about the identity of countries in the top and bottom quartiles of the distribution. Japan is ranked #1 and Sierra Leone is ranked #191 on all four indexes.</p><p>Figure <xref ref-type="fig" rid="F1">1</xref> shows plots of WHO attainment scores and rankings versus the three LP attainment scores and rankings. The convergence of the distributions of the LP attainment scores and rankings to the WHO scores and rankings is apparent.</p><p>Results based on LP1 are unattractive. Over one-third of countries (70 of 191) assign a zero weight to four of the five indicators, and the vast majority of countries assign a weight in excess of 0.9 to either responsiveness distribution or fairness in financial contributions. This means they assign a low or zero weight to population health, the defining goal of the health system, which does not have face validity. In LP1, only Japan, Luxembourg and the United States assign positive weights to all five indicators. Consequently the attainment index is tightly distributed about a very high mean value. The ability to discriminate is sacrificed to freedom to choose, with 75% of countries receiving attainment indexes of 99 or above.</p><p>Results from LP2 are somewhat more attractive. Nevertheless, when weights are bounded below by 0.1, over three-quarters (147 of 191) of countries assign the minimum weight to four of the five indicators and a 0.6 = 1 - (4 × 0.1) weight to either responsiveness distribution or fairness in financial contributions. The attainment scores are again compressed about a high mean value, and the ability to discriminate is not much improved, with 75% of countries receiving attainment scores of 93 or above. However despite this dramatic compression, the LP2 ranking is globally very similar to the WHO ranking. Eighteen of the countries ranked in the top 20 by WHO appear in the LP2 top 20, and 14 of the countries ranked in the bottom 20 by WHO appear in the LP2 bottom 20.</p><p>Not surprisingly, the distribution of the attainment scores for LP3 looks even more similar to the distribution of the WHO scores, and has a similar mean and standard deviation. Rank correlation is very high, with only one country falling out of the WHO top 20 and only five countries rising out of the WHO bottom 20. Nonetheless, limited freedom to choose has an important impact on individual countries. The USA, given an ability to emphasize the importance of responsiveness level and responsiveness inequality, and to de-emphasize the importance of health level and inequality in the distribution of health, improves its ranking from #15 to #3. Australia improves from #12 to #7 for similar reasons. Italy, on the other hand, falls from #11 to #18, primarily as a result of the movement of other countries. In LP3, the largest positive changes in ranking are for Mauritius (+25) and Saint Vincent (+22), while the largest negative changes in ranking are for Kazakhstan (-39) and Albania (-36).</p></sec><sec><title>Discussion</title><p>We began by questioning the appropriateness of the fixed weight approach to aggregating indicators adopted by WHO, on the grounds that fixed weights deny countries at varying stages of development the freedom to choose. We then proposed a sequence of linear programming models that allowed countries varying freedom to choose the weights assigned to their indicators. LP1 allows complete freedom to choose, and generates weights we consider unacceptable, particularly because so many countries give a zero weight to improving health. LP2 allows considerable freedom to choose, but generates many country-specific weights falling outside the range of the within-country means used as bounds in LP3. Clearly, the validity of a procedure that routinely assigns weights out of the range of representative cross-population preferences should be questioned, even without a sophisticated theory of empirical ethics or democratic choice.</p><p>LP3 applies the AHP procedure to set plausible bounds on weights, and allows limited freedom to choose. It generates a very similar distribution of the attainment index, and a very high linear rank correlation with the WHO ranking. Despite these similarities, we find the LP3 approach intuitively appealing, and are encouraged by its global concordance with the WHO index. However it is fair to ask: if LP3 and WHO generate such similar rankings, why bother? What value does LP3 add? Indeed, individual countries may come to diametrically opposed conclusions about the benefits of LP3 or WHO on the basis of their implied rank changes (e.g. Mauritius vs. Kazakhstan).</p><p>Howbeit, our first response to the question "why bother" focuses on the distribution of the LP3 weights in comparison to the WHO weights. The WHO weight on responsiveness inequality was 0.125. But the LP3 upper bound of 0.17 is binding on 182 countries, which implicitly want a higher weight on this indicator. The WHO weight on fairness in financial contributions was 0.25. But the LP3 upper bound of 0.30 is binding on 167 countries that want a higher weight. At the other end, the WHO weight on health level is 0.25. But the LP3 lower bound of 0.19 is binding on 170 countries that want a lower weight. The WHO weight on responsiveness level is 0.125. But the LP3 lower bound of 0.12 is binding on 103 countries that want a lower weight. It appears that a majority of countries at all stages of development may implicitly assign greater importance to indicators of health distribution, and less importance to indicators of health level, than the experts whose judgments formed the basis of the original WHO weights.</p><p>Our second response is more general. By allowing countries limited freedom to choose their weights, LP3 takes a small but nevertheless significant step toward respecting their varying circumstances. While the narrower the bounds on weights, the smaller the step, even the limited freedom embodied in LP3 makes an important difference to some countries.</p></sec><sec><title>Conclusions</title><p>Building in the flexibility of varying weights might be a useful way for WHO to respond to the debates and criticisms appearing since publication of the ranking. We conclude by speculating that a variant of LP3 incorporating information regarding which weights are binding, and in which direction, might yield even greater benefits in terms of respecting individual circumstances.</p></sec><sec><title>Competing interests</title><p>JAL, CJLM and DBE were part of the team at WHO that developed the methods for the world health system performance rankings published by the Organization in 2000.</p></sec><sec><title>Abbreviations</title><p>AHP (Analytical Hierarchy Process)</p><p>DEA (Data envelopment analysis)</p><p>LP (Linear program)</p><p>LP1 (Linear Program 1)</p><p>LP2 (Linear Program 2)</p><p>LP3 (Linear Program 3)</p><p>WHO (World Health Organization)</p></sec><sec><title>Authors' contributions</title><p>JAL developed methods inspired by the benefit-of-the-doubt concept and drafted an earlier version of the manuscript. CAKL adapted and applied the DEA methods described here to health system performance and drafted the initial version of the current manuscript. CJLM conceived the methods for measuring health system performance. DBE coordinated the research at WHO. All authors revised and approved the manuscript.</p></sec><sec><title>Pre-publication history</title><p>The pre-publication history for this paper can be accessed here:</p><p><ext-link ext-link-type="uri" xlink:href="http://www.biomedcentral.com/1472-6963/4/19/prepub"></ext-link></p></sec><sec sec-type="supplementary-material"><title>Supplementary Material</title><supplementary-material content-type="local-data" id="S1"><caption><title>Additional File 1</title><p>Annex.Graphical interpretation of DEA and conceptual links with value theory.doc</p></caption><media xlink:href="1472-6963-4-19-S1.doc" mimetype="application" mime-subtype="msword"><caption><p>Click here for file</p></caption></media></supplementary-material></sec></body><back><ref-list><ref id="B1"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Evans</surname><given-names>DB</given-names></name><name><surname>Tandon</surname><given-names>A</given-names></name><name><surname>Murray</surname><given-names>CJL</given-names></name><name><surname>Lauer</surname><given-names>J</given-names></name></person-group><article-title>The comparative efficiency of national health systems in producing health: an analysis of 191 countries</article-title><source>Global Programme on Evidence for Health Policy Discussion Paper No 29</source><year>2000</year><publisher-name>Geneva, Switzerland, World Health Organization</publisher-name></citation></ref><ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Evans</surname><given-names>DB</given-names></name><name><surname>Tandon</surname><given-names>A</given-names></name><name><surname>Murray</surname><given-names>CJL</given-names></name><name><surname>Lauer</surname><given-names>JA</given-names></name></person-group><article-title>Comparative efficiency of national health systems: cross national econometric analysis</article-title><source>BMJ</source><year>2001</year><volume>323</volume><fpage>307</fpage><lpage>310</lpage><pub-id pub-id-type="pmid">11498486</pub-id><pub-id pub-id-type="doi">10.1136/bmj.323.7308.307</pub-id></citation></ref><ref id="B3"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Tandon</surname><given-names>A</given-names></name><name><surname>Murray</surname><given-names>CJL</given-names></name><name><surname>Lauer</surname><given-names>J</given-names></name><name><surname>Evans</surname><given-names>DE</given-names></name></person-group><article-title>Measuring overall health system performance for 191 countries</article-title><source>Global Programme on Evidence forHealth Policy Discussion Paper No 30</source><year>2000</year><publisher-name>Geneva, Switzerland, World Health Organization</publisher-name></citation></ref><ref id="B4"><citation citation-type="other"><person-group person-group-type="author"><collab>World Health Organization</collab></person-group><article-title>The World Health Report 2000: Health systems: Improving performance</article-title><source>Geneva, World Health Organization</source><year>2000</year></citation></ref><ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Murray</surname><given-names>CJ</given-names></name><name><surname>Frenk</surname><given-names>J</given-names></name></person-group><article-title>A framework for assessing the performance of health systems</article-title><source>Bull World Health Organ</source><year>2000</year><volume>78</volume><fpage>717</fpage><lpage>731</lpage><pub-id pub-id-type="pmid">10916909</pub-id></citation></ref><ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Navarro</surname><given-names>V</given-names></name></person-group><article-title>Assessment of the World Health Report 2000</article-title><source>Lancet</source><year>2000</year><volume>356</volume><fpage>1598</fpage><lpage>1601</lpage><pub-id pub-id-type="pmid">11075789</pub-id><pub-id pub-id-type="doi">10.1016/S0140-6736(00)03139-1</pub-id></citation></ref><ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Williams</surname><given-names>A</given-names></name></person-group><article-title>Science or marketing at WHO? A commentary on 'World Health 2000'</article-title><source>Health Econ</source><year>2001</year><volume>10</volume><fpage>93</fpage><lpage>100</lpage><pub-id pub-id-type="pmid">11252041</pub-id><pub-id pub-id-type="doi">10.1002/hec.594</pub-id></citation></ref><ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Williams</surname><given-names>A</given-names></name></person-group><article-title>Science or marketing at WHO? Rejoinder from Alan Williams</article-title><source>Health Econ</source><year>2001</year><volume>10</volume><fpage>283</fpage><lpage>285</lpage><pub-id pub-id-type="doi">10.1002/hec.624</pub-id></citation></ref><ref id="B9"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Ustun</surname><given-names>TB</given-names></name><name><surname>Chatterji</surname><given-names>S</given-names></name><name><surname>Villanueva</surname><given-names>M</given-names></name><name><surname>Bendib</surname><given-names>L</given-names></name><name><surname>Celik</surname><given-names>C</given-names></name><name><surname>Sadana</surname><given-names>R</given-names></name><name><surname>Valentine</surname><given-names>N</given-names></name><name><surname>Ortiz</surname><given-names>J</given-names></name><name><surname>Tandon</surname><given-names>A</given-names></name><name><surname>Salomon</surname><given-names>J</given-names></name><name><surname>Cao</surname><given-names>Y</given-names></name><name><surname>Jun</surname><given-names>XW</given-names></name><name><surname>Ozaltin</surname><given-names>E</given-names></name><name><surname>Mathers</surname><given-names>C</given-names></name><name><surname>Murray</surname><given-names>CJL</given-names></name></person-group><article-title>WHO Multi-country survey study on health and responsiveness 2000–2001</article-title><source>Global Programme on Evidence for Health Policy, Discussion Paper No 37</source><year>2001</year><publisher-name>Geneva, World Health Organization</publisher-name></citation></ref><ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Almeida</surname><given-names>C</given-names></name><name><surname>Braveman</surname><given-names>P</given-names></name><name><surname>Gold</surname><given-names>MR</given-names></name><name><surname>Szwarcwald</surname><given-names>CL</given-names></name><name><surname>Ribeiro</surname><given-names>JM</given-names></name><name><surname>Miglionico</surname><given-names>A</given-names></name><name><surname>Millar</surname><given-names>JS</given-names></name><name><surname>Porto</surname><given-names>S</given-names></name><name><surname>Costa</surname><given-names>NR</given-names></name><name><surname>Rubio</surname><given-names>VO</given-names></name><etal></etal></person-group><article-title>Methodological concerns and recommendations on policy consequences of the World Health Report 2000</article-title><source>Lancet</source><year>2001</year><volume>357</volume><fpage>1692</fpage><lpage>1697</lpage><pub-id pub-id-type="pmid">11425394</pub-id><pub-id pub-id-type="doi">10.1016/S0140-6736(00)04825-X</pub-id></citation></ref><ref id="B11"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Smith</surname><given-names>P</given-names></name></person-group><person-group person-group-type="editor"><name><surname>Smith P</surname></name></person-group><article-title>Developing composite indicators for assessing overall system efficiency</article-title><source>In Measuring up: improving health systems performance in OECD countries</source><year>2002</year><publisher-name>Paris, France, OECD</publisher-name></citation></ref><ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hollingsworth</surname><given-names>B</given-names></name><name><surname>Wildman</surname><given-names>J</given-names></name></person-group><article-title>The efficiency of health production: re-estimating the WHO panel data using parametric and non-parametric approaches to provide additional information</article-title><source>Health Econ</source><year>2003</year><volume>12</volume><fpage>493</fpage><lpage>504</lpage><pub-id pub-id-type="pmid">12759918</pub-id><pub-id pub-id-type="doi">10.1002/hec.751</pub-id></citation></ref><ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Richardson</surname><given-names>J</given-names></name><name><surname>Robertson</surname><given-names>IK</given-names></name><name><surname>Wildman</surname><given-names>J</given-names></name></person-group><article-title>A critique of the World Health Organization's evaluation of health system performance</article-title><source>Health Econ</source><year>2003</year><volume>12</volume><fpage>355</fpage><lpage>366</lpage><pub-id pub-id-type="pmid">12720253</pub-id><pub-id pub-id-type="doi">10.1002/hec.761</pub-id></citation></ref><ref id="B14"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Gakidou</surname><given-names>EE</given-names></name><name><surname>Frenk</surname><given-names>J</given-names></name><name><surname>Murray</surname><given-names>CJL</given-names></name></person-group><article-title>Measuring preferences on health system performance assessment</article-title><source>Global Programme on Evidence for Health Policy Discussion Paper, 20</source><year>2000</year><publisher-name>Geneva, Switzerland, World Health Organization</publisher-name></citation></ref><ref id="B15"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Melvyn</surname><given-names>W</given-names></name><name><surname>Moesen</surname><given-names>W</given-names></name></person-group><article-title>Towards a synthetic indicator of macroeconomic performance: unequal weighting when limited information is available</article-title><source>Public Economics Research Paper No 17</source><year>1991</year><publisher-name>Leuven, Belgium, Katholieke Universiteit Leuven</publisher-name></citation></ref><ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Takamura</surname><given-names>Y</given-names></name><name><surname>Tone</surname><given-names>K</given-names></name></person-group><article-title>A comparative site evaluation study for relocating Japanese government agencies out of Tokyo</article-title><source>Socioecon Plann Sci</source><year>2003</year><volume>37</volume><fpage>85</fpage><lpage>102</lpage><pub-id pub-id-type="doi">10.1016/S0038-0121(02)00049-6</pub-id></citation></ref><ref id="B17"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Saaty</surname><given-names>TL</given-names></name></person-group><source>Analytic hierarchy process</source><year>1980</year><publisher-name>New York, McGraw-Hill</publisher-name></citation></ref><ref id="B18"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Gakidou</surname><given-names>EE</given-names></name><name><surname>Evans</surname><given-names>DB</given-names></name><name><surname>Murray</surname><given-names>CJL</given-names></name></person-group><person-group person-group-type="editor"><name><surname>Murray CJL</surname></name></person-group><article-title>Empirical assessment of the importance of three health system goals: results from household surveys in 50 countries</article-title><source>In Health Systems Performance Assessment: Debate, New Methods, and New Empiricism</source><year>2003</year><publisher-name>Geneva, World Health Organization, forthcoming</publisher-name></citation></ref><ref id="B19"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Sadana</surname><given-names>R</given-names></name><name><surname>Tandon</surname><given-names>A</given-names></name><name><surname>Murray</surname><given-names>CJL</given-names></name><name><surname>Serdobova</surname><given-names>I</given-names></name><name><surname>Cao</surname><given-names>Y</given-names></name><name><surname>Xie</surname><given-names>WJ</given-names></name><name><surname>Chatterji</surname><given-names>S</given-names></name><name><surname>Ustun</surname><given-names>TB</given-names></name></person-group><article-title>Describing population health in six domains: comparable results from 66 household surveys</article-title><source>Global Programme on Evidence for Health Policy Discussion Paper No 43</source><year>2002</year><publisher-name>Geneva, Switzerland, World Health Organization</publisher-name></citation></ref><ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mathers</surname><given-names>CD</given-names></name><name><surname>Murray</surname><given-names>CJ</given-names></name><name><surname>Lopez</surname><given-names>AD</given-names></name><name><surname>Sadana</surname><given-names>R</given-names></name><name><surname>Salomon</surname><given-names>JA</given-names></name></person-group><article-title>Global patterns of healthy life expectancy for older women</article-title><source>J Women Aging</source><year>2002</year><volume>14</volume><fpage>99</fpage><lpage>117</lpage><pub-id pub-id-type="pmid">12537282</pub-id><pub-id pub-id-type="doi">10.1300/J074v14n01_07</pub-id></citation></ref><ref id="B21"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Mathers</surname><given-names>CD</given-names></name><name><surname>Murray</surname><given-names>CJL</given-names></name><name><surname>Salomon</surname><given-names>J</given-names></name><name><surname>Sadana</surname><given-names>R</given-names></name><name><surname>Tandon</surname><given-names>A</given-names></name><name><surname>Lopez</surname><given-names>AD</given-names></name><name><surname>Ustun</surname><given-names>B</given-names></name><name><surname>Chatterji</surname><given-names>S</given-names></name></person-group><article-title>Healthy life expectancy: comparison of OECD countries in 2001</article-title><source>Aust N Z J Public Health</source><year>2003</year><comment></comment></citation></ref><ref id="B22"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Sadana</surname><given-names>R</given-names></name><name><surname>Tandon</surname><given-names>A</given-names></name><name><surname>Mathers</surname><given-names>CD</given-names></name><name><surname>Salomon</surname><given-names>J</given-names></name><name><surname>Ustun</surname><given-names>TB</given-names></name><name><surname>Lopez</surname><given-names>AD</given-names></name><name><surname>Murray</surname><given-names>CJL</given-names></name></person-group><person-group person-group-type="editor"><name><surname>OECD</surname></name></person-group><article-title>Comparable measures of population health with a focus on OECD countries</article-title><source>In A disease-based comparison of health systems: what is best and at what cost?</source><year>2003</year><publisher-name>Paris, OECD, forthcoming</publisher-name><fpage>263</fpage><lpage>276</lpage></citation></ref><ref id="B23"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Lauer</surname><given-names>JA</given-names></name><name><surname>Evans</surname><given-names>DB</given-names></name><name><surname>Murray</surname><given-names>CJL</given-names></name></person-group><person-group person-group-type="editor"><name><surname>Murray CJL</surname></name></person-group><article-title>Measuring health system attainment: the impact of variability in the importance of social goals</article-title><source>In Health Systems Performance Assessment: Debate, New Methods, and New Empiricism</source><year>2003</year><publisher-name>Geneva, World Health Organization, forthcoming</publisher-name></citation></ref></ref-list><sec sec-type="display-objects"><title>Figures and Tables</title><fig position="float" id="F1"><label>Figure 1</label><caption><p>Graphical array showing LP attainment scores vs WHO attainment scores (left column) and LP ranks vs WHO ranks (right column). From top to bottom, WHO vs LP1, LP2, and LP3, respectively.</p></caption><graphic xlink:href="1472-6963-4-19-1"></graphic></fig><table-wrap position="float" id="T1"><label>Table 1</label><caption><p>Country means and survey types.</p></caption><table frame="hsides" rules="groups"><thead><tr><td></td><td align="center" colspan="6">Mean survey weight</td></tr><tr><td align="left">Survey country</td><td align="center">Health level</td><td align="center">Health distribution</td><td align="center">Responsiveness level</td><td align="center">Responsiveness distribution</td><td align="center">Fair financing</td><td align="center">Survey type</td></tr></thead><tbody><tr><td align="left">Argentina</td><td align="center">0.26</td><td align="center">0.25</td><td align="center">0.13</td><td align="center">0.13</td><td align="center">0.24</td><td align="center">brief<sup>a</sup></td></tr><tr><td align="left">Australia</td><td align="center">0.23</td><td align="center">0.21</td><td align="center">0.15</td><td align="center">0.14</td><td align="center">0.27</td><td align="center">postal<sup>b</sup></td></tr><tr><td align="left">Austria</td><td align="center">0.23</td><td align="center">0.20</td><td align="center">0.15</td><td align="center">0.14</td><td align="center">0.28</td><td align="center">postal</td></tr><tr><td align="left">Bahrain</td><td align="center">0.26</td><td align="center">0.17</td><td align="center">0.17</td><td align="center">0.13</td><td align="center">0.27</td><td align="center">brief</td></tr><tr><td align="left">Belgium</td><td align="center">0.24</td><td align="center">0.25</td><td align="center">0.13</td><td align="center">0.14</td><td align="center">0.25</td><td align="center">brief</td></tr><tr><td align="left">Bulgaria</td><td align="center">0.25</td><td align="center">0.22</td><td align="center">0.13</td><td align="center">0.13</td><td align="center">0.27</td><td align="center">brief</td></tr><tr><td align="left">Canada</td><td align="center">0.25</td><td align="center">0.17</td><td align="center">0.16</td><td align="center">0.13</td><td align="center">0.29</td><td align="center">brief</td></tr><tr><td align="left">Chile</td><td align="center">0.20</td><td align="center">0.21</td><td align="center">0.15</td><td align="center">0.15</td><td align="center">0.29</td><td align="center">brief</td></tr><tr><td align="left">China</td><td align="center">0.27</td><td align="center">0.21</td><td align="center">0.15</td><td align="center">0.12</td><td align="center">0.25</td><td align="center">postal</td></tr><tr><td align="left">Costa Rica</td><td align="center">0.28</td><td align="center">0.25</td><td align="center">0.12</td><td align="center">0.12</td><td align="center">0.22</td><td align="center">brief</td></tr><tr><td align="left">Croatia</td><td align="center">0.25</td><td align="center">0.24</td><td align="center">0.13</td><td align="center">0.13</td><td align="center">0.25</td><td align="center">brief</td></tr><tr><td align="left">Cyprus</td><td align="center">0.25</td><td align="center">0.23</td><td align="center">0.14</td><td align="center">0.13</td><td align="center">0.25</td><td align="center">postal</td></tr><tr><td align="left">Czech Republic</td><td align="center">0.29</td><td align="center">0.22</td><td align="center">0.14</td><td align="center">0.12</td><td align="center">0.24</td><td align="center">brief, postal</td></tr><tr><td align="left">Denmark</td><td align="center">0.26</td><td align="center">0.21</td><td align="center">0.15</td><td align="center">0.12</td><td align="center">0.25</td><td align="center">postal</td></tr><tr><td align="left">Egypt</td><td align="center">0.26</td><td align="center">0.22</td><td align="center">0.14</td><td align="center">0.12</td><td align="center">0.26</td><td align="center">postal</td></tr><tr><td align="left">Estonia</td><td align="center">0.27</td><td align="center">0.22</td><td align="center">0.14</td><td align="center">0.11</td><td align="center">0.25</td><td align="center">brief</td></tr><tr><td align="left">Finland</td><td align="center">0.25</td><td align="center">0.21</td><td align="center">0.14</td><td align="center">0.12</td><td align="center">0.27</td><td align="center">brief, postal</td></tr><tr><td align="left">France</td><td align="center">0.24</td><td align="center">0.23</td><td align="center">0.14</td><td align="center">0.13</td><td align="center">0.26</td><td align="center">brief, postal</td></tr><tr><td align="left">Germany</td><td align="center">0.24</td><td align="center">0.22</td><td align="center">0.13</td><td align="center">0.14</td><td align="center">0.28</td><td align="center">brief</td></tr><tr><td align="left">Greece</td><td align="center">0.25</td><td align="center">0.21</td><td align="center">0.15</td><td align="center">0.13</td><td align="center">0.26</td><td align="center">postal</td></tr><tr><td align="left">Hungary</td><td align="center">0.24</td><td align="center">0.20</td><td align="center">0.16</td><td align="center">0.13</td><td align="center">0.27</td><td align="center">postal</td></tr><tr><td align="left">Iceland</td><td align="center">0.26</td><td align="center">0.20</td><td align="center">0.14</td><td align="center">0.13</td><td align="center">0.26</td><td align="center">brief</td></tr><tr><td align="left">Indonesia</td><td align="center">0.26</td><td align="center">0.22</td><td align="center">0.15</td><td align="center">0.13</td><td align="center">0.24</td><td align="center">brief</td></tr><tr><td align="left">Ireland</td><td align="center">0.24</td><td align="center">0.25</td><td align="center">0.13</td><td align="center">0.13</td><td align="center">0.26</td><td align="center">brief</td></tr><tr><td align="left">Italy</td><td align="center">0.24</td><td align="center">0.23</td><td align="center">0.14</td><td align="center">0.14</td><td align="center">0.25</td><td align="center">brief</td></tr><tr><td align="left">Jordan</td><td align="center">0.26</td><td align="center">0.18</td><td align="center">0.16</td><td align="center">0.12</td><td align="center">0.27</td><td align="center">brief</td></tr><tr><td align="left">Kyrgyzstan</td><td align="center">0.25</td><td align="center">0.22</td><td align="center">0.13</td><td align="center">0.13</td><td align="center">0.26</td><td align="center">postal</td></tr><tr><td align="left">Latvia</td><td align="center">0.24</td><td align="center">0.19</td><td align="center">0.15</td><td align="center">0.12</td><td align="center">0.30</td><td align="center">brief</td></tr><tr><td align="left">Lithuania</td><td align="center">0.24</td><td align="center">0.23</td><td align="center">0.15</td><td align="center">0.13</td><td align="center">0.25</td><td align="center">postal</td></tr><tr><td align="left">Luxembourg</td><td align="center">0.25</td><td align="center">0.23</td><td align="center">0.13</td><td align="center">0.13</td><td align="center">0.26</td><td align="center">telephone<sup>c</sup></td></tr><tr><td align="left">Malta</td><td align="center">0.25</td><td align="center">0.23</td><td align="center">0.13</td><td align="center">0.14</td><td align="center">0.24</td><td align="center">brief</td></tr><tr><td align="left">Morocco</td><td align="center">0.19</td><td align="center">0.18</td><td align="center">0.17</td><td align="center">0.17</td><td align="center">0.29</td><td align="center">brief</td></tr><tr><td align="left">Netherlands</td><td align="center">0.24</td><td align="center">0.18</td><td align="center">0.17</td><td align="center">0.14</td><td align="center">0.28</td><td align="center">brief, postal</td></tr><tr><td align="left">New Zealand</td><td align="center">0.24</td><td align="center">0.22</td><td align="center">0.15</td><td align="center">0.13</td><td align="center">0.26</td><td align="center">brief</td></tr><tr><td align="left">Oman</td><td align="center">0.25</td><td align="center">0.18</td><td align="center">0.18</td><td align="center">0.14</td><td align="center">0.25</td><td align="center">brief</td></tr><tr><td align="left">Poland</td><td align="center">0.24</td><td align="center">0.22</td><td align="center">0.14</td><td align="center">0.12</td><td align="center">0.27</td><td align="center">brief</td></tr><tr><td align="left">Portugal</td><td align="center">0.24</td><td align="center">0.25</td><td align="center">0.13</td><td align="center">0.13</td><td align="center">0.25</td><td align="center">brief</td></tr><tr><td align="left">Republic of Korea</td><td align="center">0.28</td><td align="center">0.21</td><td align="center">0.14</td><td align="center">0.12</td><td align="center">0.25</td><td align="center">brief</td></tr><tr><td align="left">Romania</td><td align="center">0.25</td><td align="center">0.22</td><td align="center">0.14</td><td align="center">0.13</td><td align="center">0.26</td><td align="center">brief</td></tr><tr><td align="left">Russian Federation</td><td align="center">0.25</td><td align="center">0.17</td><td align="center">0.17</td><td align="center">0.12</td><td align="center">0.29</td><td align="center">brief</td></tr><tr><td align="left">Spain</td><td align="center">0.26</td><td align="center">0.24</td><td align="center">0.13</td><td align="center">0.13</td><td align="center">0.24</td><td align="center">brief</td></tr><tr><td align="left">Sweden</td><td align="center">0.23</td><td align="center">0.20</td><td align="center">0.15</td><td align="center">0.14</td><td align="center">0.28</td><td align="center">brief</td></tr><tr><td align="left">Switzerland</td><td align="center">0.22</td><td align="center">0.21</td><td align="center">0.15</td><td align="center">0.15</td><td align="center">0.27</td><td align="center">postal</td></tr><tr><td align="left">Thailand</td><td align="center">0.21</td><td align="center">0.19</td><td align="center">0.16</td><td align="center">0.16</td><td align="center">0.28</td><td align="center">brief</td></tr><tr><td align="left">Trinidad and Tobago</td><td align="center">0.24</td><td align="center">0.22</td><td align="center">0.14</td><td align="center">0.13</td><td align="center">0.26</td><td align="center">brief</td></tr><tr><td align="left">Turkey</td><td align="center">0.24</td><td align="center">0.23</td><td align="center">0.13</td><td align="center">0.13</td><td align="center">0.27</td><td align="center">postal</td></tr><tr><td align="left">Ukraine</td><td align="center">0.26</td><td align="center">0.22</td><td align="center">0.14</td><td align="center">0.12</td><td align="center">0.26</td><td align="center">brief</td></tr><tr><td align="left">United Arab Emirates</td><td align="center">0.23</td><td align="center">0.17</td><td align="center">0.18</td><td align="center">0.14</td><td align="center">0.28</td><td align="center">brief</td></tr><tr><td align="left">United Kingdom</td><td align="center">0.26</td><td align="center">0.22</td><td align="center">0.14</td><td align="center">0.12</td><td align="center">0.26</td><td align="center">postal</td></tr><tr><td align="left">United States of America</td><td align="center">0.24</td><td align="center">0.20</td><td align="center">0.15</td><td align="center">0.16</td><td align="center">0.25</td><td align="center">postal</td></tr><tr><td align="left">Venezuela</td><td align="center">0.28</td><td align="center">0.23</td><td align="center">0.13</td><td align="center">0.11</td><td align="center">0.25</td><td align="center">brief</td></tr><tr><td align="left">Sample minimum</td><td align="center">0.19</td><td align="center">0.17</td><td align="center">0.12</td><td align="center">0.11</td><td align="center">0.22</td><td></td></tr><tr><td align="left">Sample maximum</td><td align="center">0.29</td><td align="center">0.25</td><td align="center">0.18</td><td align="center">0.17</td><td align="center">0.30</td><td></td></tr></tbody></table><table-wrap-foot><p><bold><sup>a</sup></bold>brief = brief face-to-face survey (Üstün et al. 2001). <bold><sup>b</sup></bold>postal = postal survey (Üstün et al. 2001). <bold><sup>c </sup></bold>telephone = computer-assisted telephone survey (Üstün et al. 2001).</p></table-wrap-foot></table-wrap><table-wrap position="float" id="T2"><label>Table 2</label><caption><p>Summary Statistics</p></caption><table frame="hsides" rules="groups"><thead><tr><td></td><td align="center">WHO</td><td align="center">LP1</td><td align="center">LP2</td><td align="center">LP3</td></tr></thead><tbody><tr><td align="left">Mean (%)</td><td align="center">73.30</td><td align="center">95.18</td><td align="center">85.15</td><td align="center">79.28</td></tr><tr><td align="left">Standard deviation (%)</td><td align="center">12.34</td><td align="center">4.79</td><td align="center">11.34</td><td align="center">14.98</td></tr><tr><td align="left">Interquartile range (%):</td><td></td><td></td><td></td><td></td></tr><tr><td align="right">First quartile</td><td align="center">63.64</td><td align="center">92.99</td><td align="center">78.12</td><td align="center">69.42</td></tr><tr><td align="right">Second quartile</td><td align="center">75.39</td><td align="center">96.00</td><td align="center">87.91</td><td align="center">83.37</td></tr><tr><td align="right">Third quartile</td><td align="center">81.65</td><td align="center">99.05</td><td align="center">93.25</td><td align="center">89.83</td></tr><tr><td align="right">Fourth quartile</td><td align="center">93.45</td><td align="center">100.00</td><td align="center">100.00</td><td align="center">100.00</td></tr></tbody></table></table-wrap><table-wrap position="float" id="T3"><label>Table 3</label><caption><p>Rank Correlations.</p></caption><table frame="hsides" rules="groups"><thead><tr><td></td><td align="center">WHO</td><td align="center">LP1</td><td align="center">LP2</td><td align="center">LP3</td></tr></thead><tbody><tr><td align="left">WHO</td><td align="center">1.00</td><td align="center">0.71</td><td align="center">0.96</td><td align="center">0.97</td></tr><tr><td align="left">LP1</td><td></td><td align="center">1.00</td><td align="center">0.75</td><td align="center">0.69</td></tr><tr><td align="left">LP2</td><td></td><td></td><td align="center">1.00</td><td align="center">0.99</td></tr><tr><td align="left">LP3</td><td></td><td></td><td></td><td align="center">1.00</td></tr></tbody></table></table-wrap></sec></back></pmc></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Sante/explor/LuxembourgNcbiV1/Data/PubMedCentral/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000025 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/PubMedCentral/Corpus/biblio.hfd -nk 000025 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Sante
|area= LuxembourgNcbiV1
|flux= PubMedCentral
|étape= Corpus
|type= RBID
|clé=
|texte=
}}
| This area was generated with Dilib version V0.6.37. |  |