Serveur d'exploration Cyberinfrastructure

Attention, ce site est en cours de développement !
Attention, site généré par des moyens informatiques à partir de corpus bruts.
Les informations ne sont donc pas validées.
***** Acces problem to record *****\

Identifieur interne : 000474 ( Pmc/Corpus ); précédent : 0004739; suivant : 0004750 ***** probable Xml problem with record *****

Links to Exploration step


Le document en format XML

<record>
<TEI>
<teiHeader>
<fileDesc>
<titleStmt>
<title xml:lang="en">A grid-enabled web service for low-resolution crystal structure refinement</title>
<author>
<name sortKey="O Onovan, Daniel J" sort="O Onovan, Daniel J" uniqKey="O Onovan D" first="Daniel J." last="O Onovan">Daniel J. O Onovan</name>
<affiliation>
<nlm:aff id="a">Department of Biological Chemistry and Molecular Pharmacology,
<institution>Harvard Medical School</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Stokes Rees, Ian" sort="Stokes Rees, Ian" uniqKey="Stokes Rees I" first="Ian" last="Stokes-Rees">Ian Stokes-Rees</name>
<affiliation>
<nlm:aff id="a">Department of Biological Chemistry and Molecular Pharmacology,
<institution>Harvard Medical School</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Nam, Yunsun" sort="Nam, Yunsun" uniqKey="Nam Y" first="Yunsun" last="Nam">Yunsun Nam</name>
<affiliation>
<nlm:aff id="a">Department of Biological Chemistry and Molecular Pharmacology,
<institution>Harvard Medical School</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Blacklow, Stephen C" sort="Blacklow, Stephen C" uniqKey="Blacklow S" first="Stephen C." last="Blacklow">Stephen C. Blacklow</name>
<affiliation>
<nlm:aff id="a">Department of Biological Chemistry and Molecular Pharmacology,
<institution>Harvard Medical School</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="b">Department of Cancer Biology,
<institution>Dana Farber Cancer Institute</institution>
, Boston, MA 02215,
<country>USA</country>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="c">Department of Pathology,
<institution>Brigham and Women’s Hospital</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Schroder, Gunnar F" sort="Schroder, Gunnar F" uniqKey="Schroder G" first="Gunnar F." last="Schröder">Gunnar F. Schröder</name>
<affiliation>
<nlm:aff id="d">Forschungszentrum Jülich,
<institution>Institute of Complex Systems (ICS-6)</institution>
, 52425 Jülich,
<country>Germany</country>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Brunger, Axel T" sort="Brunger, Axel T" uniqKey="Brunger A" first="Axel T." last="Brunger">Axel T. Brunger</name>
<affiliation>
<nlm:aff id="e">Howard Hughes Medical Institute and Departments of Molecular and Cellular Physiology, Neurology and Neurological Sciences, Structural Biology and Photon Science,
<institution>Stanford School of Medicine</institution>
, J. H. Clark Center E300C, 318 Campus Drive, Stanford, CA 94305,
<country>USA</country>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Sliz, Piotr" sort="Sliz, Piotr" uniqKey="Sliz P" first="Piotr" last="Sliz">Piotr Sliz</name>
<affiliation>
<nlm:aff id="a">Department of Biological Chemistry and Molecular Pharmacology,
<institution>Harvard Medical School</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="f">Laboratory of Molecular Medicine,
<institution>Children’s Hospital</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
</author>
</titleStmt>
<publicationStmt>
<idno type="wicri:source">PMC</idno>
<idno type="pmid">22349228</idno>
<idno type="pmc">3282622</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3282622</idno>
<idno type="RBID">PMC:3282622</idno>
<idno type="doi">10.1107/S0907444912001163</idno>
<date when="2012">2012</date>
<idno type="wicri:Area/Pmc/Corpus">000474</idno>
</publicationStmt>
<sourceDesc>
<biblStruct>
<analytic>
<title xml:lang="en" level="a" type="main">A grid-enabled web service for low-resolution crystal structure refinement</title>
<author>
<name sortKey="O Onovan, Daniel J" sort="O Onovan, Daniel J" uniqKey="O Onovan D" first="Daniel J." last="O Onovan">Daniel J. O Onovan</name>
<affiliation>
<nlm:aff id="a">Department of Biological Chemistry and Molecular Pharmacology,
<institution>Harvard Medical School</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Stokes Rees, Ian" sort="Stokes Rees, Ian" uniqKey="Stokes Rees I" first="Ian" last="Stokes-Rees">Ian Stokes-Rees</name>
<affiliation>
<nlm:aff id="a">Department of Biological Chemistry and Molecular Pharmacology,
<institution>Harvard Medical School</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Nam, Yunsun" sort="Nam, Yunsun" uniqKey="Nam Y" first="Yunsun" last="Nam">Yunsun Nam</name>
<affiliation>
<nlm:aff id="a">Department of Biological Chemistry and Molecular Pharmacology,
<institution>Harvard Medical School</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Blacklow, Stephen C" sort="Blacklow, Stephen C" uniqKey="Blacklow S" first="Stephen C." last="Blacklow">Stephen C. Blacklow</name>
<affiliation>
<nlm:aff id="a">Department of Biological Chemistry and Molecular Pharmacology,
<institution>Harvard Medical School</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="b">Department of Cancer Biology,
<institution>Dana Farber Cancer Institute</institution>
, Boston, MA 02215,
<country>USA</country>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="c">Department of Pathology,
<institution>Brigham and Women’s Hospital</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Schroder, Gunnar F" sort="Schroder, Gunnar F" uniqKey="Schroder G" first="Gunnar F." last="Schröder">Gunnar F. Schröder</name>
<affiliation>
<nlm:aff id="d">Forschungszentrum Jülich,
<institution>Institute of Complex Systems (ICS-6)</institution>
, 52425 Jülich,
<country>Germany</country>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Brunger, Axel T" sort="Brunger, Axel T" uniqKey="Brunger A" first="Axel T." last="Brunger">Axel T. Brunger</name>
<affiliation>
<nlm:aff id="e">Howard Hughes Medical Institute and Departments of Molecular and Cellular Physiology, Neurology and Neurological Sciences, Structural Biology and Photon Science,
<institution>Stanford School of Medicine</institution>
, J. H. Clark Center E300C, 318 Campus Drive, Stanford, CA 94305,
<country>USA</country>
</nlm:aff>
</affiliation>
</author>
<author>
<name sortKey="Sliz, Piotr" sort="Sliz, Piotr" uniqKey="Sliz P" first="Piotr" last="Sliz">Piotr Sliz</name>
<affiliation>
<nlm:aff id="a">Department of Biological Chemistry and Molecular Pharmacology,
<institution>Harvard Medical School</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
<affiliation>
<nlm:aff id="f">Laboratory of Molecular Medicine,
<institution>Children’s Hospital</institution>
, Boston, MA 02115,
<country>USA</country>
</nlm:aff>
</affiliation>
</author>
</analytic>
<series>
<title level="j">Acta Crystallographica Section D: Biological Crystallography</title>
<idno type="ISSN">0907-4449</idno>
<idno type="eISSN">1399-0047</idno>
<imprint>
<date when="2012">2012</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc>
<textClass></textClass>
</profileDesc>
</teiHeader>
<front>
<div type="abstract" xml:lang="en">
<p>The deformable elastic network (DEN) method for reciprocal-space crystallographic refinement improves crystal structures, especially at resolutions lower than 3.5 Å. The DEN web service presented here intends to provide structural biologists with access to resources for running computationally intensive DEN refinements.</p>
</div>
</front>
<back>
<div1 type="bibliography">
<listBibl>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="research-article">
<pmc-dir>properties open_access</pmc-dir>
<front>
<journal-meta>
<journal-id journal-id-type="nlm-ta">Acta Crystallogr D Biol Crystallogr</journal-id>
<journal-id journal-id-type="publisher-id">Acta Cryst. D</journal-id>
<journal-title-group>
<journal-title>Acta Crystallographica Section D: Biological Crystallography</journal-title>
</journal-title-group>
<issn pub-type="ppub">0907-4449</issn>
<issn pub-type="epub">1399-0047</issn>
<publisher>
<publisher-name>International Union of Crystallography</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="pmid">22349228</article-id>
<article-id pub-id-type="pmc">3282622</article-id>
<article-id pub-id-type="publisher-id">dz5246</article-id>
<article-id pub-id-type="doi">10.1107/S0907444912001163</article-id>
<article-id pub-id-type="coden">ABCRE6</article-id>
<article-id pub-id-type="pii">S0907444912001163</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Research Papers</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>A grid-enabled web service for low-resolution crystal structure refinement</article-title>
<alt-title>DEN web service</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>O’Donovan</surname>
<given-names>Daniel J.</given-names>
</name>
<xref ref-type="aff" rid="a">a</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Stokes-Rees</surname>
<given-names>Ian</given-names>
</name>
<xref ref-type="aff" rid="a">a</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Nam</surname>
<given-names>Yunsun</given-names>
</name>
<xref ref-type="aff" rid="a">a</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Blacklow</surname>
<given-names>Stephen C.</given-names>
</name>
<xref ref-type="aff" rid="a">a</xref>
<xref ref-type="aff" rid="b">b</xref>
<xref ref-type="aff" rid="c">c</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Schröder</surname>
<given-names>Gunnar F.</given-names>
</name>
<xref ref-type="aff" rid="d">d</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Brunger</surname>
<given-names>Axel T.</given-names>
</name>
<xref ref-type="aff" rid="e">e</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Sliz</surname>
<given-names>Piotr</given-names>
</name>
<xref ref-type="aff" rid="a">a</xref>
<xref ref-type="aff" rid="f">f</xref>
<xref ref-type="corresp" rid="cor">*</xref>
</contrib>
<aff id="a">
<label>a</label>
Department of Biological Chemistry and Molecular Pharmacology,
<institution>Harvard Medical School</institution>
, Boston, MA 02115,
<country>USA</country>
</aff>
<aff id="b">
<label>b</label>
Department of Cancer Biology,
<institution>Dana Farber Cancer Institute</institution>
, Boston, MA 02215,
<country>USA</country>
</aff>
<aff id="c">
<label>c</label>
Department of Pathology,
<institution>Brigham and Women’s Hospital</institution>
, Boston, MA 02115,
<country>USA</country>
</aff>
<aff id="d">
<label>d</label>
Forschungszentrum Jülich,
<institution>Institute of Complex Systems (ICS-6)</institution>
, 52425 Jülich,
<country>Germany</country>
</aff>
<aff id="e">
<label>e</label>
Howard Hughes Medical Institute and Departments of Molecular and Cellular Physiology, Neurology and Neurological Sciences, Structural Biology and Photon Science,
<institution>Stanford School of Medicine</institution>
, J. H. Clark Center E300C, 318 Campus Drive, Stanford, CA 94305,
<country>USA</country>
</aff>
<aff id="f">
<label>f</label>
Laboratory of Molecular Medicine,
<institution>Children’s Hospital</institution>
, Boston, MA 02115,
<country>USA</country>
</aff>
</contrib-group>
<author-notes>
<corresp id="cor">Correspondence e-mail:
<email>sliz@hkl.hms.harvard.edu</email>
</corresp>
</author-notes>
<pub-date pub-type="ppub">
<day>01</day>
<month>3</month>
<year>2012</year>
</pub-date>
<pub-date pub-type="epub">
<day>14</day>
<month>2</month>
<year>2012</year>
</pub-date>
<pub-date pub-type="pmc-release">
<day>14</day>
<month>2</month>
<year>2012</year>
</pub-date>
<pmc-comment> PMC Release delay is 0 months and 0 days and was based on the . </pmc-comment>
<volume>68</volume>
<issue>Pt 3</issue>
<issue-id pub-id-type="publisher-id">d120300</issue-id>
<fpage>261</fpage>
<lpage>267</lpage>
<history>
<date date-type="received">
<day>09</day>
<month>11</month>
<year>2011</year>
</date>
<date date-type="accepted">
<day>10</day>
<month>1</month>
<year>2012</year>
</date>
</history>
<permissions>
<copyright-statement>© O'Donovan et al. 2012</copyright-statement>
<copyright-year>2012</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/2.0/uk/">
<license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original authors and source are cited.</license-p>
</license>
</permissions>
<self-uri xlink:type="simple" xlink:href="http://dx.doi.org/10.1107/S0907444912001163">A full version of this article is available from Crystallography Journals Online.</self-uri>
<abstract abstract-type="toc">
<p>The deformable elastic network (DEN) method for reciprocal-space crystallographic refinement improves crystal structures, especially at resolutions lower than 3.5 Å. The DEN web service presented here intends to provide structural biologists with access to resources for running computationally intensive DEN refinements.</p>
</abstract>
<abstract>
<p>Deformable elastic network (DEN) restraints have proved to be a powerful tool for refining structures from low-resolution X-ray crystallographic data sets. Unfortunately, optimal refinement using DEN restraints requires extensive calculations and is often hindered by a lack of access to sufficient computational resources. The DEN web service presented here intends to provide structural biologists with access to resources for running computationally intensive DEN refinements in parallel on the Open Science Grid, the US cyberinfrastructure. Access to the grid is provided through a simple and intuitive web interface integrated into the SBGrid Science Portal. Using this portal, refinements combined with full parameter optimization that would take many thousands of hours on standard computational resources can now be completed in several hours. An example of the successful application of DEN restraints to the human Notch1 transcriptional complex using the grid resource, and summaries of all submitted refinements, are presented as justification.</p>
</abstract>
<kwd-group>
<kwd>deformable elastic network restraints</kwd>
<kwd>low-resolution refinement</kwd>
<kwd>DEN refinement</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="sec1">
<label>1.</label>
<title>Introduction</title>
<p>Larger macromolecules tend to produce crystals that diffract weakly (Fig. 1
<xref ref-type="fig" rid="fig1"></xref>
). As interest in these large assemblies grows, the range of methods for determining structures from these weakly diffracting crystals is also growing. Refinement of structures at resolutions lower than 3.5 Å is known to be difficult and error-prone, although careful investigations can produce good results (Brunger
<italic>et al.</italic>
, 2009
<xref ref-type="bibr" rid="bb6"></xref>
). Often, it is more convenient for structural biologists to pursue a ‘divide-and-conquer’ approach in which fragments of a larger molecule are solved independently and then used to reconstruct the larger assembly. Using a threshold of 3.5 Å resolution, there are approximately 1000 structures in the Protein Data Bank (Berman
<italic>et al.</italic>
, 2000
<xref ref-type="bibr" rid="bb1"></xref>
) which fall into this category. These structures represent less than 2% of the 68 140 total structures currently in the database. It is believed that the advent of new computational methods for low-resolution refinement will allow more structures to be refined from data recorded at resolutions that were previously believed to be unusable.</p>
<p>The deformable elastic network (DEN) method for reciprocal-space crystallographic refinement improves crystal structures, especially at resolutions lower than 3.5 Å and in cases where the initial structure is far from the target (Schröder
<italic>et al.</italic>
, 2010
<xref ref-type="bibr" rid="bb13"></xref>
). In this resolution range, overfitting becomes a significant problem because the number of experimental observations (Bragg intensities) can be smaller than the number of free torsion angles (
<italic>e.g.</italic>
for a protein, ϕ and ψ backbone torsion angles and rotatable side-chain torsion angles) that the refinement process attempts to fit. The DEN approach reduces overfitting by using a reference-model structure. This reference model is typically a homology model or a structure of the protein in a different conformation, or simply the starting structure for the refinement. A set of harmonic distance restraints are defined for a sparse set of randomly chosen pairs of atoms in the reference model, creating an elastic network. During the refinement process the equilibrium distances of the harmonic restraints are allowed to deform so as to better fit the diffraction data.</p>
<p>The DEN-refinement process is controlled by several important parameters that can affect the success of the method. Those parameters include a weight (ω
<sub>DEN</sub>
) that determines the effect of the DEN restraints on the refinement relative to the other terms of the target function used for refinement, the deformation factor γ
<sub>DEN</sub>
and the simulated-annealing temperature. The ω
<sub>DEN</sub>
parameter can range from 0 to 300. When ω
<sub>DEN</sub>
= 0 the DEN restraints have no effect on the refinement process, and when ω
<sub>DEN</sub>
= 300 and γ
<sub>DEN</sub>
= 0 the DEN term is high enough to effectively restrain the refined structure to the reference model. A suitable ω
<sub>DEN</sub>
in the range between 0 and 300 will need to be determined in each case and will depend on the overall similarity between the refined structure and its reference model. The γ
<sub>DEN</sub>
parameter can range from 0 to 1 and at larger γ
<sub>DEN</sub>
values the DEN distances can eventually significantly deviate from the reference model during the DEN-refinement process. This deformation is justified through the observation that local protein structure tends to evolve at a slower rate than sequence and function (Schröder
<italic>et al.</italic>
, 2010
<xref ref-type="bibr" rid="bb13"></xref>
).</p>
<p>In addition, for each parameter combination several refinement repeats should be performed with different initial random-number seeds for the simulated-annealing process and the random selection of DEN distances, since DEN refinement is an inherently stochastic search process. Currently, optimal choices for these values should be obtained by an exhaustive grid search of the parameter space, although in the future guidelines may be developed to make the search more efficient based on growing experience with the DEN method. In a complete parameter search many thousands of individual parameter choices must be evaluated and each run must be executed to completion. Depending on the number of parameters being searched and the range and accuracy desired in these parameters, DEN refinements often result in many thousands of independent refinement calculations. A single refinement calculation (with one set of parameters) may require several hours of serial processing time on a modern processor depending on the unit-cell content and the limiting resolution of the crystal, with the implication that a full DEN computation could require of the order of one year of serial computational time for the largest macromolecular crystal structures. Such computational demands put DEN beyond the capacity of desktop computing resources and require access to large computer clusters.</p>
<p>Grid computing provides an attractive approach to support the widespread implementation of DEN refinement. We have previously developed the SBGrid Science Portal (
<ext-link ext-link-type="uri" xlink:href="https://portal.sbgrid.org">http://sbgrid.org</ext-link>
) to provide a standard framework that can support specialized structure-determination computations such as wide-search molecular replacement (Stokes-Rees & Sliz, 2010
<xref ref-type="bibr" rid="bb15"></xref>
). The computational power of the portal is provided by the extensive opportunistic resources of the Open Science Grid (OSG; Pordes
<italic>et al.</italic>
, 2007
<xref ref-type="bibr" rid="bb11"></xref>
). OSG federated resources include large computing clusters at over 50 research institutions; major computational sites utilized by SBGrid include the University of Nebraska-Lincoln, Purdue University and Clemson University. The science portal consists of a Django-driven web interface with LDAP user authentication allowing SSH, WebDAV and S/FTP access to data. The grid interface is powered by Condor (Thain
<italic>et al.</italic>
, 2005
<xref ref-type="bibr" rid="bb16"></xref>
) and is linked to the portal through the
<italic>django-condor</italic>
application. The Virtual Data Toolkit (Roy, 2009
<xref ref-type="bibr" rid="bb12"></xref>
) and GlideinWMS (Sfiligoi
<italic>et al.</italic>
, 2009
<xref ref-type="bibr" rid="bb14"></xref>
) through the GlideIn factory at the University of California at San Diego allow many thousands of unique Condor tasks to be processed through the portal every day.</p>
<p>In this paper, we report an extension of the SBGrid Science Portal to support the DEN-refinement method. The DEN web service can complete an entire DEN refinement with full parameter search within ∼10 h (when grid resources are not saturated) through the utilization of OSG resources. A web interface has been developed that allows users to upload the required data files [a user-edited
<italic>CNS</italic>
(Brünger
<italic>et al.</italic>
, 1998
<xref ref-type="bibr" rid="bb4"></xref>
)
<monospace>refine_den.inp</monospace>
refinement script and required diffraction data and models] and control other parameters that determine the extent of the grid search. Upon completion of all refinements, the results are presented to the user in a sortable table through the web interface with a series of heat-map plots. The DEN web service was initially tested for its utility in refinement of a Notch transcriptional complex at 3.85 Å resolution and has been further tested and validated by DEN refinements submitted by users. A blind analysis of these initial runs was performed and indicated a significant improvement in
<italic>R</italic>
<sub>free</sub>
values for most submitted jobs. The SBGrid Science Portal will make the method of DEN refinement immediately available to the structural biology community and will also provide a wealth of information useful for further optimization of the DEN method.</p>
</sec>
<sec id="sec2">
<label>2.</label>
<title>Submitting DEN-refinement jobs</title>
<sec id="sec2.1">
<label>2.1.</label>
<title>Registration</title>
<p>The SBGrid Science Portal requires that all users register. Registration is needed to ensure legitimate and secure use of global computing resources and allows users to access a secure workspace for all their portal-based data and com­putations. Owing to the length of time required for DEN refinements, the account system allows users to return to the portal and track the progress of one or more previously submitted computations.</p>
</sec>
<sec id="sec2.2">
<label>2.2.</label>
<title>Preparation</title>
<p>A DEN-refinement optimization requires a diffraction data set, a coordinate file with an initial model and a coordinate file with a reference structure (which could also be the initial model). The initial model is typically obtained by molecular replacement or by the fitting of electron-density maps phased by experimental phasing methods and can combine molecular-replacement fragments and
<italic>de novo</italic>
modeled structures. The reference structure can be provided by a previously refined higher resolution coordinate file with an identical or a related sequence or a model generated by software such as
<italic>Desmond</italic>
(Bowers
<italic>et al.</italic>
, 2006
<xref ref-type="bibr" rid="bb2"></xref>
) or
<italic>Modeller</italic>
(Eswar
<italic>et al.</italic>
, 2006
<xref ref-type="bibr" rid="bb7"></xref>
). In general, the reference structure represents the prior knowledge of the structure. Reference structures can be in an arbitrary orientation and position since DEN distances are invariant with respect to the placement of the reference model. If the reference model consists of several domains or independent molecules, the relative placement of these components can be arbitrary as well if the default-sequence and chain-separation selections are used (Schröder
<italic>et al.</italic>
, 2010
<xref ref-type="bibr" rid="bb13"></xref>
). However, if the distance selections are sparse random drawings from all possible interatomic distances then the relative placements of the components in the reference model are important.</p>
<p>Two mandatory files need to be prepared by the user before portal submission: a DEN-refinement input file based on the template
<monospace>refine_den.inp</monospace>
from the DEN tutorial of the
<italic>CNS</italic>
website and included with the
<italic>CNS</italic>
v.1.3 distribution, and an archive file containing all the data files referenced by the
<italic>CNS</italic>
input file, including the diffraction data set, the initial model and reference coordinates and any other files that are required by the refinement job, such as special parameter files or noncrystallographic symmetry files. The DEN-input file must be modified to reference the diffraction data set, the initial model and the reference structure. All values in this input file are conserved during the DEN optimization as are parameters such as the starting temperature for the simulated annealing (
<italic>temperature</italic>
) or the number of refinement macrocycles. The archive file can be in any common file-compression format. Detailed instructions on how to prepare the DEN-input file can be found in the DEN tutorial on the
<italic>CNS</italic>
website (
<ext-link ext-link-type="uri" xlink:href="http://www.cns-online.org">http://www.cns-online.org</ext-link>
). Once the DEN-input file and all accessory files have been prepared, running a single iteration of DEN refinement on a local machine is highly recommended in order to ensure that the file is correct and does not produce errors.</p>
</sec>
<sec id="sec2.3">
<label>2.3.</label>
<title>Submission and monitoring</title>
<p>The DEN-refinement computation is initiated through the SBGrid Science Portal, which provides a web form to name and describe the computation, upload necessary files prepared as described in §2.2
<xref ref-type="sec" rid="sec2.2"></xref>
and provide other computation configurations (see Fig. 2
<xref ref-type="fig" rid="fig2"></xref>
). The uploaded files are checked for correctness and consistency.</p>
<p>The web form also provides an option to perform an additional annealing-temperature optimization (the default is to use the temperature specified in the DEN-refinement input file). There are also input fields for the number of initial random-number seeds (for the velocity assignments of the simulated-annealing runs and the random selection of DEN distances) and for setting the resolution of the diffraction data for the
<italic>PROCHECK</italic>
(Laskowski
<italic>et al.</italic>
, 1993
<xref ref-type="bibr" rid="bb9"></xref>
) score.</p>
<p>Submitting the form uploads the data and parameters, performs the checks and, provided the checks pass, queues the computation for execution on OSG. Grid execution is monitored
<italic>via</italic>
the
<italic>django</italic>
<italic>condor</italic>
application bridge and when all jobs have finished executing, results are generated and the user is notified by e-mail.</p>
</sec>
<sec id="sec2.4">
<label>2.4.</label>
<title>DEN optimization</title>
<p>DEN-refinement parameter optimization follows the originally described brute-force strategy (Schröder
<italic>et al.</italic>
, 2010
<xref ref-type="bibr" rid="bb13"></xref>
). This takes all permutations of each parameter over a fixed range of values, conventionally known as a ‘parameter sweep’. The optimized parameter set is that which will lead to the lowest
<italic>R</italic>
<sub>free</sub>
(Brünger, 1992
<xref ref-type="bibr" rid="bb3"></xref>
) value after the DEN refinement (among the multiple repeat refinements for each particular set, the refinement with the lowest
<italic>R</italic>
<sub>free</sub>
will be considered for that particular set). In addition, a
<italic>PROCHECK</italic>
validation is performed to provide extra assurance of the validity of the refined structure through the Ramachandran percentage ‘disallowed’ score and to enable the user to choose between structures that have similar
<italic>R</italic>
<sub>free</sub>
values.</p>
<p>The parameters being varied to produce an optimal
<italic>R</italic>
<sub>free</sub>
in a DEN run are γ
<sub>DEN</sub>
, ω
<sub>DEN</sub>
and
<italic>n</italic>
<sub>seed</sub>
, the number of unique seed values for the random-number generator. The special case of ω
<sub>DEN</sub>
= 0 is known as ‘no DEN’ and can be used as a control for comparing results when the DEN restraints are turned off. Optionally, temperature can also be varied to optimize
<italic>R</italic>
<sub>free</sub>
; doing this will perform DEN refinements for a range of starting temperatures.</p>
<p>Following Schröder
<italic>et al.</italic>
(2010
<xref ref-type="bibr" rid="bb13"></xref>
), the DEN-refinement optimization protocol uses (0, 0.25, 0.5, 0.75, 1.0) for the γ
<sub>DEN</sub>
parameter and six values of ω
<sub>DEN</sub>
(3, 15, 30, 60, 150, 300). As the DEN-refinement process is inherently stochastic, it is important to test a range of randomly chosen random-number seeds for the refinement, which has been set to a default value of 20 seeds. This search space for parameter optimization for DEN refinement covers 600 individual refinement computations (5 × 6 × 20). When the
<italic>temperature</italic>
parameter is turned on, runs are started at one of six different starting temperatures (300, 600, 1200, 2000, 2500, 3000), requiring 3600 refinements. If the control (DEN = 0) is included, an additional
<italic>n</italic>
<sub>seed</sub>
refinements are performed with ω
<sub>DEN</sub>
= 0 and γ
<sub>DEN</sub>
= 0 and the default temperature in the input file.</p>
</sec>
<sec id="sec2.5">
<label>2.5.</label>
<title>Analyzing output and finishing refinement</title>
<p>Once the DEN-refinement task has completed, the user is sent a notification e-mail containing a link to the results page. The results will consist of a set of heat maps showing the best
<italic>R</italic>
<sub>free</sub>
under different parameter conditions, a table displaying all salient results and output data files. For each given
<italic>temperature</italic>
, γ
<sub>DEN</sub>
and ω
<sub>DEN</sub>
there will be
<italic>n</italic>
<sub>seed</sub>
repeated jobs; the heat map presents the best
<italic>R</italic>
<sub>free</sub>
chosen from these
<italic>n</italic>
<sub>seed</sub>
runs (blue implies a lower
<italic>R</italic>
<sub>free</sub>
and red a higher
<italic>R</italic>
<sub>free</sub>
). The Ramachandran heat map presents the percentage of residues in the disallowed region of the Ramachandran plot (from the structure with the best
<italic>R</italic>
<sub>free</sub>
value for each γ
<sub>DEN</sub>
, ω
<sub>DEN</sub>
parameter pair). The results from all runs are presented in a sortable table, which also includes html links to the refined coordinates, Fourier coefficients for map calculations and
<italic>PROCHECK</italic>
summary files. To save load times, initially the best 50 results (in terms of
<italic>R</italic>
<sub>free</sub>
) are presented, but a link to the entire results list is provided. From these collected results, the user is able to choose the most promising (typically based on lowest
<italic>R</italic>
<sub>free</sub>
) and use this for subsequent remodeling and refinement cycles. Additional rounds of DEN refinement can be performed as needed, although most of the benefit of DEN refinement is generally observed in the first round when the initial model is still far from the target structure.</p>
</sec>
</sec>
<sec id="sec3">
<label>3.</label>
<title>Example: Notch transcriptional complex</title>
<p>Activated Notch signaling is important for various cell-fate decisions and leads to the assembly of a multi-protein complex on DNA that can promote transcription of downstream genes. The structure of a human Notch1 transcriptional complex was initially determined using anisotropic diffraction at a resolution between 4.2 and 7 Å by combining molecular replacement with selenomethionine-scanning mutagenesis (Fig. 3
<xref ref-type="fig" rid="fig3"></xref>
<italic>a</italic>
). Ultimately, crystals diffracting to 3.25 Å resolution were obtained and the refined coordinates confirmed the essential architectural features of the earlier 4.2–7 Å model (Nam
<italic>et al.</italic>
, 2006
<xref ref-type="bibr" rid="bb10"></xref>
). More recently, we crystallized a Notch transcriptional complex in the presence of the RAM region of Notch1, which engages the transcription factor (called CSL) at a different site from the ankyrin-repeat domain of Notch1 present in the previously reported structure (Wilson & Kovall, 2006
<xref ref-type="bibr" rid="bb17"></xref>
; Friedmann
<italic>et al.</italic>
, 2008
<xref ref-type="bibr" rid="bb8"></xref>
). The 3.85 Å resolution data set produced from these crystals was used to test the portal-based DEN-refinement optimization protocol. Over 28 000 h of com­puting time was used to complete this DEN run in 8 h, a 3500-fold speedup over serial computation. The heat maps for the refined coordinates are presented in Figs. 3
<xref ref-type="fig" rid="fig3"></xref>
(
<italic>b</italic>
) and 3
<xref ref-type="fig" rid="fig3"></xref>
(
<italic>c</italic>
). These figures show that the best refinements occurred with higher values of ω
<sub>DEN</sub>
and with a γ
<sub>DEN</sub>
of 0.8. The high values of ω
<sub>DEN</sub>
imply that the reference model provided a good template for the RAM structure, although flexibility was still required to allow adjustments. Indeed, the C
<sup>α</sup>
root-mean-square deviation between the refined coordinates and the reference model is only 0.38 Å and differences between the two structures are limited to loop regions. A detailed description of the complex structure and relevant biochemistry is presented separately (Choi
<italic>et al.</italic>
, 2012
<xref ref-type="bibr" rid="bb5"></xref>
). A histogram showing all of the
<italic>R</italic>
<sub>free</sub>
scores calculated from a complete DEN optimization of the Notch1 complex is shown in Fig. 3
<xref ref-type="fig" rid="fig3"></xref>
(
<italic>d</italic>
).</p>
</sec>
<sec id="sec4">
<label>4.</label>
<title>Current status</title>
<p>To date, more than 60 unique DEN-refinement optimizations with different structures or refinement scripts have been submitted through the SBGrid Science Portal by ten researchers. More than 80 years of CPU execution time have been used by these jobs. Most values in the portal DEN refinement resulted in an improvement in
<italic>R</italic>
<sub>free</sub>
, but a significant number of values showed no improvement in
<italic>R</italic>
<sub>free</sub>
. Fig. 4
<xref ref-type="fig" rid="fig4"></xref>
is a scatter chart showing each task submitted and completed on the DEN portal to date. The
<italic>x</italic>
axis corresponds to the resulting
<italic>R</italic>
<sub>free</sub>
scores when run with ω
<sub>DEN</sub>
= 0 and γ
<sub>DEN</sub>
= 0,
<italic>i.e.</italic>
 control or ‘no DEN’ runs; the
<italic>y</italic>
axis shows the most improved values of
<italic>R</italic>
<sub>free</sub>
. The diagonal line plots where
<italic>R</italic>
<sub>free</sub>
(optimum) is equal to
<italic>R</italic>
<sub>free</sub>
(no DEN). As all points lie below this line, we see that all tasks showed an improvement in
<italic>R</italic>
<sub>free</sub>
.</p>
</sec>
<sec id="sec5">
<label>5.</label>
<title>Implementation</title>
<p>The public-serving frontend to the SBGrid Portal is written in Python using the Django web framework. The DEN code base consists of a Python-written Django application (or ‘app’) that integrates with the existing Portal code and negotiates with the Condor job scheduler
<italic>via</italic>
the
<italic>django–condor</italic>
application, also written in Python. Through an Apache process running on the SBGrid Portal, the Django-based website allows the DEN application to serve the DEN web pages. Python code integrated into the DEN application verifies and checks the input data files and user input data, creates submission scripts, launches DEN jobs on the grid and collects and processes the resultant information from DEN jobs. The application also updates a MySQL database (MySQL AB, Uppsala, Sweden;
<ext-link ext-link-type="uri" xlink:href="http://www.mysql.com">http://www.mysql.com</ext-link>
) which is used for logging and tracking all tasks. The code was written using the Enthought Python 2.7 distribution and Django 1.3.1, although earlier versions (to v.2.5) of Python are expected to function correctly.</p>
<p>The code is available for inspection from the SBGrid Portal home page (
<ext-link ext-link-type="uri" xlink:href="http://portal.sbgrid.org">http://portal.sbgrid.org</ext-link>
) and relies on portions of the Portal code base.</p>
</sec>
<sec id="sec6">
<label>6.</label>
<title>Conclusions</title>
<p>Many multicomponent biologically important complexes can be crystallized, but structural interpretation is often limited by low-resolution diffraction data. The DEN-refinement optimization provides a useful tool for interpretation of diffraction data that might otherwise be uninformative. The optimization protocol provides refined models with optimal
<italic>R</italic>
<sub>free</sub>
values and geometry-validation scores that guide further refinement strategies. In the majority of completed DEN tasks, including the initial refinement of the Notch transcriptional complex, the grid DEN refinement resulted in a further decrease in
<italic>R</italic>
<sub>free</sub>
compared with the starting structure and compared with controls without DEN restraints.</p>
<p>The DEN portal provides an interface with the vast computing resources available on the grid. There are several barriers that users must hurdle before being able to execute a successful DEN refinement. DEN refinements rely on a suitable model with prior structural information. When there is no known structure of high similarity a model must be generated, the production of which can be difficult and error-prone. To completely master the refinement steps, a familiarity with the
<italic>CNS</italic>
program is needed; the DEN portal only performs
<italic>CNS</italic>
refinement tasks. Thus, the DEN refinement must be tested before submitting it to the DEN portal.</p>
<p>An additional consequence of calculating structures using DEN restraints is likely to emerge from consideration of the potentially interesting patterns found in the DEN refinements submitted by the user community. Through investigation of these results and patterns, more will eventually be understood about the optimal conditions for DEN refinement, leading to a less computationally intensive method for optimizing these parameters in the future. For example, it seems that more than half of the search space rarely produces good results, and similar results are often obtained for fairly broad regions. By performing line searches rather than full two- or three-dimensional searches, the overall computational cost of the experiment could be significantly reduced while still obtaining a close-to-optimum solution. Thus, it may be possible to reduce the DEN-parameter optimization to something that can run on a desktop computer within a reasonable time frame.</p>
<p>Even the smallest parameter searches suggested by Schröder
<italic>et al.</italic>
(2010
<xref ref-type="bibr" rid="bb13"></xref>
) demand thousands of DEN refinements. Researchers will often increase this number in the search for an optimal structure. The resulting computational workflows are simply impossible to calculate using a single modern personal computer. It is believed that the grid technology presented in this paper will be an important tool for researchers to determine good-quality structures from low-resolution diffraction data. Data sets that have previously been discarded because there was no method for producing reasonable structures can now be revisited using the DEN portal.</p>
</sec>
</body>
<back>
<ack>
<p>This research was performed using resources provided by the Open Science Grid, which is supported by the National Science Foundation and the US Department of Energy’s Office of Science. This work was supported by the National Science Foundation grant
<award-id>0639193</award-id>
(PS).</p>
</ack>
<ref-list>
<title>References</title>
<ref id="bb1">
<mixed-citation publication-type="other">Berman, H. M., Westbrook, J., Feng, Z., Gilliland, G., Bhat, T. N., Weissig, H., Shindyalov, I. N. & Bourne, P. E. (2000).
<italic>Nucleic Acids Res.</italic>
<bold>28</bold>
, 235–242.</mixed-citation>
</ref>
<ref id="bb2">
<mixed-citation publication-type="other">Bowers, K. J., Chow, E., Xu, H., Dror, R. O., Eastwood, M. P., Gregersen, B. A., Klepeis, J. L., Kolossvary, I., Moraes, M. A., Sacerdoti, F. D., Salmon, J. K., Shan, Y. & Shaw, D. E. (2006).
<italic>Proceedings of the 2006 ACM/IEEE Conference on Supercomputing</italic>
, Article No. 84. New York: ACM.</mixed-citation>
</ref>
<ref id="bb3">
<mixed-citation publication-type="other">Brünger, A. T. (1992).
<italic>Nature (London)</italic>
,
<bold>355</bold>
, 472–475.</mixed-citation>
</ref>
<ref id="bb4">
<mixed-citation publication-type="other">Brünger, A. T., Adams, P. D., Clore, G. M., DeLano, W. L., Gros, P., Grosse-Kunstleve, R. W., Jiang, J.-S., Kuszewski, J., Nilges, M., Pannu, N. S., Read, R. J., Rice, L. M., Simonson, T. & Warren, G. L. (1998).
<italic>Acta Cryst.</italic>
D
<bold>54</bold>
, 905–921.</mixed-citation>
</ref>
<ref id="bb6">
<mixed-citation publication-type="other">Brunger, A. T., DeLaBarre, B., Davies, J. M. & Weis, W. I. (2009).
<italic>Acta Cryst.</italic>
D
<bold>65</bold>
, 128–133.</mixed-citation>
</ref>
<ref id="bb5">
<mixed-citation publication-type="other">Choi, S. H., Wales, T. E., Nam, Y., O’Donovan, D., Sliz, P., Engen, J. R. & Blacklow, S. C. (2012).
<italic>Structure</italic>
,
<bold>20</bold>
, 340–349.</mixed-citation>
</ref>
<ref id="bb7">
<mixed-citation publication-type="other">Eswar, N., Marti-Renom, M. A., Webb, B., Madhusudhan, M. S., Eramian, D., Shen, M., Pieper, U. & Sali, A. (2006).
<italic>Current Protocols in Bioinformatics</italic>
, edited by A. D. Baxevanis, L. D. Stein, G. D. Stormo & J. R. Yates III, Unit 5.6. New York: Wiley.</mixed-citation>
</ref>
<ref id="bb8">
<mixed-citation publication-type="other">Friedmann, D. R., Wilson, J. J. & Kovall, R. A. (2008).
<italic>J. Biol. Chem.</italic>
<bold>283</bold>
, 14781–14791.</mixed-citation>
</ref>
<ref id="bb9">
<mixed-citation publication-type="other">Laskowski, R. A., MacArthur, M. W., Moss, D. S. & Thornton, J. M. (1993).
<italic>J. Appl. Cryst.</italic>
<bold>26</bold>
, 283–291.</mixed-citation>
</ref>
<ref id="bb10">
<mixed-citation publication-type="other">Nam, Y., Sliz, P., Song, L., Aster, J. C. & Blacklow, S. C. (2006).
<italic>Cell</italic>
,
<bold>124</bold>
, 973–983.</mixed-citation>
</ref>
<ref id="bb11">
<mixed-citation publication-type="other">Pordes, R.
<italic>et al.</italic>
(2007).
<italic>J. Phys. Conf. Ser.</italic>
<bold>78</bold>
, 012057.</mixed-citation>
</ref>
<ref id="bb12">
<mixed-citation publication-type="other">Roy, A. (2009).
<italic>J. Phys. Conf. Ser.</italic>
<bold>180</bold>
, 012052.</mixed-citation>
</ref>
<ref id="bb13">
<mixed-citation publication-type="other">Schröder, G. F., Levitt, M. & Brunger, A. T. (2010).
<italic>Nature (London)</italic>
,
<bold>464</bold>
, 1218–1222.</mixed-citation>
</ref>
<ref id="bb14">
<mixed-citation publication-type="other">Sfiligoi, I., Bradley, D. C., Holzman, B., Mhashilkar, P., Padhi, S. & Wurthwein, F. (2009).
<italic>2009 WRI World Congress on Computer Science and Information Engineering</italic>
, Vol. 2, edited by M. Burgin, M. H. Chowdhury, C. H. Ham, S. Ludwig, W. Su & S. Yenduri, pp. 428–432. Los Alamitos: IEEE Computer Society.</mixed-citation>
</ref>
<ref id="bb15">
<mixed-citation publication-type="other">Stokes-Rees, I. & Sliz, P. (2010).
<italic>Proc. Natl Acad. Sci. USA</italic>
,
<bold>107</bold>
, 21476–21481.</mixed-citation>
</ref>
<ref id="bb16">
<mixed-citation publication-type="other">Thain, D., Tannenbaum, T. & Livny, M. (2005).
<italic>Concur. Comput. Pract. Exp.</italic>
<bold>17</bold>
, 323–356.</mixed-citation>
</ref>
<ref id="bb17">
<mixed-citation publication-type="other">Wilson, J. J. & Kovall, R. A. (2006).
<italic>Cell</italic>
,
<bold>124</bold>
, 985–996.</mixed-citation>
</ref>
</ref-list>
</back>
<floats-group>
<fig id="fig1" position="float">
<label>Figure 1</label>
<caption>
<p>Heat map showing how (X-ray-determined) Protein Data Bank (PDB) entries trend with data resolution and molecular weight. There are many structures recorded between 1.5 and 2.5 Å resolution with a molecular weight of around 40 kDa, indicated by a lighter color. The white dots represent the mean average resolutions for structures in 10 kDa ranges. This figure shows that larger molecules tend to have poorer resolutions. As the molecular weight of structures increases, the mean resolution of the recorded X-ray data also increases. The PDB only contains structures that have been finalized; therefore, there may be many more low-resolution data sets from crystals that did not yield publication-quality structures.</p>
</caption>
<graphic xlink:href="d-68-00261-fig1"></graphic>
</fig>
<fig id="fig2" position="float">
<label>Figure 2</label>
<caption>
<p>DEN Portal Application job-submission interface. This is the form through which registered users can submit new tasks to the Open Science Grid. The form requires a unique ‘task name’, DEN input file, data archive and the resolution of the diffraction data for
<italic>PROCHECK</italic>
validity checking. There are other optional parameters.</p>
</caption>
<graphic xlink:href="d-68-00261-fig2"></graphic>
</fig>
<fig id="fig3" position="float">
<label>Figure 3</label>
<caption>
<p>Test case: a Notch1 transcription complex containing the RAM region. (
<italic>a</italic>
) The first 4.2–7 Å low-resolution structure of a human Notch1 complex consisting of the Notch ankyrin-repeat domain, the CSL transcription factor and the Mastermind-like 1 (MAML-1) co-activator was determined by combining molecular replacement and selenomethionine scanning. Single Leu-to-Met or Val-to-Met mutations (labeled with the MAML-1 residue number) were introduced into the MAML-1 polypeptide for incorporation of selenomethionine. Anomalous Fourier difference maps were calculated for each of five mutants (the high-resolution limit for each data set was between 6 and 7.5 Å) using the anomalous signal from selenomethionine and the phase calculated by molecular replacement. Each map shows a clear peak at the predicted location of the mutated residue, indicated by the matching colors. The gray mesh represents the density for the MAML-1 as part of a 2
<italic>F</italic>
<sub>o</sub>
<italic>F</italic>
<sub>c</sub>
density map calculated without any atoms modeled for the MAML-1 helix. Adapted from the supplementary information in Nam
<italic>et al.</italic>
(2006
<xref ref-type="bibr" rid="bb10"></xref>
). (
<italic>b</italic>
) An
<italic>R</italic>
<sub>free</sub>
heat map of results from the Notch protein DEN optimization using an initial starting temperature of 1000 K. The minimal
<italic>R</italic>
<sub>free</sub>
values for each parameter pair (ω
<sub>DEN</sub>
and γ
<sub>DEN</sub>
) over multiple refinement repeats are shown. (
<italic>c</italic>
) The corresponding Ramachandran statistics (percentage of disallowed backbone angles). For each parameter pair, the structure with the lowest
<italic>R</italic>
<sub>free</sub>
value was usen to calculate the Ramachandran statistics. (
<italic>d</italic>
) A histogram showing all calculated
<italic>R</italic>
<sub>free</sub>
for a complete portal DEN optimization of the Notch1 complex. The dashed line is the best that could be achieved without DEN (
<italic>i.e.</italic>
, the lowest
<italic>R</italic>
<sub>free</sub>
of the all the ‘no DEN’ repeat refinements); the lowest (or best)
<italic>R</italic>
<sub>free</sub>
chosen is the far left tail of the histogram.</p>
</caption>
<graphic xlink:href="d-68-00261-fig3"></graphic>
</fig>
<fig id="fig4" position="float">
<label>Figure 4</label>
<caption>
<p>Chart showing
<italic>R</italic>
<sub>free</sub>
(optimum over all results) and
<italic>R</italic>
<sub>free</sub>
(no DEN; optimum over all control refinements without DEN) for all tasks submitted by users. Each point lies below the diagonal line, showing that all results demonstrated an improvement in
<italic>R</italic>
<sub>free</sub>
over the control results.</p>
</caption>
<graphic xlink:href="d-68-00261-fig4"></graphic>
</fig>
</floats-group>
</pmc>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/CyberinfraV1/Data/Pmc/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000474  | SxmlIndent | more

Ou

HfdSelect -h $EXPLOR_AREA/Data/Pmc/Corpus/biblio.hfd -nk 000474  | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Ticri/CIDE
   |area=    CyberinfraV1
   |flux=    Pmc
   |étape=   Corpus
   |type=    RBID
   |clé=     
   |texte=   
}}

Wicri

This area was generated with Dilib version V0.6.25.
Data generation: Thu Oct 27 09:30:58 2016. Site generation: Sun Mar 10 23:08:40 2024