The interplay of resource provisioning and workflow optimization in scientific applications
Identifieur interne : 000154 ( Istex/Checkpoint ); précédent : 000153; suivant : 000155The interplay of resource provisioning and workflow optimization in scientific applications
Auteurs : Gurmeet Singh [États-Unis] ; Ewa Deelman [États-Unis]Source :
- Concurrency and Computation: Practice and Experience [ 1532-0626 ] ; 2011-11.
English descriptors
- KwdEn :
Abstract
In this paper, we propose resource provisioning as the means to reduce the completion time of scientific workflows in a Grid environment. We propose task clustering as a form of workflow optimization that can be used along with provisioning in order to achieve this reduction in completion time. Provisioning can be done statically using advance reservations (ARs) or using dynamic provisioning mechanisms. A simulation is done using the Maui simulator, a workload trace collected from the NCSA Teragrid cluster and 13 workflows to study the effect of provisioning on the completion time of the scientific workflows. The results show in general a reduction of about 50% in the workflow completion time using provisioning for the First In First Out and fair share scheduling policies. In this paper, we also examine the cost of resource provisioning and propose a utilization‐based metric that can be used to guide the provisioning decisions in order to reduce the cost. Finally, we present the results of a survey on the support of AR at the Grid sites. Copyright © 2011 John Wiley & Sons, Ltd.
Url:
DOI: 10.1002/cpe.1735
Affiliations:
Links toward previous steps (curation, corpus...)
Links to Exploration step
ISTEX:09DE35AA7F410B7A836497A0F62E1D669D4319E4Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">The interplay of resource provisioning and workflow optimization in scientific applications</title>
<author><name sortKey="Singh, Gurmeet" sort="Singh, Gurmeet" uniqKey="Singh G" first="Gurmeet" last="Singh">Gurmeet Singh</name>
</author>
<author><name sortKey="Deelman, Ewa" sort="Deelman, Ewa" uniqKey="Deelman E" first="Ewa" last="Deelman">Ewa Deelman</name>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">ISTEX</idno>
<idno type="RBID">ISTEX:09DE35AA7F410B7A836497A0F62E1D669D4319E4</idno>
<date when="2011" year="2011">2011</date>
<idno type="doi">10.1002/cpe.1735</idno>
<idno type="url">https://api.istex.fr/document/09DE35AA7F410B7A836497A0F62E1D669D4319E4/fulltext/pdf</idno>
<idno type="wicri:Area/Istex/Corpus">000755</idno>
<idno type="wicri:Area/Istex/Curation">000755</idno>
<idno type="wicri:Area/Istex/Checkpoint">000154</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">The interplay of resource provisioning and workflow optimization in scientific applications</title>
<author><name sortKey="Singh, Gurmeet" sort="Singh, Gurmeet" uniqKey="Singh G" first="Gurmeet" last="Singh">Gurmeet Singh</name>
<affiliation wicri:level="4"><country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Information Sciences Institute, University of Southern California, CA</wicri:regionArea>
<placeName><region type="state">Californie</region>
<settlement type="city">Los Angeles</settlement>
</placeName>
<orgName type="university">Université de Californie du Sud</orgName>
</affiliation>
</author>
<author><name sortKey="Deelman, Ewa" sort="Deelman, Ewa" uniqKey="Deelman E" first="Ewa" last="Deelman">Ewa Deelman</name>
<affiliation wicri:level="4"><country xml:lang="fr">États-Unis</country>
<wicri:regionArea>Information Sciences Institute, University of Southern California, CA</wicri:regionArea>
<placeName><region type="state">Californie</region>
<settlement type="city">Los Angeles</settlement>
</placeName>
<orgName type="university">Université de Californie du Sud</orgName>
</affiliation>
</author>
</analytic>
<monogr></monogr>
<series><title level="j">Concurrency and Computation: Practice and Experience</title>
<title level="j" type="abbrev">Concurrency Computat.: Pract. Exper.</title>
<idno type="ISSN">1532-0626</idno>
<idno type="eISSN">1532-0634</idno>
<imprint><publisher>John Wiley & Sons, Ltd.</publisher>
<pubPlace>Chichester, UK</pubPlace>
<date type="published" when="2011-11">2011-11</date>
<biblScope unit="volume">23</biblScope>
<biblScope unit="issue">16</biblScope>
<biblScope unit="page" from="1969">1969</biblScope>
<biblScope unit="page" to="1989">1989</biblScope>
</imprint>
<idno type="ISSN">1532-0626</idno>
</series>
<idno type="istex">09DE35AA7F410B7A836497A0F62E1D669D4319E4</idno>
<idno type="DOI">10.1002/cpe.1735</idno>
<idno type="ArticleID">CPE1735</idno>
</biblStruct>
</sourceDesc>
<seriesStmt><idno type="ISSN">1532-0626</idno>
</seriesStmt>
</fileDesc>
<profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>Grid computing</term>
<term>advance reservations</term>
<term>resource allocation</term>
<term>resource provisioning</term>
<term>resource utilization</term>
<term>scheduling</term>
<term>scientific workflows</term>
</keywords>
</textClass>
<langUsage><language ident="en">en</language>
</langUsage>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en">In this paper, we propose resource provisioning as the means to reduce the completion time of scientific workflows in a Grid environment. We propose task clustering as a form of workflow optimization that can be used along with provisioning in order to achieve this reduction in completion time. Provisioning can be done statically using advance reservations (ARs) or using dynamic provisioning mechanisms. A simulation is done using the Maui simulator, a workload trace collected from the NCSA Teragrid cluster and 13 workflows to study the effect of provisioning on the completion time of the scientific workflows. The results show in general a reduction of about 50% in the workflow completion time using provisioning for the First In First Out and fair share scheduling policies. In this paper, we also examine the cost of resource provisioning and propose a utilization‐based metric that can be used to guide the provisioning decisions in order to reduce the cost. Finally, we present the results of a survey on the support of AR at the Grid sites. Copyright © 2011 John Wiley & Sons, Ltd.</div>
</front>
</TEI>
<affiliations><list><country><li>États-Unis</li>
</country>
<region><li>Californie</li>
</region>
<settlement><li>Los Angeles</li>
</settlement>
<orgName><li>Université de Californie du Sud</li>
</orgName>
</list>
<tree><country name="États-Unis"><region name="Californie"><name sortKey="Singh, Gurmeet" sort="Singh, Gurmeet" uniqKey="Singh G" first="Gurmeet" last="Singh">Gurmeet Singh</name>
</region>
<name sortKey="Deelman, Ewa" sort="Deelman, Ewa" uniqKey="Deelman E" first="Ewa" last="Deelman">Ewa Deelman</name>
</country>
</tree>
</affiliations>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/CyberinfraV1/Data/Istex/Checkpoint
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000154 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Istex/Checkpoint/biblio.hfd -nk 000154 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= CyberinfraV1 |flux= Istex |étape= Checkpoint |type= RBID |clé= ISTEX:09DE35AA7F410B7A836497A0F62E1D669D4319E4 |texte= The interplay of resource provisioning and workflow optimization in scientific applications }}
This area was generated with Dilib version V0.6.25. |