A Dataflow-Oriented Atomicity and Provenance System for Pipelined Scientific Workflows
Identifieur interne : 000219 ( Istex/Corpus ); précédent : 000218; suivant : 000220A Dataflow-Oriented Atomicity and Provenance System for Pipelined Scientific Workflows
Auteurs : Liqiang Wang ; Shiyong Lu ; Xubo Fei ; Jeffrey RamSource :
- Lecture Notes in Computer Science [ 0302-9743 ] ; 2007.
Abstract
Abstract: Scientific workflows have gained great momentum in recent years due to their critical roles in e-Science and cyberinfrastructure applications. However, some tasks of a scientific workflow might fail during execution. A domain scientist might require a region of a scientific workflow to be “atomic”. Data provenance, which determines the source data that are used to produce a data item, is also essential to scientific workflows. In this paper, we propose: (i) an architecture for scientific workflow management systems that supports both provenance and atomicity; (ii) a dataflow-oriented atomicity model that supports the notions of commit and abort; and (iii) a dataflow-oriented provenance model that, in addition to supporting existing provenance graphs and queries, also supports queries related to atomicity and failure.
Url:
DOI: 10.1007/978-3-540-72588-6_42
Links to Exploration step
ISTEX:48AE9890FC65C1CD833AEF9852CE22227CD35F7DLe document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">A Dataflow-Oriented Atomicity and Provenance System for Pipelined Scientific Workflows</title><author><name sortKey="Wang, Liqiang" sort="Wang, Liqiang" uniqKey="Wang L" first="Liqiang" last="Wang">Liqiang Wang</name><affiliation><mods:affiliation>Dept. of Computer Science, University of Wyoming, USA</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: wang@cs.uwyo.edu</mods:affiliation></affiliation></author><author><name sortKey="Lu, Shiyong" sort="Lu, Shiyong" uniqKey="Lu S" first="Shiyong" last="Lu">Shiyong Lu</name><affiliation><mods:affiliation>Dept. of Computer Science, Wayne State University, USA</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: shiyong@wayne.edu</mods:affiliation></affiliation></author><author><name sortKey="Fei, Xubo" sort="Fei, Xubo" uniqKey="Fei X" first="Xubo" last="Fei">Xubo Fei</name><affiliation><mods:affiliation>Dept. of Computer Science, Wayne State University, USA</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: xubo@wayne.edu</mods:affiliation></affiliation></author><author><name sortKey="Ram, Jeffrey" sort="Ram, Jeffrey" uniqKey="Ram J" first="Jeffrey" last="Ram">Jeffrey Ram</name><affiliation><mods:affiliation>Dept. of Physiology, Wayne State University, USA</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: jeffram@med.wayne.edu</mods:affiliation></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:48AE9890FC65C1CD833AEF9852CE22227CD35F7D</idno><date when="2007" year="2007">2007</date><idno type="doi">10.1007/978-3-540-72588-6_42</idno><idno type="url">https://api.istex.fr/document/48AE9890FC65C1CD833AEF9852CE22227CD35F7D/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">000219</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">A Dataflow-Oriented Atomicity and Provenance System for Pipelined Scientific Workflows</title><author><name sortKey="Wang, Liqiang" sort="Wang, Liqiang" uniqKey="Wang L" first="Liqiang" last="Wang">Liqiang Wang</name><affiliation><mods:affiliation>Dept. of Computer Science, University of Wyoming, USA</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: wang@cs.uwyo.edu</mods:affiliation></affiliation></author><author><name sortKey="Lu, Shiyong" sort="Lu, Shiyong" uniqKey="Lu S" first="Shiyong" last="Lu">Shiyong Lu</name><affiliation><mods:affiliation>Dept. of Computer Science, Wayne State University, USA</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: shiyong@wayne.edu</mods:affiliation></affiliation></author><author><name sortKey="Fei, Xubo" sort="Fei, Xubo" uniqKey="Fei X" first="Xubo" last="Fei">Xubo Fei</name><affiliation><mods:affiliation>Dept. of Computer Science, Wayne State University, USA</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: xubo@wayne.edu</mods:affiliation></affiliation></author><author><name sortKey="Ram, Jeffrey" sort="Ram, Jeffrey" uniqKey="Ram J" first="Jeffrey" last="Ram">Jeffrey Ram</name><affiliation><mods:affiliation>Dept. of Physiology, Wayne State University, USA</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: jeffram@med.wayne.edu</mods:affiliation></affiliation></author></analytic><monogr></monogr><series><title level="s">Lecture Notes in Computer Science</title><imprint><date>2007</date></imprint><idno type="ISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><idno type="ISSN">0302-9743</idno></series><idno type="istex">48AE9890FC65C1CD833AEF9852CE22227CD35F7D</idno><idno type="DOI">10.1007/978-3-540-72588-6_42</idno><idno type="ChapterID">42</idno><idno type="ChapterID">Chap42</idno></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">0302-9743</idno></seriesStmt></fileDesc><profileDesc><textClass></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Abstract: Scientific workflows have gained great momentum in recent years due to their critical roles in e-Science and cyberinfrastructure applications. However, some tasks of a scientific workflow might fail during execution. A domain scientist might require a region of a scientific workflow to be “atomic”. Data provenance, which determines the source data that are used to produce a data item, is also essential to scientific workflows. In this paper, we propose: (i) an architecture for scientific workflow management systems that supports both provenance and atomicity; (ii) a dataflow-oriented atomicity model that supports the notions of commit and abort; and (iii) a dataflow-oriented provenance model that, in addition to supporting existing provenance graphs and queries, also supports queries related to atomicity and failure.</div></front></TEI><istex><corpusName>springer</corpusName><author><json:item><name>Liqiang Wang</name><affiliations><json:string>Dept. of Computer Science, University of Wyoming, USA</json:string><json:string>E-mail: wang@cs.uwyo.edu</json:string></affiliations></json:item><json:item><name>Shiyong Lu</name><affiliations><json:string>Dept. of Computer Science, Wayne State University, USA</json:string><json:string>E-mail: shiyong@wayne.edu</json:string></affiliations></json:item><json:item><name>Xubo Fei</name><affiliations><json:string>Dept. of Computer Science, Wayne State University, USA</json:string><json:string>E-mail: xubo@wayne.edu</json:string></affiliations></json:item><json:item><name>Jeffrey Ram</name><affiliations><json:string>Dept. of Physiology, Wayne State University, USA</json:string><json:string>E-mail: jeffram@med.wayne.edu</json:string></affiliations></json:item></author><language><json:string>eng</json:string></language><originalGenre><json:string>OriginalPaper</json:string></originalGenre><abstract>Abstract: Scientific workflows have gained great momentum in recent years due to their critical roles in e-Science and cyberinfrastructure applications. However, some tasks of a scientific workflow might fail during execution. A domain scientist might require a region of a scientific workflow to be “atomic”. Data provenance, which determines the source data that are used to produce a data item, is also essential to scientific workflows. In this paper, we propose: (i) an architecture for scientific workflow management systems that supports both provenance and atomicity; (ii) a dataflow-oriented atomicity model that supports the notions of commit and abort; and (iii) a dataflow-oriented provenance model that, in addition to supporting existing provenance graphs and queries, also supports queries related to atomicity and failure.</abstract><qualityIndicators><score>4.898</score><pdfVersion>1.3</pdfVersion><pdfPageSize>430 x 660 pts</pdfPageSize><refBibsNative>false</refBibsNative><keywordCount>0</keywordCount><abstractCharCount>838</abstractCharCount><pdfWordCount>3434</pdfWordCount><pdfCharCount>19771</pdfCharCount><pdfPageCount>9</pdfPageCount><abstractWordCount>122</abstractWordCount></qualityIndicators><title>A Dataflow-Oriented Atomicity and Provenance System for Pipelined Scientific Workflows</title><chapterId><json:string>42</json:string><json:string>Chap42</json:string></chapterId><genre><json:string>conference</json:string></genre><serie><editor><json:item><name>David Hutchison</name></json:item><json:item><name>Takeo Kanade</name></json:item><json:item><name>Josef Kittler</name></json:item><json:item><name>Jon M. Kleinberg</name></json:item><json:item><name>Friedemann Mattern</name></json:item><json:item><name>John C. Mitchell</name></json:item><json:item><name>Moni Naor</name></json:item><json:item><name>Oscar Nierstrasz</name></json:item><json:item><name>C. Pandu Rangan</name></json:item><json:item><name>Bernhard Steffen</name></json:item><json:item><name>Madhu Sudan</name></json:item><json:item><name>Demetri Terzopoulos</name></json:item><json:item><name>Doug Tygar</name></json:item><json:item><name>Moshe Y. Vardi</name></json:item><json:item><name>Gerhard Weikum</name></json:item></editor><issn><json:string>0302-9743</json:string></issn><language><json:string>unknown</json:string></language><eissn><json:string>1611-3349</json:string></eissn><title>Lecture Notes in Computer Science</title><copyrightDate>2007</copyrightDate></serie><host><editor><json:item><name>Yong Shi</name></json:item><json:item><name>Geert Dick van Albada</name></json:item><json:item><name>Jack Dongarra</name></json:item><json:item><name>Peter M. A. Sloot</name></json:item></editor><subject><json:item><value>Computer Science</value></json:item><json:item><value>Computer Science</value></json:item><json:item><value>Theory of Computation</value></json:item><json:item><value>Software Engineering/Programming and Operating Systems</value></json:item><json:item><value>Numeric Computing</value></json:item><json:item><value>Information Systems and Communication Service</value></json:item><json:item><value>Simulation and Modeling</value></json:item><json:item><value>Computer Imaging, Vision, Pattern Recognition and Graphics</value></json:item></subject><isbn><json:string>978-3-540-72587-9</json:string></isbn><language><json:string>unknown</json:string></language><eissn><json:string>1611-3349</json:string></eissn><title>Computational Science – ICCS 2007</title><bookId><json:string>978-3-540-72588-6</json:string></bookId><volume>4489</volume><pages><last>252</last><first>244</first></pages><issn><json:string>0302-9743</json:string></issn><genre><json:string>book-series</json:string></genre><eisbn><json:string>978-3-540-72588-6</json:string></eisbn><copyrightDate>2007</copyrightDate><doi><json:string>10.1007/978-3-540-72588-6</json:string></doi></host><publicationDate>2007</publicationDate><copyrightDate>2007</copyrightDate><doi><json:string>10.1007/978-3-540-72588-6_42</json:string></doi><id>48AE9890FC65C1CD833AEF9852CE22227CD35F7D</id><score>0.24761574</score><fulltext><json:item><original>true</original><mimetype>application/pdf</mimetype><extension>pdf</extension><uri>https://api.istex.fr/document/48AE9890FC65C1CD833AEF9852CE22227CD35F7D/fulltext/pdf</uri></json:item><json:item><original>false</original><mimetype>application/zip</mimetype><extension>zip</extension><uri>https://api.istex.fr/document/48AE9890FC65C1CD833AEF9852CE22227CD35F7D/fulltext/zip</uri></json:item><istex:fulltextTEI uri="https://api.istex.fr/document/48AE9890FC65C1CD833AEF9852CE22227CD35F7D/fulltext/tei"><teiHeader><fileDesc><titleStmt><title level="a" type="main" xml:lang="en">A Dataflow-Oriented Atomicity and Provenance System for Pipelined Scientific Workflows</title><respStmt><resp>Références bibliographiques récupérées via GROBID</resp><name resp="ISTEX-API">ISTEX-API (INIST-CNRS)</name></respStmt></titleStmt><publicationStmt><authority>ISTEX</authority><publisher>Springer Berlin Heidelberg</publisher><pubPlace>Berlin, Heidelberg</pubPlace><availability><p>Springer-Verlag Berlin Heidelberg, 2007</p></availability><date>2007</date></publicationStmt><sourceDesc><biblStruct type="inbook"><analytic><title level="a" type="main" xml:lang="en">A Dataflow-Oriented Atomicity and Provenance System for Pipelined Scientific Workflows</title><author xml:id="author-1"><persName><forename type="first">Liqiang</forename><surname>Wang</surname></persName><email>wang@cs.uwyo.edu</email><affiliation>Dept. of Computer Science, University of Wyoming, USA</affiliation></author><author xml:id="author-2"><persName><forename type="first">Shiyong</forename><surname>Lu</surname></persName><email>shiyong@wayne.edu</email><affiliation>Dept. of Computer Science, Wayne State University, USA</affiliation></author><author xml:id="author-3"><persName><forename type="first">Xubo</forename><surname>Fei</surname></persName><email>xubo@wayne.edu</email><affiliation>Dept. of Computer Science, Wayne State University, USA</affiliation></author><author xml:id="author-4"><persName><forename type="first">Jeffrey</forename><surname>Ram</surname></persName><email>jeffram@med.wayne.edu</email><affiliation>Dept. of Physiology, Wayne State University, USA</affiliation></author></analytic><monogr><title level="m">Computational Science – ICCS 2007</title><title level="m" type="sub">7th International Conference, Beijing, China, May 27 - 30, 2007, Proceedings, Part III</title><idno type="pISBN">978-3-540-72587-9</idno><idno type="eISBN">978-3-540-72588-6</idno><idno type="pISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><idno type="DOI">10.1007/978-3-540-72588-6</idno><idno type="book-ID">978-3-540-72588-6</idno><idno type="book-title-ID">149866</idno><idno type="book-sequence-number">4489</idno><idno type="book-volume-number">4489</idno><idno type="book-chapter-count">193</idno><editor><persName><forename type="first">Yong</forename><surname>Shi</surname></persName></editor><editor><persName><forename type="first">Geert</forename><forename type="first">Dick</forename><surname>van Albada</surname></persName></editor><editor><persName><forename type="first">Jack</forename><surname>Dongarra</surname></persName></editor><editor><persName><forename type="first">Peter</forename><forename type="first">M.</forename><forename type="first">A.</forename><surname>Sloot</surname></persName></editor><imprint><publisher>Springer Berlin Heidelberg</publisher><pubPlace>Berlin, Heidelberg</pubPlace><date type="published" when="2007"></date><biblScope unit="volume">4489</biblScope><biblScope unit="page" from="244">244</biblScope><biblScope unit="page" to="252">252</biblScope></imprint></monogr><series><title level="s">Lecture Notes in Computer Science</title><editor><persName><forename type="first">David</forename><surname>Hutchison</surname></persName></editor><editor><persName><forename type="first">Takeo</forename><surname>Kanade</surname></persName></editor><editor><persName><forename type="first">Josef</forename><surname>Kittler</surname></persName></editor><editor><persName><forename type="first">Jon</forename><forename type="first">M.</forename><surname>Kleinberg</surname></persName></editor><editor><persName><forename type="first">Friedemann</forename><surname>Mattern</surname></persName></editor><editor><persName><forename type="first">John</forename><forename type="first">C.</forename><surname>Mitchell</surname></persName></editor><editor><persName><forename type="first">Moni</forename><surname>Naor</surname></persName></editor><editor><persName><forename type="first">Oscar</forename><surname>Nierstrasz</surname></persName></editor><editor><persName><forename type="first">C.</forename><forename type="first">Pandu</forename><surname>Rangan</surname></persName></editor><editor><persName><forename type="first">Bernhard</forename><surname>Steffen</surname></persName></editor><editor><persName><forename type="first">Madhu</forename><surname>Sudan</surname></persName></editor><editor><persName><forename type="first">Demetri</forename><surname>Terzopoulos</surname></persName></editor><editor><persName><forename type="first">Doug</forename><surname>Tygar</surname></persName></editor><editor><persName><forename type="first">Moshe</forename><forename type="first">Y.</forename><surname>Vardi</surname></persName></editor><editor><persName><forename type="first">Gerhard</forename><surname>Weikum</surname></persName></editor><biblScope><date>2007</date></biblScope><idno type="pISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><idno type="series-Id">558</idno></series><idno type="istex">48AE9890FC65C1CD833AEF9852CE22227CD35F7D</idno><idno type="DOI">10.1007/978-3-540-72588-6_42</idno><idno type="ChapterID">42</idno><idno type="ChapterID">Chap42</idno></biblStruct></sourceDesc></fileDesc><profileDesc><creation><date>2007</date></creation><langUsage><language ident="en">en</language></langUsage><abstract xml:lang="en"><p>Abstract: Scientific workflows have gained great momentum in recent years due to their critical roles in e-Science and cyberinfrastructure applications. However, some tasks of a scientific workflow might fail during execution. A domain scientist might require a region of a scientific workflow to be “atomic”. Data provenance, which determines the source data that are used to produce a data item, is also essential to scientific workflows. In this paper, we propose: (i) an architecture for scientific workflow management systems that supports both provenance and atomicity; (ii) a dataflow-oriented atomicity model that supports the notions of commit and abort; and (iii) a dataflow-oriented provenance model that, in addition to supporting existing provenance graphs and queries, also supports queries related to atomicity and failure.</p></abstract><textClass><keywords scheme="Book-Subject-Collection"><list><label>SUCO11645</label><item><term>Computer Science</term></item></list></keywords></textClass><textClass><keywords scheme="Book-Subject-Group"><list><label>I</label><label>I16005</label><label>I14002</label><label>I1701X</label><label>I18008</label><label>I21025</label><label>I22005</label><item><term>Computer Science</term></item><item><term>Theory of Computation</term></item><item><term>Software Engineering/Programming and Operating Systems</term></item><item><term>Numeric Computing</term></item><item><term>Information Systems and Communication Service</term></item><item><term>Simulation and Modeling</term></item><item><term>Computer Imaging, Vision, Pattern Recognition and Graphics</term></item></list></keywords></textClass></profileDesc><revisionDesc><change when="2007">Published</change><change xml:id="refBibs-istex" who="#ISTEX-API" when="2016-09-22">References added</change></revisionDesc></teiHeader></istex:fulltextTEI><json:item><original>false</original><mimetype>text/plain</mimetype><extension>txt</extension><uri>https://api.istex.fr/document/48AE9890FC65C1CD833AEF9852CE22227CD35F7D/fulltext/txt</uri></json:item></fulltext><metadata><istex:metadataXml wicri:clean="Springer, Publisher found" wicri:toSee="no header"><istex:xmlDeclaration>version="1.0" encoding="UTF-8"</istex:xmlDeclaration><istex:docType PUBLIC="-//Springer-Verlag//DTD A++ V2.4//EN" URI="http://devel.springer.de/A++/V2.4/DTD/A++V2.4.dtd" name="istex:docType"></istex:docType><istex:document><Publisher><PublisherInfo><PublisherName>Springer Berlin Heidelberg</PublisherName><PublisherLocation>Berlin, Heidelberg</PublisherLocation></PublisherInfo><Series><SeriesInfo SeriesType="Series" TocLevels="0"><SeriesID>558</SeriesID><SeriesPrintISSN>0302-9743</SeriesPrintISSN><SeriesElectronicISSN>1611-3349</SeriesElectronicISSN><SeriesTitle Language="En">Lecture Notes in Computer Science</SeriesTitle><SeriesAbbreviatedTitle>LNCS</SeriesAbbreviatedTitle></SeriesInfo><SeriesHeader><EditorGroup><Editor><EditorName DisplayOrder="Western"><GivenName>David</GivenName><FamilyName>Hutchison</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Takeo</GivenName><FamilyName>Kanade</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Josef</GivenName><FamilyName>Kittler</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Jon</GivenName><GivenName>M.</GivenName><FamilyName>Kleinberg</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Friedemann</GivenName><FamilyName>Mattern</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>John</GivenName><GivenName>C.</GivenName><FamilyName>Mitchell</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Moni</GivenName><FamilyName>Naor</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Oscar</GivenName><FamilyName>Nierstrasz</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>C.</GivenName><GivenName>Pandu</GivenName><FamilyName>Rangan</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Bernhard</GivenName><FamilyName>Steffen</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Madhu</GivenName><FamilyName>Sudan</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Demetri</GivenName><FamilyName>Terzopoulos</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Doug</GivenName><FamilyName>Tygar</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Moshe</GivenName><GivenName>Y.</GivenName><FamilyName>Vardi</FamilyName></EditorName></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Gerhard</GivenName><FamilyName>Weikum</FamilyName></EditorName></Editor></EditorGroup></SeriesHeader><Book Language="En"><BookInfo BookProductType="Proceedings" ContainsESM="No" Language="En" MediaType="eBook" NumberingStyle="Unnumbered" OutputMedium="All" TocLevels="0"><BookID>978-3-540-72588-6</BookID><BookTitle>Computational Science – ICCS 2007</BookTitle><BookSubTitle>7th International Conference, Beijing, China, May 27 - 30, 2007, Proceedings, Part III</BookSubTitle><BookVolumeNumber>4489</BookVolumeNumber><BookSequenceNumber>4489</BookSequenceNumber><BookDOI>10.1007/978-3-540-72588-6</BookDOI><BookTitleID>149866</BookTitleID><BookPrintISBN>978-3-540-72587-9</BookPrintISBN><BookElectronicISBN>978-3-540-72588-6</BookElectronicISBN><BookChapterCount>193</BookChapterCount><BookCopyright><CopyrightHolderName>Springer-Verlag Berlin Heidelberg</CopyrightHolderName><CopyrightYear>2007</CopyrightYear></BookCopyright><BookSubjectGroup><BookSubject Code="I" Type="Primary">Computer Science</BookSubject><BookSubject Code="I16005" Priority="1" Type="Secondary">Theory of Computation</BookSubject><BookSubject Code="I14002" Priority="2" Type="Secondary">Software Engineering/Programming and Operating Systems</BookSubject><BookSubject Code="I1701X" Priority="3" Type="Secondary">Numeric Computing</BookSubject><BookSubject Code="I18008" Priority="4" Type="Secondary">Information Systems and Communication Service</BookSubject><BookSubject Code="I21025" Priority="5" Type="Secondary">Simulation and Modeling</BookSubject><BookSubject Code="I22005" Priority="6" Type="Secondary">Computer Imaging, Vision, Pattern Recognition and Graphics</BookSubject><SubjectCollection Code="SUCO11645">Computer Science</SubjectCollection></BookSubjectGroup></BookInfo><BookHeader><EditorGroup><Editor><EditorName DisplayOrder="Western"><GivenName>Yong</GivenName><FamilyName>Shi</FamilyName></EditorName><Contact><Email>yshi@mail.unomaha.edu</Email></Contact></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Geert</GivenName><GivenName>Dick</GivenName><Particle>van</Particle><FamilyName>Albada</FamilyName></EditorName><Contact><Email>dick@science.uva.nl</Email></Contact></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Jack</GivenName><FamilyName>Dongarra</FamilyName></EditorName><Contact><Email>dongarra@cs.utk.edu</Email></Contact></Editor><Editor><EditorName DisplayOrder="Western"><GivenName>Peter</GivenName><GivenName>M.</GivenName><GivenName>A.</GivenName><FamilyName>Sloot</FamilyName></EditorName><Contact><Email>sloot@science.uva.nl</Email></Contact></Editor></EditorGroup></BookHeader><Chapter ID="Chap42" Language="En"><ChapterInfo ChapterType="OriginalPaper" ContainsESM="No" NumberingStyle="Unnumbered" TocLevels="0"><ChapterID>42</ChapterID><ChapterDOI>10.1007/978-3-540-72588-6_42</ChapterDOI><ChapterSequenceNumber>42</ChapterSequenceNumber><ChapterTitle Language="En">A Dataflow-Oriented Atomicity and Provenance System for Pipelined Scientific Workflows</ChapterTitle><ChapterFirstPage>244</ChapterFirstPage><ChapterLastPage>252</ChapterLastPage><ChapterCopyright><CopyrightHolderName>Springer Berlin Heidelberg</CopyrightHolderName><CopyrightYear>2007</CopyrightYear></ChapterCopyright><ChapterGrants Type="Regular"><MetadataGrant Grant="OpenAccess"></MetadataGrant><AbstractGrant Grant="OpenAccess"></AbstractGrant><BodyPDFGrant Grant="Restricted"></BodyPDFGrant><BodyHTMLGrant Grant="Restricted"></BodyHTMLGrant><BibliographyGrant Grant="Restricted"></BibliographyGrant><ESMGrant Grant="Restricted"></ESMGrant></ChapterGrants></ChapterInfo><ChapterHeader><AuthorGroup><Author AffiliationIDS="Aff1"><AuthorName DisplayOrder="Western"><GivenName>Liqiang</GivenName><FamilyName>Wang</FamilyName></AuthorName><Contact><Email>wang@cs.uwyo.edu</Email></Contact></Author><Author AffiliationIDS="Aff2"><AuthorName DisplayOrder="Western"><GivenName>Shiyong</GivenName><FamilyName>Lu</FamilyName></AuthorName><Contact><Email>shiyong@wayne.edu</Email></Contact></Author><Author AffiliationIDS="Aff2"><AuthorName DisplayOrder="Western"><GivenName>Xubo</GivenName><FamilyName>Fei</FamilyName></AuthorName><Contact><Email>xubo@wayne.edu</Email></Contact></Author><Author AffiliationIDS="Aff3"><AuthorName DisplayOrder="Western"><GivenName>Jeffrey</GivenName><FamilyName>Ram</FamilyName></AuthorName><Contact><Email>jeffram@med.wayne.edu</Email></Contact></Author><Affiliation ID="Aff1"><OrgName>Dept. of Computer Science, University of Wyoming</OrgName><OrgAddress><Country>USA</Country></OrgAddress></Affiliation><Affiliation ID="Aff2"><OrgName>Dept. of Computer Science, Wayne State University</OrgName><OrgAddress><Country>USA</Country></OrgAddress></Affiliation><Affiliation ID="Aff3"><OrgName>Dept. of Physiology, Wayne State University</OrgName><OrgAddress><Country>USA</Country></OrgAddress></Affiliation></AuthorGroup><Abstract ID="Abs1" Language="En"><Heading>Abstract</Heading><Para>Scientific workflows have gained great momentum in recent years due to their critical roles in e-Science and cyberinfrastructure applications. However, some tasks of a scientific workflow might fail during execution. A domain scientist might require a region of a scientific workflow to be “atomic”. Data provenance, which determines the source data that are used to produce a data item, is also essential to scientific workflows. In this paper, we propose: (<Emphasis Type="Italic">i</Emphasis>) an architecture for scientific workflow management systems that supports both provenance and atomicity; (<Emphasis Type="Italic">ii</Emphasis>) a dataflow-oriented atomicity model that supports the notions of commit and abort; and (<Emphasis Type="Italic">iii</Emphasis>) a dataflow-oriented provenance model that, in addition to supporting existing provenance graphs and queries, also supports queries related to atomicity and failure.</Para></Abstract><ArticleNote Type="Misc"><SimplePara>The first two authors contributed equally to this paper.</SimplePara></ArticleNote></ChapterHeader><NoBody></NoBody></Chapter></Book></Series></Publisher></istex:document></istex:metadataXml><mods version="3.6"><titleInfo lang="en"><title>A Dataflow-Oriented Atomicity and Provenance System for Pipelined Scientific Workflows</title></titleInfo><titleInfo type="alternative" contentType="CDATA" lang="en"><title>A Dataflow-Oriented Atomicity and Provenance System for Pipelined Scientific Workflows</title></titleInfo><name type="personal"><namePart type="given">Liqiang</namePart><namePart type="family">Wang</namePart><affiliation>Dept. of Computer Science, University of Wyoming, USA</affiliation><affiliation>E-mail: wang@cs.uwyo.edu</affiliation><role><roleTerm type="text">author</roleTerm></role></name><name type="personal"><namePart type="given">Shiyong</namePart><namePart type="family">Lu</namePart><affiliation>Dept. of Computer Science, Wayne State University, USA</affiliation><affiliation>E-mail: shiyong@wayne.edu</affiliation><role><roleTerm type="text">author</roleTerm></role></name><name type="personal"><namePart type="given">Xubo</namePart><namePart type="family">Fei</namePart><affiliation>Dept. of Computer Science, Wayne State University, USA</affiliation><affiliation>E-mail: xubo@wayne.edu</affiliation><role><roleTerm type="text">author</roleTerm></role></name><name type="personal"><namePart type="given">Jeffrey</namePart><namePart type="family">Ram</namePart><affiliation>Dept. of Physiology, Wayne State University, USA</affiliation><affiliation>E-mail: jeffram@med.wayne.edu</affiliation><role><roleTerm type="text">author</roleTerm></role></name><typeOfResource>text</typeOfResource><genre type="conference" displayLabel="OriginalPaper"></genre><originInfo><publisher>Springer Berlin Heidelberg</publisher><place><placeTerm type="text">Berlin, Heidelberg</placeTerm></place><dateIssued encoding="w3cdtf">2007</dateIssued><copyrightDate encoding="w3cdtf">2007</copyrightDate></originInfo><language><languageTerm type="code" authority="rfc3066">en</languageTerm><languageTerm type="code" authority="iso639-2b">eng</languageTerm></language><physicalDescription><internetMediaType>text/html</internetMediaType></physicalDescription><abstract lang="en">Abstract: Scientific workflows have gained great momentum in recent years due to their critical roles in e-Science and cyberinfrastructure applications. However, some tasks of a scientific workflow might fail during execution. A domain scientist might require a region of a scientific workflow to be “atomic”. Data provenance, which determines the source data that are used to produce a data item, is also essential to scientific workflows. In this paper, we propose: (i) an architecture for scientific workflow management systems that supports both provenance and atomicity; (ii) a dataflow-oriented atomicity model that supports the notions of commit and abort; and (iii) a dataflow-oriented provenance model that, in addition to supporting existing provenance graphs and queries, also supports queries related to atomicity and failure.</abstract><relatedItem type="host"><titleInfo><title>Computational Science – ICCS 2007</title><subTitle>7th International Conference, Beijing, China, May 27 - 30, 2007, Proceedings, Part III</subTitle></titleInfo><name type="personal"><namePart type="given">Yong</namePart><namePart type="family">Shi</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Geert</namePart><namePart type="given">Dick</namePart><namePart type="family">van Albada</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Jack</namePart><namePart type="family">Dongarra</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Peter</namePart><namePart type="given">M.</namePart><namePart type="given">A.</namePart><namePart type="family">Sloot</namePart><role><roleTerm type="text">editor</roleTerm></role></name><genre type="book-series" displayLabel="Proceedings"></genre><originInfo><copyrightDate encoding="w3cdtf">2007</copyrightDate><issuance>monographic</issuance></originInfo><subject><genre>Book-Subject-Collection</genre><topic authority="SpringerSubjectCodes" authorityURI="SUCO11645">Computer Science</topic></subject><subject><genre>Book-Subject-Group</genre><topic authority="SpringerSubjectCodes" authorityURI="I">Computer Science</topic><topic authority="SpringerSubjectCodes" authorityURI="I16005">Theory of Computation</topic><topic authority="SpringerSubjectCodes" authorityURI="I14002">Software Engineering/Programming and Operating Systems</topic><topic authority="SpringerSubjectCodes" authorityURI="I1701X">Numeric Computing</topic><topic authority="SpringerSubjectCodes" authorityURI="I18008">Information Systems and Communication Service</topic><topic authority="SpringerSubjectCodes" authorityURI="I21025">Simulation and Modeling</topic><topic authority="SpringerSubjectCodes" authorityURI="I22005">Computer Imaging, Vision, Pattern Recognition and Graphics</topic></subject><identifier type="DOI">10.1007/978-3-540-72588-6</identifier><identifier type="ISBN">978-3-540-72587-9</identifier><identifier type="eISBN">978-3-540-72588-6</identifier><identifier type="ISSN">0302-9743</identifier><identifier type="eISSN">1611-3349</identifier><identifier type="BookTitleID">149866</identifier><identifier type="BookID">978-3-540-72588-6</identifier><identifier type="BookChapterCount">193</identifier><identifier type="BookVolumeNumber">4489</identifier><identifier type="BookSequenceNumber">4489</identifier><part><date>2007</date><detail type="volume"><number>4489</number><caption>vol.</caption></detail><extent unit="pages"><start>244</start><end>252</end></extent></part><recordInfo><recordOrigin>Springer-Verlag Berlin Heidelberg, 2007</recordOrigin></recordInfo></relatedItem><relatedItem type="series"><titleInfo><title>Lecture Notes in Computer Science</title></titleInfo><name type="personal"><namePart type="given">David</namePart><namePart type="family">Hutchison</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Takeo</namePart><namePart type="family">Kanade</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Josef</namePart><namePart type="family">Kittler</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Jon</namePart><namePart type="given">M.</namePart><namePart type="family">Kleinberg</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Friedemann</namePart><namePart type="family">Mattern</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">John</namePart><namePart type="given">C.</namePart><namePart type="family">Mitchell</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Moni</namePart><namePart type="family">Naor</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Oscar</namePart><namePart type="family">Nierstrasz</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">C.</namePart><namePart type="given">Pandu</namePart><namePart type="family">Rangan</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Bernhard</namePart><namePart type="family">Steffen</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Madhu</namePart><namePart type="family">Sudan</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Demetri</namePart><namePart type="family">Terzopoulos</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Doug</namePart><namePart type="family">Tygar</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Moshe</namePart><namePart type="given">Y.</namePart><namePart type="family">Vardi</namePart><role><roleTerm type="text">editor</roleTerm></role></name><name type="personal"><namePart type="given">Gerhard</namePart><namePart type="family">Weikum</namePart><role><roleTerm type="text">editor</roleTerm></role></name><originInfo><copyrightDate encoding="w3cdtf">2007</copyrightDate><issuance>serial</issuance></originInfo><identifier type="ISSN">0302-9743</identifier><identifier type="eISSN">1611-3349</identifier><identifier type="SeriesID">558</identifier><recordInfo><recordOrigin>Springer-Verlag Berlin Heidelberg, 2007</recordOrigin></recordInfo></relatedItem><identifier type="istex">48AE9890FC65C1CD833AEF9852CE22227CD35F7D</identifier><identifier type="DOI">10.1007/978-3-540-72588-6_42</identifier><identifier type="ChapterID">42</identifier><identifier type="ChapterID">Chap42</identifier><accessCondition type="use and reproduction" contentType="copyright">Springer-Verlag Berlin Heidelberg, 2007</accessCondition><recordInfo><recordContentSource>SPRINGER</recordContentSource><recordOrigin>Springer Berlin Heidelberg, 2007</recordOrigin></recordInfo></mods></metadata><enrichments><json:item><type>multicat</type><uri>https://api.istex.fr/document/48AE9890FC65C1CD833AEF9852CE22227CD35F7D/enrichments/multicat</uri></json:item><istex:refBibTEI uri="https://api.istex.fr/document/48AE9890FC65C1CD833AEF9852CE22227CD35F7D/enrichments/refBib"><teiHeader></teiHeader><text><front></front><body></body><back><listBibl><biblStruct xml:id="b0"><analytic><title level="a" type="main">Implementing recoverable requests using queues</title><author><persName><forename type="first">P</forename><forename type="middle">A</forename><surname>Bernstein</surname></persName></author><author><persName><forename type="first">M</forename><surname>Hsu</surname></persName></author><author><persName><forename type="first">B</forename><surname>Mann</surname></persName></author></analytic><monogr><title level="m">Proc. of the 1990 ACM SIGMOD international conference on Management of data</title><meeting>. of the 1990 ACM SIGMOD international conference on Management of data</meeting><imprint><publisher>ACM Press</publisher><date type="published" when="1990"></date><biblScope unit="page" from="112" to="122"></biblScope></imprint></monogr></biblStruct><biblStruct xml:id="b1"><analytic><title level="a" type="main">A model for user-oriented data provenance in pipelined scientific workflows</title><author><persName><forename type="first">S</forename><surname>Bowers</surname></persName></author><author><persName><forename type="first">T</forename><surname>Mcphillips</surname></persName></author><author><persName><forename type="first">B</forename><surname>Ludascher</surname></persName></author><author><persName><forename type="first">S</forename><surname>Cohen</surname></persName></author><author><persName><forename type="first">S</forename><forename type="middle">B</forename><surname>Davidson</surname></persName></author></analytic><monogr><title level="m">Proc. of the International Provenance and Annotation Workshop (IPAW'06)</title><meeting>. of the International Provenance and Annotation Workshop (IPAW'06)<address><addrLine>Chicago, Illinois, USA</addrLine></address></meeting><imprint><date type="published" when="2006-03"></date></imprint></monogr></biblStruct><biblStruct xml:id="b2"><analytic><title level="a" type="main">Why and where: A characterization of data provenance</title><author><persName><forename type="first">P</forename><surname>Buneman</surname></persName></author><author><persName><forename type="first">S</forename><surname>Khanna</surname></persName></author><author><persName><forename type="first">W.-C</forename><surname>Tan</surname></persName></author></analytic><monogr><title level="m">Proc. of the International Conference on Database Theory (ICDT)</title><meeting>. of the International Conference on Database Theory (ICDT)</meeting><imprint><date type="published" when="1973"></date><biblScope unit="page" from="316" to="330"></biblScope></imprint></monogr></biblStruct><biblStruct xml:id="b3"><analytic><title level="a" type="main">Towards a model of provenance and user views in scientific workflows</title><author><persName><forename type="first">S</forename><surname>Cohen</surname></persName></author><author><persName><forename type="first">S</forename><forename type="middle">C</forename><surname>Boulakia</surname></persName></author><author><persName><forename type="first">S</forename><forename type="middle">B</forename><surname>Davidson</surname></persName></author></analytic><monogr><title level="m">Data Integration in the Life Sciences</title><imprint><date type="published" when="2006"></date><biblScope unit="page" from="264" to="279"></biblScope></imprint></monogr></biblStruct><biblStruct xml:id="b4"><analytic><title level="a" type="main">Customized atomicity specification for transactional workflows</title><author><persName><forename type="first">W</forename><surname>Derks</surname></persName></author><author><persName><forename type="first">J</forename><surname>Dehnert</surname></persName></author><author><persName><forename type="first">P</forename><surname>Grefen</surname></persName></author><author><persName><forename type="first">W</forename><surname>Jonker</surname></persName></author></analytic><monogr><title level="m">Proc. of the Third International Symposium on Cooperative Database Systems for Advanced Applications(CODAS'01)</title><meeting>. of the Third International Symposium on Cooperative Database Systems for Advanced Applications(CODAS'01)</meeting><imprint><publisher>IEEE Computer Society Press</publisher><date type="published" when="2001"></date><biblScope unit="page" from="140" to="147"></biblScope></imprint></monogr></biblStruct><biblStruct xml:id="b5"><analytic><title level="a" type="main">Sagas</title><author><persName><forename type="first">H</forename><surname>Garcia-Molina</surname></persName></author><author><persName><forename type="first">K</forename><surname>Salem</surname></persName></author></analytic><monogr><title level="m">SIGMOD '87: Proceedings of the 1987 ACM SIGMOD international conference on Management of data</title><imprint><publisher>ACM Press</publisher><date type="published" when="1987"></date><biblScope unit="page" from="249" to="259"></biblScope></imprint></monogr></biblStruct><biblStruct xml:id="b6"><analytic><title level="a" type="main">Recording and using provenance in a protein compressibility experiment</title><author><persName><forename type="first">P</forename><surname>Groth</surname></persName></author><author><persName><forename type="first">S</forename><surname>Miles</surname></persName></author><author><persName><forename type="first">W</forename><surname>Fang</surname></persName></author><author><persName><forename type="first">S</forename><forename type="middle">C</forename><surname>Wong</surname></persName></author><author><persName><forename type="first">K.-P</forename><surname>Zauner</surname></persName></author><author><persName><forename type="first">L</forename><surname>Moreau</surname></persName></author></analytic><monogr><title level="m">Proc. of the 14th IEEE International Symposium on High Performance Distributed Computing (HPDC'05)</title><meeting>. of the 14th IEEE International Symposium on High Performance Distributed Computing (HPDC'05)<address><addrLine>Research Triangle Park, North Carolina, U.S.A.</addrLine></address></meeting><imprint><date type="published" when="2005-07"></date></imprint></monogr></biblStruct><biblStruct xml:id="b7"><monogr><title level="m" type="main">Production workflow: concepts and techniques</title><author><persName><forename type="first">F</forename><surname>Leymann</surname></persName></author><author><persName><forename type="first">D</forename><surname>Roller</surname></persName></author><imprint><date type="published" when="2000"></date><publisher>Prentice Hall</publisher></imprint></monogr></biblStruct><biblStruct xml:id="b8"><analytic><title></title><author><persName><forename type="first">B</forename><surname>Ludascher</surname></persName></author><author><persName><forename type="first">I</forename><surname>Altintas</surname></persName></author><author><persName><forename type="first">C</forename><surname>Berkley</surname></persName></author><author><persName><forename type="first">D</forename><surname>Higgins</surname></persName></author><author><persName><forename type="first">E</forename><surname>Jaeger</surname></persName></author><author><persName><forename type="first">M</forename><surname>Jones</surname></persName></author><author><persName><forename type="first">E</forename><forename type="middle">A</forename><surname>Lee</surname></persName></author><author><persName><forename type="first">J</forename><surname>Tao</surname></persName></author><author><persName><forename type="first">Y</forename><surname>Zhao</surname></persName></author></analytic><monogr><title level="m">Scientific workflow management and the kepler system: Research articles</title><imprint><date type="published" when="2006"></date><biblScope unit="page" from="1039" to="1065"></biblScope></imprint></monogr></biblStruct><biblStruct xml:id="b9"><analytic><title level="a" type="main">The requirements of recording and using provenance in e-science experiments</title><author><persName><forename type="first">S</forename><surname>Miles</surname></persName></author><author><persName><forename type="first">P</forename><surname>Groth</surname></persName></author><author><persName><forename type="first">M</forename><surname>Branco</surname></persName></author><author><persName><forename type="first">L</forename><surname>Moreau</surname></persName></author></analytic><monogr><title level="j">Journal of Grid Computing</title><imprint><date type="published" when="2006"></date></imprint></monogr></biblStruct><biblStruct xml:id="b10"><analytic><title level="a" type="main">A framework for collecting provenance in data-centric scientific workflows</title><author><persName><forename type="first">Y</forename><forename type="middle">L</forename><surname>Simmhan</surname></persName></author><author><persName><forename type="first">B</forename><surname>Plale</surname></persName></author><author><persName><forename type="first">D</forename><surname>Gannon</surname></persName></author></analytic><monogr><title level="m">Proc. of the IEEE International Conference on Web Services (ICWS'06)</title><meeting>. of the IEEE International Conference on Web Services (ICWS'06)<address><addrLine>Washington, DC, USA</addrLine></address></meeting><imprint><date type="published" when="2006"></date><biblScope unit="page" from="427" to="436"></biblScope></imprint></monogr></biblStruct><biblStruct xml:id="b11"><analytic><title level="a" type="main">A taxonomy of scientific workflow systems for grid computing</title><author><persName><forename type="first">J</forename><surname>Yu</surname></persName></author><author><persName><forename type="first">R</forename><surname>Buyya</surname></persName></author></analytic><monogr><title level="j">SIGMOD Record</title><imprint><biblScope unit="volume">34</biblScope><biblScope unit="issue">3</biblScope><biblScope unit="page" from="44" to="49"></biblScope><date type="published" when="2005-09"></date></imprint></monogr></biblStruct></listBibl></back></text></istex:refBibTEI><json:item><type>refBibs</type><uri>https://api.istex.fr/document/48AE9890FC65C1CD833AEF9852CE22227CD35F7D/enrichments/refBibs</uri></json:item></enrichments></istex></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/CyberinfraV1/Data/Istex/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000219 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Istex/Corpus/biblio.hfd -nk 000219 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= CyberinfraV1
|flux= Istex
|étape= Corpus
|type= RBID
|clé= ISTEX:48AE9890FC65C1CD833AEF9852CE22227CD35F7D
|texte= A Dataflow-Oriented Atomicity and Provenance System for Pipelined Scientific Workflows
}}
| This area was generated with Dilib version V0.6.25. |  |