MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems
Identifieur interne : 000F71 ( Istex/Corpus ); précédent : 000F70; suivant : 000F72MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems
Auteurs : Iadine Chadès ; Guillaume Chapron ; Marie-Josée Cros ; Frédérick Garcia ; Régis SabbadinSource :
- Ecography [ 0906-7590 ] ; 2014-09.
Abstract
Stochastic dynamic programming (SDP) or Markov decision processes (MDP) are increasingly being used in ecology to find the best decisions over time and under uncertainty so that the chance of achieving an objective is maximised. To date, few programs are available to solve SDP/MDP. We present MDPtoolbox, a multi‐platform set of functions to solve Markov decision problems (MATLAB, GNU Octave, Scilab and R). MDPtoolbox provides state‐of‐the‐art and ready to use algorithms to solve a wide range of MDPs. MDPtoolbox is easy to use, freely available and has been continuously improved since 2004. We illustrate how to use MDPtoolbox on a dynamic reserve design problem.
Url:
DOI: 10.1111/ecog.00888
Links to Exploration step
ISTEX:5358F5E00125CDBC7C7419D57192ACC07F95911CLe document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems</title><author><name sortKey="Chades, Iadine" sort="Chades, Iadine" uniqKey="Chades I" first="Iadine" last="Chadès">Iadine Chadès</name><affiliation><mods:affiliation>E-mail: iadine.chades@csiro.au</mods:affiliation></affiliation><affiliation><mods:affiliation>CSIRO Ecosystem Sciences, GPO Box 2583, QLD 4001, Brisbane, Australia</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: iadine.chades@csiro.au</mods:affiliation></affiliation></author><author><name sortKey="Chapron, Guillaume" sort="Chapron, Guillaume" uniqKey="Chapron G" first="Guillaume" last="Chapron">Guillaume Chapron</name><affiliation><mods:affiliation>Grimsö Wildlife Research Station, Swedish Univ. of Agricultural Sciences, Riddarhyttan, SE‐73091, Sweden</mods:affiliation></affiliation></author><author><name sortKey="Cros, Marie Osee" sort="Cros, Marie Osee" uniqKey="Cros M" first="Marie-Josée" last="Cros">Marie-Josée Cros</name><affiliation><mods:affiliation>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex, France</mods:affiliation></affiliation></author><author><name sortKey="Garcia, Frederick" sort="Garcia, Frederick" uniqKey="Garcia F" first="Frédérick" last="Garcia">Frédérick Garcia</name><affiliation><mods:affiliation>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex, France</mods:affiliation></affiliation></author><author><name sortKey="Sabbadin, Regis" sort="Sabbadin, Regis" uniqKey="Sabbadin R" first="Régis" last="Sabbadin">Régis Sabbadin</name><affiliation><mods:affiliation>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex, France</mods:affiliation></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:5358F5E00125CDBC7C7419D57192ACC07F95911C</idno><date when="2014" year="2014">2014</date><idno type="doi">10.1111/ecog.00888</idno><idno type="url">https://api.istex.fr/document/5358F5E00125CDBC7C7419D57192ACC07F95911C/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">000F71</idno><idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Corpus" wicri:corpus="ISTEX">000F71</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main">MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems</title><author><name sortKey="Chades, Iadine" sort="Chades, Iadine" uniqKey="Chades I" first="Iadine" last="Chadès">Iadine Chadès</name><affiliation><mods:affiliation>E-mail: iadine.chades@csiro.au</mods:affiliation></affiliation><affiliation><mods:affiliation>CSIRO Ecosystem Sciences, GPO Box 2583, QLD 4001, Brisbane, Australia</mods:affiliation></affiliation><affiliation><mods:affiliation>E-mail: iadine.chades@csiro.au</mods:affiliation></affiliation></author><author><name sortKey="Chapron, Guillaume" sort="Chapron, Guillaume" uniqKey="Chapron G" first="Guillaume" last="Chapron">Guillaume Chapron</name><affiliation><mods:affiliation>Grimsö Wildlife Research Station, Swedish Univ. of Agricultural Sciences, Riddarhyttan, SE‐73091, Sweden</mods:affiliation></affiliation></author><author><name sortKey="Cros, Marie Osee" sort="Cros, Marie Osee" uniqKey="Cros M" first="Marie-Josée" last="Cros">Marie-Josée Cros</name><affiliation><mods:affiliation>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex, France</mods:affiliation></affiliation></author><author><name sortKey="Garcia, Frederick" sort="Garcia, Frederick" uniqKey="Garcia F" first="Frédérick" last="Garcia">Frédérick Garcia</name><affiliation><mods:affiliation>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex, France</mods:affiliation></affiliation></author><author><name sortKey="Sabbadin, Regis" sort="Sabbadin, Regis" uniqKey="Sabbadin R" first="Régis" last="Sabbadin">Régis Sabbadin</name><affiliation><mods:affiliation>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex, France</mods:affiliation></affiliation></author></analytic><monogr></monogr><series><title level="j" type="main">Ecography</title><title level="j" type="alt">ECOGRAPHY</title><idno type="ISSN">0906-7590</idno><idno type="eISSN">1600-0587</idno><imprint><biblScope unit="vol">37</biblScope><biblScope unit="issue">9</biblScope><biblScope unit="page" from="916">916</biblScope><biblScope unit="page" to="920">920</biblScope><biblScope unit="page-count">5</biblScope><publisher>Blackwell Publishing Ltd</publisher><pubPlace>Oxford, UK</pubPlace><date type="published" when="2014-09">2014-09</date></imprint><idno type="ISSN">0906-7590</idno></series></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">0906-7590</idno></seriesStmt></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Stochastic dynamic programming (SDP) or Markov decision processes (MDP) are increasingly being used in ecology to find the best decisions over time and under uncertainty so that the chance of achieving an objective is maximised. To date, few programs are available to solve SDP/MDP. We present MDPtoolbox, a multi‐platform set of functions to solve Markov decision problems (MATLAB, GNU Octave, Scilab and R). MDPtoolbox provides state‐of‐the‐art and ready to use algorithms to solve a wide range of MDPs. MDPtoolbox is easy to use, freely available and has been continuously improved since 2004. We illustrate how to use MDPtoolbox on a dynamic reserve design problem.</div></front></TEI><istex><corpusName>wiley</corpusName><author><json:item><name>Iadine Chadès</name><affiliations><json:string>E-mail: iadine.chades@csiro.au</json:string><json:string>CSIRO Ecosystem Sciences, GPO Box 2583, QLD 4001, Brisbane, Australia</json:string><json:string>E-mail: iadine.chades@csiro.au</json:string></affiliations></json:item><json:item><name>Guillaume Chapron</name><affiliations><json:string>Grimsö Wildlife Research Station, Swedish Univ. of Agricultural Sciences, Riddarhyttan, SE‐73091, Sweden</json:string></affiliations></json:item><json:item><name>Marie‐Josée Cros</name><affiliations><json:string>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex, France</json:string></affiliations></json:item><json:item><name>Frédérick Garcia</name><affiliations><json:string>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex, France</json:string></affiliations></json:item><json:item><name>Régis Sabbadin</name><affiliations><json:string>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex, France</json:string></affiliations></json:item></author><articleId><json:string>ECOG888</json:string></articleId><arkIstex>ark:/67375/WNG-0NDXKMBW-F</arkIstex><language><json:string>eng</json:string></language><originalGenre><json:string>article</json:string></originalGenre><abstract>Stochastic dynamic programming (SDP) or Markov decision processes (MDP) are increasingly being used in ecology to find the best decisions over time and under uncertainty so that the chance of achieving an objective is maximised. To date, few programs are available to solve SDP/MDP. We present MDPtoolbox, a multi‐platform set of functions to solve Markov decision problems (MATLAB, GNU Octave, Scilab and R). MDPtoolbox provides state‐of‐the‐art and ready to use algorithms to solve a wide range of MDPs. MDPtoolbox is easy to use, freely available and has been continuously improved since 2004. We illustrate how to use MDPtoolbox on a dynamic reserve design problem.</abstract><qualityIndicators><refBibsNative>true</refBibsNative><abstractWordCount>104</abstractWordCount><abstractCharCount>669</abstractCharCount><keywordCount>0</keywordCount><score>6.192</score><pdfWordCount>2944</pdfWordCount><pdfCharCount>18367</pdfCharCount><pdfVersion>1.3</pdfVersion><pdfPageCount>5</pdfPageCount><pdfPageSize>595.276 x 782.362 pts</pdfPageSize></qualityIndicators><title>MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems</title><genre><json:string>article</json:string></genre><host><title>Ecography</title><language><json:string>unknown</json:string></language><doi><json:string>10.1111/(ISSN)1600-0587</json:string></doi><issn><json:string>0906-7590</json:string></issn><eissn><json:string>1600-0587</json:string></eissn><publisherId><json:string>ECOG</json:string></publisherId><volume>37</volume><issue>9</issue><pages><first>916</first><last>920</last><total>5</total></pages><genre><json:string>journal</json:string></genre><subject><json:item><value>Software note</value></json:item></subject></host><ark><json:string>ark:/67375/WNG-0NDXKMBW-F</json:string></ark><publicationDate>2014</publicationDate><copyrightDate>2014</copyrightDate><doi><json:string>10.1111/ecog.00888</json:string></doi><id>5358F5E00125CDBC7C7419D57192ACC07F95911C</id><score>1</score><fulltext><json:item><extension>pdf</extension><original>true</original><mimetype>application/pdf</mimetype><uri>https://api.istex.fr/document/5358F5E00125CDBC7C7419D57192ACC07F95911C/fulltext/pdf</uri></json:item><json:item><extension>zip</extension><original>false</original><mimetype>application/zip</mimetype><uri>https://api.istex.fr/document/5358F5E00125CDBC7C7419D57192ACC07F95911C/fulltext/zip</uri></json:item><istex:fulltextTEI uri="https://api.istex.fr/document/5358F5E00125CDBC7C7419D57192ACC07F95911C/fulltext/tei"><teiHeader><fileDesc><titleStmt><title level="a" type="main">MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems</title></titleStmt><publicationStmt><authority>ISTEX</authority><publisher>Blackwell Publishing Ltd</publisher><pubPlace>Oxford, UK</pubPlace><availability><licence>© 2014 The Authors</licence></availability><date type="published" when="2014-09"></date></publicationStmt><notesStmt><note type="content-type" subtype="article" source="article" scheme="https://content-type.data.istex.fr/ark:/67375/XTP-6N5SZHKN-D">article</note><note type="publication-type" subtype="journal" scheme="https://publication-type.data.istex.fr/ark:/67375/JMC-0GLKJH51-B">journal</note></notesStmt><sourceDesc><biblStruct type="article"><analytic><title level="a" type="main">MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems</title><author xml:id="author-0000"><persName><forename type="first">Iadine</forename><surname>Chadès</surname></persName><email>iadine.chades@csiro.au</email><affiliation><orgName>CSIRO Ecosystem Sciences</orgName><address><settlement type="city">Brisbane</settlement><postCode>QLD 4001</postCode><region>GPO Box 2583</region><country>Australia</country></address></affiliation></author><author xml:id="author-0001"><persName><forename type="first">Guillaume</forename><surname>Chapron</surname></persName><affiliation><orgName>Grimsö Wildlife Research Station, Swedish Univ. of Agricultural Sciences</orgName><address><postCode>SE‐73091</postCode><region>Riddarhyttan</region><country>Sweden</country></address></affiliation></author><author xml:id="author-0002"><persName><forename type="first">Marie‐Josée</forename><surname>Cros</surname></persName><affiliation><orgName>INRA, Unité de Mathématiques et Informatique Appliquées</orgName><address><region>Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex</region><country>France</country></address></affiliation></author><author xml:id="author-0003"><persName><forename type="first">Frédérick</forename><surname>Garcia</surname></persName><affiliation><orgName>INRA, Unité de Mathématiques et Informatique Appliquées</orgName><address><region>Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex</region><country>France</country></address></affiliation></author><author xml:id="author-0004"><persName><forename type="first">Régis</forename><surname>Sabbadin</surname></persName><affiliation><orgName>INRA, Unité de Mathématiques et Informatique Appliquées</orgName><address><region>Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex</region><country>France</country></address></affiliation></author><idno type="istex">5358F5E00125CDBC7C7419D57192ACC07F95911C</idno><idno type="ark">ark:/67375/WNG-0NDXKMBW-F</idno><idno type="DOI">10.1111/ecog.00888</idno><idno type="unit">ECOG888</idno><idno type="supplier">ecog888</idno><idno type="toTypesetVersion">file:ECOG.ECOG888.pdf</idno></analytic><monogr><title level="j" type="main">Ecography</title><title level="j" type="alt">ECOGRAPHY</title><idno type="pISSN">0906-7590</idno><idno type="eISSN">1600-0587</idno><idno type="book-DOI">10.1111/(ISSN)1600-0587</idno><idno type="book-part-DOI">10.1111/ecog.2014.v37.i9</idno><idno type="product">ECOG</idno><idno type="publisherDivision">ST</idno><imprint><biblScope unit="vol">37</biblScope><biblScope unit="issue">9</biblScope><biblScope unit="page" from="916">916</biblScope><biblScope unit="page" to="920">920</biblScope><biblScope unit="page-count">5</biblScope><publisher>Blackwell Publishing Ltd</publisher><pubPlace>Oxford, UK</pubPlace><date type="published" when="2014-09"></date></imprint></monogr></biblStruct></sourceDesc></fileDesc><profileDesc><abstract xml:lang="en" style="main"><p>Stochastic dynamic programming (SDP) or Markov decision processes (MDP) are increasingly being used in ecology to find the best decisions over time and under uncertainty so that the chance of achieving an objective is maximised. To date, few programs are available to solve SDP/MDP. We present MDPtoolbox, a multi‐platform set of functions to solve Markov decision problems (MATLAB, GNU Octave, Scilab and R). MDPtoolbox provides state‐of‐the‐art and ready to use algorithms to solve a wide range of MDPs. MDPtoolbox is easy to use, freely available and has been continuously improved since 2004. We illustrate how to use MDPtoolbox on a dynamic reserve design problem.</p></abstract><textClass><keywords rend="articleCategory"><term>Software note</term></keywords><keywords rend="tocHeading1"><term>Software notes</term></keywords></textClass><langUsage><language ident="en"></language></langUsage></profileDesc></teiHeader></istex:fulltextTEI></fulltext><metadata><istex:metadataXml wicri:clean="Wiley, elements deleted: body"><istex:xmlDeclaration>version="1.0" encoding="UTF-8" standalone="yes"</istex:xmlDeclaration><istex:document><component version="2.0" type="serialArticle" xml:lang="en" xml:id="ecog888"><header><publicationMeta level="product"><publisherInfo><publisherName>Blackwell Publishing Ltd</publisherName><publisherLoc>Oxford, UK</publisherLoc></publisherInfo><doi origin="wiley" registered="yes">10.1111/(ISSN)1600-0587</doi><issn type="print">0906-7590</issn><issn type="electronic">1600-0587</issn><idGroup><id type="product" value="ECOG"></id><id type="publisherDivision" value="ST"></id></idGroup><titleGroup><title type="main" sort="ECOGRAPHY">Ecography</title><title type="short">Ecography</title></titleGroup></publicationMeta><publicationMeta level="part" position="09109"><doi origin="wiley">10.1111/ecog.2014.v37.i9</doi><copyright ownership="publisher">Ecography © 2014 Nordic Society Oikos</copyright><numberingGroup><numbering type="journalVolume" number="37">37</numbering><numbering type="journalIssue" number="9">9</numbering></numberingGroup><coverDate startDate="2014-09">September 2014</coverDate></publicationMeta><publicationMeta level="unit" position="110" type="article" status="forIssue"><doi origin="wiley" registered="yes">10.1111/ecog.00888</doi><idGroup><id type="unit" value="ECOG888"></id><id type="supplier" value="ecog888"></id></idGroup><countGroup><count type="pageTotal" number="5"></count></countGroup><titleGroup><title type="articleCategory">Software note</title><title type="tocHeading1">Software notes</title></titleGroup><copyright>© 2014 The Authors</copyright><eventGroup><event type="manuscriptAccepted" date="2014-05-09"></event><event type="xmlCreated" agent="Deanta Publishing Services Pvt Ltd." date="2014-07-10"></event><event type="publishedOnlineEarlyUnpaginated" date="2014-07-14"></event><event type="firstOnline" date="2014-07-14"></event><event type="publishedOnlineFinalForm" date="2014-08-26"></event><event type="xmlConverted" agent="Converter:WML3G_To_WML3G version:4.6.4 mode:FullText" date="2015-10-08"></event></eventGroup><numberingGroup><numbering type="pageFirst">916</numbering><numbering type="pageLast">920</numbering></numberingGroup><linkGroup><link type="toTypesetVersion" href="file:ECOG.ECOG888.pdf"></link></linkGroup></publicationMeta><contentMeta><countGroup><count type="figureTotal" number="1"></count><count type="tableTotal" number="2"></count><count type="formulaTotal" number="5"></count><count type="referenceTotal" number="24"></count></countGroup><titleGroup><title type="main">MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems</title></titleGroup><creators><creator creatorRole="author" xml:id="cr1" affiliationRef="#aff-1"><personName><givenNames>Iadine</givenNames><familyName>Chadès</familyName></personName><contactDetails><email>iadine.chades@csiro.au</email></contactDetails></creator><creator creatorRole="author" xml:id="cr2" affiliationRef="#aff-2"><personName><givenNames>Guillaume</givenNames><familyName>Chapron</familyName></personName></creator><creator creatorRole="author" xml:id="cr3" affiliationRef="#aff-3"><personName><givenNames>Marie‐Josée</givenNames><familyName>Cros</familyName></personName></creator><creator creatorRole="author" xml:id="cr4" affiliationRef="#aff-3"><personName><givenNames>Frédérick</givenNames><familyName>Garcia</familyName></personName></creator><creator creatorRole="author" xml:id="cr5" affiliationRef="#aff-3"><personName><givenNames>Régis</givenNames><familyName>Sabbadin</familyName></personName></creator></creators><affiliationGroup><affiliation xml:id="aff-1"><orgName>CSIRO Ecosystem Sciences</orgName> <address><countryPart>GPO Box 2583</countryPart> <city>Brisbane</city> <postCode>QLD 4001</postCode> <country>Australia</country></address></affiliation><affiliation xml:id="aff-2"><orgName>Grimsö Wildlife Research Station, Swedish Univ. of Agricultural Sciences</orgName> <address><postCode>SE‐73091</postCode> <countryPart>Riddarhyttan</countryPart> <country>Sweden</country></address></affiliation><affiliation xml:id="aff-3"><orgName>INRA, Unité de Mathématiques et Informatique Appliquées</orgName> <address><countryPart>Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex</countryPart> <country>France</country></address></affiliation></affiliationGroup><abstractGroup><abstract type="main" xml:lang="en"><p>Stochastic dynamic programming (SDP) or Markov decision processes (MDP) are increasingly being used in ecology to find the best decisions over time and under uncertainty so that the chance of achieving an objective is maximised. To date, few programs are available to solve SDP/MDP. We present MDPtoolbox, a multi‐platform set of functions to solve Markov decision problems (MATLAB, GNU Octave, Scilab and R). MDPtoolbox provides state‐of‐the‐art and ready to use algorithms to solve a wide range of MDPs. MDPtoolbox is easy to use, freely available and has been continuously improved since 2004. We illustrate how to use MDPtoolbox on a dynamic reserve design problem.</p></abstract></abstractGroup></contentMeta></header></component></istex:document></istex:metadataXml><mods version="3.6"><titleInfo lang="en"><title>MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems</title></titleInfo><titleInfo type="alternative" contentType="CDATA" lang="en"><title>MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems</title></titleInfo><name type="personal"><namePart type="given">Iadine</namePart><namePart type="family">Chadès</namePart><affiliation>E-mail: iadine.chades@csiro.au</affiliation><affiliation>CSIRO Ecosystem Sciences, GPO Box 2583, QLD 4001, Brisbane, Australia</affiliation><affiliation>E-mail: iadine.chades@csiro.au</affiliation><role><roleTerm type="text">author</roleTerm></role></name><name type="personal"><namePart type="given">Guillaume</namePart><namePart type="family">Chapron</namePart><affiliation>Grimsö Wildlife Research Station, Swedish Univ. of Agricultural Sciences, Riddarhyttan, SE‐73091, Sweden</affiliation><role><roleTerm type="text">author</roleTerm></role></name><name type="personal"><namePart type="given">Marie‐Josée</namePart><namePart type="family">Cros</namePart><affiliation>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex, France</affiliation><role><roleTerm type="text">author</roleTerm></role></name><name type="personal"><namePart type="given">Frédérick</namePart><namePart type="family">Garcia</namePart><affiliation>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex, France</affiliation><role><roleTerm type="text">author</roleTerm></role></name><name type="personal"><namePart type="given">Régis</namePart><namePart type="family">Sabbadin</namePart><affiliation>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex, France</affiliation><role><roleTerm type="text">author</roleTerm></role></name><typeOfResource>text</typeOfResource><genre type="article" displayLabel="article" authority="ISTEX" authorityURI="https://content-type.data.istex.fr" valueURI="https://content-type.data.istex.fr/ark:/67375/XTP-6N5SZHKN-D">article</genre><originInfo><publisher>Blackwell Publishing Ltd</publisher><place><placeTerm type="text">Oxford, UK</placeTerm></place><dateIssued encoding="w3cdtf">2014-09</dateIssued><dateCreated encoding="w3cdtf">2014-07-10</dateCreated><dateValid encoding="w3cdtf">2014-05-09</dateValid><copyrightDate encoding="w3cdtf">2014</copyrightDate></originInfo><language><languageTerm type="code" authority="rfc3066">en</languageTerm><languageTerm type="code" authority="iso639-2b">eng</languageTerm></language><physicalDescription><extent unit="figures">1</extent><extent unit="tables">2</extent><extent unit="formulas">5</extent><extent unit="references">24</extent></physicalDescription><abstract lang="en">Stochastic dynamic programming (SDP) or Markov decision processes (MDP) are increasingly being used in ecology to find the best decisions over time and under uncertainty so that the chance of achieving an objective is maximised. To date, few programs are available to solve SDP/MDP. We present MDPtoolbox, a multi‐platform set of functions to solve Markov decision problems (MATLAB, GNU Octave, Scilab and R). MDPtoolbox provides state‐of‐the‐art and ready to use algorithms to solve a wide range of MDPs. MDPtoolbox is easy to use, freely available and has been continuously improved since 2004. We illustrate how to use MDPtoolbox on a dynamic reserve design problem.</abstract><relatedItem type="host"><titleInfo><title>Ecography</title></titleInfo><titleInfo type="abbreviated"><title>Ecography</title></titleInfo><genre type="journal" authority="ISTEX" authorityURI="https://publication-type.data.istex.fr" valueURI="https://publication-type.data.istex.fr/ark:/67375/JMC-0GLKJH51-B">journal</genre><subject><genre>article-category</genre><topic>Software note</topic></subject><identifier type="ISSN">0906-7590</identifier><identifier type="eISSN">1600-0587</identifier><identifier type="DOI">10.1111/(ISSN)1600-0587</identifier><identifier type="PublisherID">ECOG</identifier><part><date>2014</date><detail type="volume"><caption>vol.</caption><number>37</number></detail><detail type="issue"><caption>no.</caption><number>9</number></detail><extent unit="pages"><start>916</start><end>920</end><total>5</total></extent></part></relatedItem><identifier type="istex">5358F5E00125CDBC7C7419D57192ACC07F95911C</identifier><identifier type="ark">ark:/67375/WNG-0NDXKMBW-F</identifier><identifier type="DOI">10.1111/ecog.00888</identifier><identifier type="ArticleID">ECOG888</identifier><accessCondition type="use and reproduction" contentType="copyright">Ecography © 2014 Nordic Society Oikos© 2014 The Authors</accessCondition><recordInfo><recordContentSource authority="ISTEX" authorityURI="https://loaded-corpus.data.istex.fr" valueURI="https://loaded-corpus.data.istex.fr/ark:/67375/XBH-L0C46X92-X">wiley</recordContentSource><recordOrigin>Blackwell Publishing Ltd</recordOrigin></recordInfo></mods><json:item><extension>json</extension><original>false</original><mimetype>application/json</mimetype><uri>https://api.istex.fr/document/5358F5E00125CDBC7C7419D57192ACC07F95911C/metadata/json</uri></json:item></metadata><serie></serie></istex></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Asie/explor/AustralieFrV1/Data/Istex/Corpus
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000F71 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Istex/Corpus/biblio.hfd -nk 000F71 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Asie
|area= AustralieFrV1
|flux= Istex
|étape= Corpus
|type= RBID
|clé= ISTEX:5358F5E00125CDBC7C7419D57192ACC07F95911C
|texte= MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems
}}
| This area was generated with Dilib version V0.6.33. |  |