|
10 | 10 | [](https://slackinvite.julialang.org) |
11 | 11 |
|
12 | 12 | This package provides a core interface for working with [Markov decision processes (MDPs)](https://en.wikipedia.org/wiki/Markov_decision_process) and [partially observable Markov decision processes (POMDPs)](https://en.wikipedia.org/wiki/Partially_observable_Markov_decision_process). |
13 | | -The [POMDPTools](https://juliapomdp.github.io/POMDPs.jl/stable/POMDPTools/#pomdptools_section) package acts as a "standard library" for the POMPDs.jl interface, providing implementations of commonly-used components such as policies, belief updaters, distributions, and simulators. |
| 13 | +The [POMDPTools](https://juliapomdp.github.io/POMDPs.jl/stable/POMDPTools/#pomdptools_section) package acts as a "standard library" for the POMDPs.jl interface, providing implementations of commonly-used components such as policies, belief updaters, distributions, and simulators. |
14 | 14 |
|
15 | 15 | Our goal is to provide a common programming vocabulary for: |
| 16 | + |
16 | 17 | 1. [Expressing problems as MDPs and POMDPs](http://juliapomdp.github.io/POMDPs.jl/stable/def_pomdp). |
17 | 18 | 2. Writing solver software. |
18 | 19 | 3. Running simulations efficiently. |
19 | 20 |
|
20 | 21 | POMDPs.jl integrates with other ecosystems: |
| 22 | + |
21 | 23 | - Python can be used to define and solve MDPs and POMDPs via the [quickpomdps](https://github.com/JuliaPOMDP/quickpomdps) package or through tables directly via [pyjulia](https://github.com/JuliaPy/pyjulia). |
22 | 24 | - POMDPTools provides [two-way integration](https://juliapomdp.github.io/POMDPModelTools.jl/stable/common_rl/#CommonRLInterface-Integration) with [CommonRLInterface](https://github.com/JuliaReinforcementLearning/CommonRLInterface.jl) and therefore with the [JuliaReinforcementLearning packages](https://github.com/JuliaReinforcementLearning/ReinforcementLearning.jl). |
23 | 25 | - The [SymbolicMDPs package](https://github.com/JuliaPlanners/SymbolicMDPs.jl) provides an interface to work with PDDL models. |
@@ -112,6 +114,21 @@ POMDPs.jl itself contains only the core interface for communicating about proble |
112 | 114 | | [POMDPTools](https://github.com/JuliaPOMDP/POMDPs.jl/tree/master/lib/POMDPTools) (hosted in this repository) | [](https://github.com/JuliaPOMDP/POMDPs.jl/actions/workflows/CI.yml) | | |
113 | 115 | | [ParticleFilters](https://github.com/JuliaPOMDP/ParticleFilters.jl) | [](https://github.com/JuliaPOMDP/ParticleFilters.jl) | [](http://codecov.io/github/JuliaPOMDP/ParticleFilters.jl?) | |
114 | 116 |
|
| 117 | +#### Implemented Models: |
| 118 | + |
| 119 | +Many models have been implemented using the POMDPs.jl interface for various projects. This list contains a few commonly used models: |
| 120 | + |
| 121 | +| **`Package`** | **`Build`** | **`Coverage`** | |
| 122 | +|-------------------|----------------------|------------------| |
| 123 | +| [POMDPModels](https://github.com/JuliaPOMDP/POMDPModels.jl) | [](https://travis-ci.org/JuliaPOMDP/POMDPModels.jl) | [](https://coveralls.io/github/JuliaPOMDP/POMDPModels.jl) | |
| 124 | +| [LaserTag](https://github.com/JuliaPOMDP/LaserTag.jl) | [](https://travis-ci.org/JuliaPOMDP/LaserTag.jl) | [](https://coveralls.io/github/JuliaPOMDP/LaserTag.jl?branch=master) | |
| 125 | +| [RockSample](https://github.com/JuliaPOMDP/RockSample.jl) | [](https://travis-ci.org/JuliaPOMDP/RockSample.jl) | [](https://coveralls.io/github/JuliaPOMDP/RockSample.jl?branch=master) | |
| 126 | +| [DroneSurveillance](https://github.com/JuliaPOMDP/DroneSurveillance.jl) | [](https://github.com/JuliaPOMDP/DroneSurveillance.jl/actions) | [](https://codecov.io/gh/juliapomdp/DroneSurveillance.jl) | |
| 127 | +| [ContinuumWorld](https://github.com/JuliaPOMDP/ContinuumWorld.jl) | [](https://travis-ci.org/JuliaPOMDP/ContinuumWorld.jl) | [](https://coveralls.io/github/JuliaPOMDP/ContinuumWorld.jl?branch=master) | |
| 128 | +| [VDPTag](https://github.com/zsunberg/VDPTag2.jl) | [](https://travis-ci.org/zsunberg/VDPTag2.jl) | | |
| 129 | +| [Roomba Localization](https://github.com/sisl/RoombaPOMDPs.jl) | [](https://travis-ci.org/sisl/RoombaPOMDPs.jl) | | |
| 130 | + |
| 131 | + |
115 | 132 | #### MDP solvers: |
116 | 133 |
|
117 | 134 | | **`Package`** | **`Build/Coverage`** | Online/<br>Offline | Continuous<br>States - Actions | Rating<sup>3</sup> | |
|
0 commit comments