Grid-WorldΒΆ

Environments with discrete observation spaces, e.g., grid-worlds.

Env

Obs/Action spaces

Objectives

Description

deep-sea-treasure-v0

Discrete / Discrete

[treasure, time_penalty]

Agent is a submarine that must collect a treasure while taking into account a time penalty. Treasures values taken from Yang et al. 2019.

deep-sea-treasure-concave-v0

Discrete / Discrete

[treasure, time_penalty]

Agent is a submarine that must collect a treasure while taking into account a time penalty. Treasures values taken from Vamplew et al. 2010.

deep-sea-treasure-mirrored-v0

Discrete / Discrete

[treasure, time_penalty]

Harder version of the concave DST Felten et al. 2022.

resource-gathering-v0

Discrete / Discrete

[enemy, gold, gem]

Agent must collect gold or gem. Enemies have a 10% chance of killing the agent. From Barret & Narayanan 2008.

fishwood-v0

Discrete / Discrete

[fish_amount, wood_amount]

ESR environment, the agent must collect fish and wood to light a fire and eat. From Roijers et al. 2018.

breakable-bottles-v0

Discrete (Dictionary) / Discrete

[time_penalty, bottles_delivered, potential]

Gridworld with 5 cells. The agents must collect bottles from the source location and deliver to the destination. From Vamplew et al. 2021.

fruit-tree-v0

Discrete / Discrete

[nutri1, ..., nutri6]

Full binary tree of depth d=5,6 or 7. Every leaf contains a fruit with a value for the nutrients Protein, Carbs, Fats, Vitamins, Minerals and Water. From Yang et al. 2019.

four-room-v0

Discrete / Discrete

[item1, item2, item3]

Agent must collect three different types of items in the map and reach the goal. From Alegre et al. 2022.