Miscellaneous

MO-Gymnasium also includes other miscellaneous multi-objective environments:

Env

Obs/Action spaces

Objectives

Description

water-reservoir-v0

Continuous / Continuous

[cost_flooding, deficit_water]

A Water reservoir environment. The agent executes a continuous action, corresponding to the amount of water released by the dam. From Pianosi et al. 2013.

minecart-v0

Continuous or Image / Discrete

[ore1, ore2, fuel]

Agent must collect two types of ores and minimize fuel consumption. From Abels et al. 2019.

mo-highway-v0 and mo-highway-fast-v0

Continuous / Discrete

[speed, right_lane, collision]

The agent’s objective is to reach a high speed while avoiding collisions with neighbouring vehicles and staying on the rightest lane. From highway-env.

mo-supermario-v0

Image / Discrete

[x_pos, time, death, coin, enemy]

[:warning: SuperMarioBrosEnv support is limited.] Multi-objective version of SuperMarioBrosEnv. Objectives are defined similarly as in Yang et al. 2019.