| Definition | A 3 rows by 4 modified version of Sutton’s windy world implemented as an Ai Gym environment |
| No of environments | 5 |
A 3 rows by 4 modified version of Sutton’s windy world implemented as an Ai Gym environment. Its purpose its to test learning strategies where there is a tradeoff between a policy which yields an expected large reward with high risk (route through row 0) or an expected smaller reward but with a lower risk (route through row 3).
cols 012 state_labels
rows 0 SXE 0 3 6
1 OWO 1 4 7
2 OOO 2 5 8
Agent starts at S and the task is to reach E avoiding X.
In cell W the wind blows and pushes the agent towards X. The wind strength is 0 or 1.
Rewards are -1 for all O cells, 5 for E and -5 for X cell.
Done is set when agent reaches X or E.