ECE183DA Problem Set 1 Submission, Richard W. NOTE: SUBMISSION IS INCOMPLETE

Calling run.py

Please see comments in code(main.py) for responses. To find responses to questions 1-5, search the file using ctrl+F for 'N(x)'. Here 'N' in {1,2,3,4,5} refers to the problem number part 'x' in {a,b,c,...}.

0(a). Discussed problem set with Timothy L. 0(b). Resources consulted:

1. https://en.wikipedia.org/wiki/Markov_decision_process
2. https://www.cs.cmu.edu/afs/cs/academic/class/15780-s16/www/slides/mdps.pdf

• main.py
• run.py
• state.py