CMPSCI 383, Fall 2011Homework 4Due in class or in the main office of the Computer Science building by 4:00 PM,December 6, 2011Problem 1:(10 points) Exercise 14.1 on page 558Problem 2:(10 points) Exercise 14.4 on page 559Problem 3:(10 points) Exercise 14.8 on page 561Problem 4:(20 points) Exercise 16.5 on page 641Problem 5:(10 points) Exercise 17.2 on page 688Problem 6:(15 points) Exercise 17.4 on page 688Programming Assignment:(25 points)For this programming assignment, you will implement thevalue iterational-gorithm for a5×5gridworld with no walls and a terminal goal in the bottomright corner. Useγ= 0.9. The agent has four possible actions,up, down, left,right. Each action achieves the intended effect with probability0.8, but the rest ofthe time, the action moves the agent at right angles to the intended direction (asin Figure 17.1). If the movement would take the agent into a wall, the agent doesnot move.Your program should read an input file,
This is the end of the preview.
access the rest of the document.