Table: Gridworld MDP Table: Gridworld MDP   Figure: Transition Function Figure: Transition Function Review Table: Gridworld MDP and Figure: Transition Function. The gridworld MDP operates like the one discussed in lecture. The states are grid squares, identified by their column (A, B, or C) and row (1 or 2) values, as presented in the table. The agent always starts in state (A,1), marked with the letter S. There are two terminal goal states: (B,1) with reward -5, and (B,2) with reward +5. Rewards are -0.1 in non-terminal states. (The reward for a state is received before the agent applies the next action.) The transition function in Figure: Transition Function is such that the intended agent movement (Up, Down, Left, or Right) happens with probability 0.8. The probability that the agent ends up in one of the states perpendicular to the intended direction is 0.1 each. If a collision with a wall happens, the agent stays in the same state, and the drift probability is added to the probability of remaining in the same state. The discounting factor is 1. Given this information, what will be the optimal policy for state (A,1)?

Actions: (:action moveTruck :parameters(?t – truck ?source_loc ?dest_loc – location) :precondition(and (truck_at ?t ?source_loc) (path ?source_loc ?dest_loc)) :effect(and (not (truck_at ?t ?source_loc)(truck_at ?loc ?dest_loc)) ) (:action load :parameters(?p – package ?t – truck ?loc – location) :precondition(and (package_at ?p ?loc)(truck_at ?t ?loc)) :effect(and (not (packeg_at ?p ?loc))(in ?p ?t)) ) (:action unload :parameters(?p – package ?t – truck ?loc – location) :precondition(and (truck_at ?t ?loc)(in ?p ?t)) :effect(and (not (in ?p ?t))(package_at ?p ?loc)) ) Current State: (truck_at truck_2 location_1)(truck_at truck_1 location_2)(package_at package_1 location_1)(package_at package_2 location_2)(path location_1 location_2)(path location_2 location_1) Consider the provided action descriptions and current state. Given this information, which action can be executed?

How does a stereo camera estimate the depth information of a target object?

Suppose that you are training a network with parameters [4.5, 2.5, 1.2, 0.6] , a learning rate of 0.3, and a gradient of [-1, 9, 2, 5] . After one update step of gradient descent, what would your network’s parameters be equal to?

Which explanation is the mathematical reason for vanishing gradients?

Suppose that you are given a set of noisy data points of the height and speed of soccer players. What should you use to approximate the joint distribution over these variables?

Suppose that you are trying to fit a neural network into data that were sampled from a sine-curve function. Your network has only one input (phase). Which neural network is best suited for this?

Consider this matrix: With zero-padding=1 and a stride size of 2, what would be the result after min pooling with pooling size 2?

Which answer choice is the correct Linear regression assumption?

Suppose you are training a neural network. One of the neurons has an input vector [12, 0.5, 3, -10, 0.04], weights [1.3, -2.5, 4, 0.3, 1]. What is the input to this neuron? Give your answer to two decimal places.