Click inside the image and hold the left mouse button to pan up or down.

Double click on the street to move up or down the street.

You can also use the mouse wheel to zoom in or out of a view.

<-- You can also drag the little figure around the map to go directly to a location.

Another alternative to the full screen view noted above is viewing both the street level view and map in a Larger Map