Hi,
I think the idea is to try to get a smooth transition out of Street View. If it was another way, a subset of users would complain about it being that way. There's no winning that game.
You can use the u shortcut key to return to 90°, or the r shortcut key to return to 90° and north up. There are other
shortcut keys that might help.
Also, you can use the backspace key to back up to each place you have stopped in that GE session. If you haven't gone far in Street View, that will take you back to the satellite view where you entered Street View.
I hope that helps.