I haven't looked into the details yet, but I think it is possible. Just select the fleet, and click to another adjacent sea area. It does not seem to work at the beginning of the fight, I assume to force you to take some losses, but it does after a while. The movement arrow will be light blue, denoting it is a retreat.