I prefer to go smaller when that's the case. You can adjust the cockpit of a shorter frame by running your seat a little higher and using a longer stem to find a comfortable reach.
However if a frame is too large you won't have that adaptability and you could run into issues with the overall standover height of the bike.