Late May and early June might actually not be that hot yet. It has been a cold winter so far and predictions for this year are that it will be a mild spring and summer. So late May might actually still be cold.
In the churches, all would be a no-no. You would need a large lightweight scarf you can use to cover up bare shoulders and another to use as a wraparound skirt to cover legs at least to your knees so that you can even enter them, otherwise they will turn you away at the door.
Tanks and shorts are fine for walking around, but not daisy duke style.
Shorter shorts would most likely attract undue attention from those that don't know how to behave themselves so just a little longer would be better. Consider wearing cropped shorts/tights under mini dresses for the same reason.