So what is semi-formal for men ... In summer, light gray or khaki linen and cotton suits are acceptable but make sure they’re refined—not as though you’ve wandered in from a beach resort.