Fluffy bantams like the ones you have do just fine in winter in my experience. My Cochin bantams and Cochin mixes are similar in stature to your birds and I do nothing different for them compared to my large fowl.
Tiny, less fluffy bantams like Sebrights and Old English may or may not do well...