The correct answers are Women's Winter Coats and Babies' Accessories.

For irregular plural nouns that do not end in s (like women, men, children), you must add an apostrophe + s (Women's, Men's, Children's).

For regular plural nouns that already end in s (like babies), you only add an apostrophe at the end (Babies').