Lovely thought! I have a friend who is a minimalist, she has about 30 items in her closet apart from the seasonal clothes. The point is to keep all you clothes that can be used in multiple ways, in other words, have mix and match options. Make sure to donate old stuff when you buy new ones.
It’s surprising how u kind of feel “Less is more” when you start a minimalist-life. All the best to you. Peace. 🙂