Many people aim for a well rounded and cohesive color scheme and style when choosing a location and wardrobe for portraits. You'll want to blend your clothing choices with the ambiance of your location. For instance photos near or in an old rustic barn, would fit best with casual clothes, jeans and flannel more so than prom dress and tux.
Spend some time planning ahead for your type of session to match the look you are going for. Color coordination is not as easy as it looks for some of us, so I am adding a link to some guides for color planning prior to your session.
You can also find many outfit and color scheme ideas on Pinterest. Searching for "Portrait wardrobe", "what to wear for family photos" etc will bring up many fun ideas to coordinate (rather than match) outfits.