I am happy to report that my boys got a huge kick out of selecting the fish to bring home (including the head).  One was surprised at the way it looked on the plate compared to the store (perfecto), and inhaled it (major kudos to my chef friend for bailing me out on how to cook my deep sea treasure).  The other was a little confused by the transformation, but enthralled that he was "eating from the ocean!”  Mind you, this certainly wasn’t the first time they’ve had fish, but it’s the first time they've really noticed.  The baby … well, he did what he does with everything, and threw it on the floor.  We’ve got some time to work on that.  Not so, though, for the fish head in my fridge … anyone got a good soup recipe?

Swanson’s Fish Market
Their location is not far off the Merritt, right in the mix with all of the other critical shopping along the pike.  They do catered clambakes, and therefore carry all the sides you’d like.
2439 Black Rock Turnpike, Fairfield, CT 06825
203-374-1577

Bridgeport Lobster & Shellfish
After an out-of-business blip in 2014, this joint is back at it, under the original owner.  It's seen a solid 25 years (they used to supply even Swanson’s), and locals LOVE this place. 
288 Knowlton St., Bridgeport, CT
203-579-0711

Ocean Fish Market
This is an absolutely no frills, fishy fish market, but it has a friendly, helpful staff and free filleting.  (It's also the nearby solution to the aforementioned Bridgeport Lobster & Shellfish problem).  Pick out your whole fish, pop it on the scale, and then grab some imported batters while they fllet it.
276 Boston Ave, Bridgeport, CT 06610
203-334-4900

Superior Seafood
You’ll find great seafood here, and will also be able to shop for the rest of your dinner, too.  It’s a bit tight, so with kids try to pick a slower time of day.  Oh, and buy their homemade salsa.  It’s unreal.
999 Post Road East, Westport, CT 06880
203-557-0844

Monroe Fish Market
You’ll get quality, but not so much quantity in terms of selection.  For folks in this part of the county, though, it saves a trip further down the coast.
477 Main St, Monroe, CT
203-268-7463

Food Bazaar
I haven’t been there myself, and can only assume it lacks ambiance (it’s a massive grocery store), but so many people talk about its selection.  You wanna eat octopus for dinner?  Head on over.
500 Sylvan Ave, Bridgeport, CT 06606
203-683-3740

Uberti’s
Eat-in if you want (their fish sandwiches get attention), and carry home more to cook.  Be warned their chowder isn’t cream-based.  Uberti’s sells their own sauces and marinades, and will offer up some cooking tips if you ask.
88 Ferry Blvd, Stratford, CT 06615
203-377-1429

Darien Seafood
Kitschy nautical decor fronts a kitchen churning out world class fish and chips.  I haven’t lived close to Darien in years, and I still crave it.  It pairs beautifully with Sam Adams Summer Ale which you may find at a location VERY nearby.  Oh yeah, the fish market.  They carry excellent seafood, clearly some cooking tips if you need them, and hey, free lemons with your purchase. 
1941 Post Rd, Darien, CT 06820
203-655-9124

Rowayton Seafood Fish Market
I love this place.  It’s in the most beautiful location, along the Five Mile River, in sleepy little Rowayton.  Here’s the drill.  Head there with your kids around 5, order from the market’s takeout window, carry your paper food boats and napkins to the harbor side deck and enjoy the closest thing to romantic you’re gonna get with young kids in tow.  Just pray someone in a fancy yacht doesn’t have the same idea at the same time.
89 Rowayton Ave, Norwalk, CT 06853
203-838-7473

Fjord Fisheries
They’re so good at this they’ve got three locations — Westport, New Canaan and Greenwich.  They personally select each fish they sell, and cut it themselves.  They pride themselves on knowing the source of their catch, and you will pay accordingly.  Prepared foods, catering and sushi also available.

ANGIE’S at AQUA Seafood Market
This unique program features food raised and harvested by aquaculture students in accordance with the commercial fishing industry and all state standards.  In addition to the locally raised fish, oysters and clams, they also have a wide selection of other seafood.  The market is open in conjunction with the fall semester, September - December, two days a week and is a stone’s throw from Captain’s Cove.  Cash only.
Bridgeport Aquaculture School
60 St. Stephens Road, Bridgeport, CT 06605
203-275-2926