Buy based on the style, layout and the amenities you want! The name on the side isn't important, Then find one worth buying. Does it really need to be stated when buying a used boat that condition is important? Well duh?????
I would not completely dismiss the build quality of a boat when buying something used & older used. My Larson 220 Hampton had a cheap deck hatch that self destructed before it was ten years old. No amount of care can change that. The Bomar in the SeaRay is a much better engineered and constructed hatch. 20 years old and it still works like new, better than the one in the Larson ever did. Larson attached many components on my Hampton with screws. Searay used nut/bolts with aluminum backing plates for the most part on the Sundancer. They used screws in some areas as well. Guess what fasteners tend to work their way loose after 20 years!
The cheap build quality of the Larson was irritating at times but I had no regrets buying it because it had such a great layout and no other 23' cuddy could touch it for amenities. So there's that!
Personally I don't find anything all that special about the Larson. I like all the windows in the cuddy of the Bayliner. I pretty much walked through every 24'-26' cruiser made when on the hunt for one 15 years ago. So my suggestion is don't sell yourself short. Check everything out you can. Even boats I didn't particularly care for the styling of, I stepped aboard.
In the end it was the test drive that sealed the deal for me w/Sundancer. As much as I liked the boat sitting on the trailer, once I drove it I knew I had to have it. So don't seal the deal without a sea test to make sure the boat doesn't have poor planing, ride or handling traits such as a bow that points to the sky when hitting the throttle or a hull that is overly sensitive to trim and immediately begins porpoise.
Good luck in your search!