Chesapeake Blue by Nora Roberts

The first ten years of Seth Quinn’s life were a prison of fear and neglect – until he was rescued by the Quinns: father Ray, and hot-blooded brothers Phillip, Ethan and Cameron. Now an adult and successful artist, Seth returns home to Chesapeake Bay. There he meets Dru Banks, but while an attraction sparks, Dru's own history has taught her not to give her heart lightly. But Seth cannot ignore his feelings. If he is ever to win a place in Dru’s affections, he must finally face up to his own tragic past and the mother who betrayed him...