Over the course of 32 years, Tom Selleck kept his family away from the spotlight in order to “nurture” his marriage