People couldn’t believe that I was saying no for any reason other than assuming my marriage was falling apart,” the former first lady said.