The former president would visit for meals but did not have massages there because he ‘had his own spa’