The former president said that even if people ‘passed away’ shortly after voting it would be ‘worth it’