‘Barring a funeral or someone in the hospital, I am not going to the United States,’ one Toronto resident said