Québec has one left: Christmas. We have a day off following Easter, but it's not a religious feastday. It can also be shifted to Good Friday by employers, which has resulted in many deciding to give both days off since doing business is too difficult and slow on both days.

Our thanksgiving isn't a religious celebration either, it's been imported by American immigrants of british descent to Lower Canada (now Québec) and has moved around the calendar a lot. It has been celebrated for all sort of things, the first time for a failure of the French revolutionaries to induce an insurrection in Lower Canada (in 1799, irrc), and even for victories against the US in the war in 1814. It eventually returned to its roots as a reaping festival, and nowadays if you ask, people will tell you it's the festival celebrating the death of a lot of turkeys (more seriously, it doesn't have nearly the importance of the US equivalent as a day for family reunions).

St-Jean-Baptiste isn't a religious holiday either, despite the old name (in Québec it's officially National Day now).

What were your others?