What level of government has the power to control all elections?

This varies for country to country. But in most of the countries, The Electoral Commission oversees the conduct of elections in parliament and in state legislatures and in the offices of the President and Deputy President.

Elections Canada is a non-partisan organization responsible for conducting elections in Canada, including by-elections, by-elections and referendums. Supervised by the Chief Electoral Officer.

Hope it helps!