If you’re trying to cut costs, you may be torn over which is the cheapest ... or electric furnace, electric heating systems usually have a much lower upfront cost than gas heating systems.