We present a collision model to describe the charging of a quantum battery by identical non-equilibrium qubit units. When the units are prepared in a classical mixture of energy eigenstates, the energy gain in the battery can be described by a classical random walk, so that both average energy and variance grow linearly with time. In contrast, when the qubits feature quantum coherence, we show that interference effects build up in the distribution of the battery, leading to a fast spreading of its energy variance (quadratic in time), reminiscent of a quantum random walk. By initializing the battery in the ground state, such interference effects can be exploited for faster and more efficient battery charging. In particular, we show that coherent protocols can lead to higher charging power than any possible incoherent strategy. This demonstrates a quantum speed-up at the level of a single battery. Finally, we characterise the amount of extractable work from the battery through the notion of ergotropy.