We present lattice QCD results by the Budapest-Marseille-Wuppertal (BMW) Collaboration for the leading-order contribution of the hadron vacuum polarization (LOHVP) to the anomalous magnetic moments of all charged leptons. Calculations are performed with u, d, s and c quarks at their physical masses, in volumes of linear extent larger than 6 fm, and at six values of the lattice spacing, allowing for controlled continuum extrapolations. All connected and disconnected contributions are calculated for not only the muon but also the electron and tau anomalous magnetic moments. Systematic uncertainties are thoroughly discussed and comparisons with other calculations and phenomenological estimates are made.