We present a tabletop setup for extreme ultraviolet (EUV) reflection spectroscopy in the spectral range from 40 to 100 eV by using high-harmonic radiation. The simultaneous measurements of reference and sample spectra with high energy resolution provide precise and robust absolute reflectivity measurements, even when operating with spectrally fluctuating EUV sources. The stability and sensitivity of EUV reflectivity measurements are crucial factors for many applications in attosecond science, EUV spectroscopy, and nano-scale tomography. We show that the accuracy and stability of our in situ referencing scheme are almost one order of magnitude better in comparison to subsequent reference measurements. We demonstrate the performance of the setup by reflective near-edge x-ray absorption fine structure measurements of the aluminum L absorption edge in α-AlO and compare the results to synchrotron measurements.