The maximum likelihood method is the most widely used estimation method. On the other hand, it can produce substantial bias, and an approximate confidence interval based on the maximum likelihood estimator cannot be valid when the sample size is small. Because the sizes of the record values are considerably smaller than the original sequence observed in the majority of cases, a method appropriate for this situation is required for precise inference. This paper provides the exact confidence intervals for unknown parameters and exact predictive intervals for the future upper record values by providing some pivotal quantities in the two-parameter Rayleigh distribution based on the upper record values. Finally, the validity of the proposed inference methods was examined from Monte Carlo simulations and real data.