This paper presents an ambient magnetic field map-based matching (MM) positioning algorithm for smartphones in an indoor environment. To improve the low distinguishability of a magnetic field fingerprint at a single point, a magnetic field sequence (MFS) combined with the measured trajectory contour coming from pedestrian dead-reckoning (PDR) is used for MM. Based on the fast approximation of magnetic field gradient, a Gauss-Newton iterative (GNI) method is used to find a rigid transformation that optimally aligns the measured MFS with a reference MFS coming from the magnetic field map. Then, the position of the reference MFS is used to control the position drift error of the inertial navigation system (INS) based PDR by an extended Kalman filter (EKF) and to further improve the accuracy of the trajectory contour. Finally, we conduct several experiments to evaluate the navigation performance of the proposed MM algorithm. The test results show that the position estimation error of the MM algorithm is 0.64 m (RMS) in an office building environment, 1.87 m (RMS) in a typical lobby environment, and 2.34 m (RMS) in a shopping mall environment.