Bismuth (Bi), a topological material, where many interesting condensed matter phenomena have been observed, possesses unique physical properties when its thickness is reduced to thin film. Here, we prepared the highly stable, single-crystalline, continuous Bi thin film via vapor deposition (VD) method, and found that the Bi thin film can exhibit broadband, ultrafast nonlinear optical response with low saturable intensity ranging from near infrared to mid-infrared spectral range under strong excitation. Moreover, we demonstrated that the Bi thin film was favorable to act as a nonlinear pulse modulator towards high performance pulsed laser operating in optical communication and mid-infrared wavelength. The experimental results highlight the prospects of Bi thin film as broadband pulsed modulators, and may open new avenues toward advanced Bi-based broadband photonic devices.