Occupational injury of the upper extremities account for 24% of occupational injuries in Taiwan. However, studies on the timing and factors influencing return-to-work is lacking. Methods: A total of 102 hospitalized workers with non-severe upper extremity fractures, defined as without avulsion, amputation and nerve damage, were interviewed over the telephone using a structured questionnaire at 45, 90 and 180 days after injury. Results: After controlling other factors, cases with other-than-digit fracture presented three-fold more difficulty than those with digit fracture on returning to work (OR, 0.32; 95% CI, 0.17–0.63). Male workers (OR, 2.70; 95% CI, 1.16–6.25) and those with financial help from their employer (OR, 2.32; 95% CI, 1.17–4.60) found it easier to return to work 90 days after injury. There were 32% who were still unable to return to work 180 days after injury. Conclusion: Women workers and workers without financial help from employers are at a disadvantage with regard to early return-to-work. Other assistance besides medical treatment could be of significant help but should be cautiously exercised in extrapolating to workers who are not the main breadwinner in their household.