Current methods for diagnosing early stage osteoarthritis (OA) based on the magnetic resonance imaging and enzyme-linked immunosorbent assay methods are specific, but require specialized laboratory facilities and highly trained personal to obtain a definitive result. In this work, a user friendly and non-invasive quartz crystal microbalance (QCM) immunosensor method has been developed to detect Cartilage Oligomeric Matrix Protein (COMP) for early stage OA diagnosis. This QCM immunosensor was fabricated to immobilize COMP antibodies utilizing the self-assembled monolayer technique. The surface properties of the immunosensor were characterized by its FTIR and electrochemical impedance spectra (EIS). The feasibility study was based on urine samples obtained from 41 volunteers. Experiments were carried out in a flow system and the reproducibility of the electrodes was evaluated by the impedance measured by EIS. Its potential dynamically monitored the immunoreaction processes and could increase the efficiency and sensitivity of COMP detection in laboratory-cultured preparations and clinical samples. The frequency responses of the QCM immunosensor changed from 6 kHz when testing 50 ng/mL COMP concentration. The linear regression equation of frequency shift and COMP concentration was determined as: y = 0.0872 x + 1.2138 (R2 = 0.9957). The COMP in urine was also determined by both QCM and EIS for comparison. A highly sensitive, user friendly and cost effective analytical method for the early stage OA diagnosis has thus been successfully developed.