Abstract
In high-stakes professional fields like maritime education, institutional summative assessments serve as critical gateways for validating student competency prior to graduation. This study evaluated the test quality, difficulty distribution, and curriculum alignment of the 100-item Comprehensive Examinations administered to the 2024–2025 graduating batch for the Bachelor of Science in Marine Transportation (BSMT) and Bachelor of Science in Marine Engineering (BSMarE) programs at the University of Cagayan Valley. Employing a descriptive document analysis design rooted in Classical Test Theory (CTT), the research qualitatively analyzed and interpreted an available archived psychometric dataset representing 712 examinees (425 BSMT and 287 BSMarE students) based on their pre-computed Facility (F) and Discrimination (D) indices.
Thematic analysis of the datasets revealed four primary findings: first, a severe psychometric range compression exists across both programs, with 97% of BSMT items and 96% of BSMarE items clustered exclusively within the "Easy" and "Average" difficulty bands, leaving the "Very Difficult" thresholds completely unrepresented (0%). Second, critical item-level structural flaws were isolated, including instances of negligible discrimination (e.g., BSMT Item 9, D = 0.10) and severe inverted discrimination where lower-performing student cohorts paradoxically outscored higher-performing peers due to ambiguous stems or keying errors. Third, a distinct programmatic asymmetry emerged, revealing that the marine engineering pathway skews significantly easier (43% Easy or Very Easy) than the marine transportation track, which clusters predominantly in the middle tier (65% Average).
The study concludes that a pronounced curriculum-assessment alignment gap exists, as the current examinations over-index on lower-order cognitive recall rather than validating the complex, high-order diagnostic troubleshooting demanded by international Standards of Training, Certification, and Watchkeeping (STCW) mandates. To satisfy the quality requirements of United Nations Sustainable Development Goal 4 (Quality Education) and the academic innovation benchmarks established by the World University Rankings for Innovation (WURI), the College of Maritime Education must transition from passive data archiving to active quality engineering. This requires systematically rewriting defective items, balancing difficulty distributions with scenario-based case studies, and creating a unified institutional item-banking policy to ensure summative evaluations genuinely verify real-world seafaring excellence.
Keywords: Item Analysis, Document Analysis, Maritime Education, BSMT & BSMarE, Curriculum Mapping, Test Quality, STCW Standards, SDG 4, WURI Innovation.
