The Script Concordance Test is a suitable test for assessing clinical reasoning in postgraduate medical education. We present the first nationwide, realtime, web-based experience of a Script Concordance Test administered to 3rd year pediatric residents. The test was administered to 268 residents (postgraduate year 3), from 56 different programs, requiring 46.1 ± 27.1 minutes to complete it, and scoring 65.3 ± 7.47 points. A later survey showed limited satisfaction from participants. This experience showed that this kind of test is feasible in this setting.