Validity of stimulus and response components in a video test of social competence

Various stimulus components (video, orally-presented questions) and response components (multiple-choice, written, orally-given replies) of situational judgement tests of occupational social competency were investigated as to their impact upon the validity for a behavior-oriented role playing criterion while keeping test content constant. The stimulus component video alone had no impact upon validity. The response components contributed to validity. Validity increased with improved fidelity of response components. Concerning stimulus-response-combinations, the validity of two video tests (r = 0.17 and r = 0.36) was not higher than the validity of similar oral questioning (r = 0.13 and r = 0.37) but was significantly lower than a situational interview (r = 0.59). Response fidelity proved to be a bottleneck regarding validity of video tests. As a result, it is recommended that, in order to maximize validity of video and multimedia efforts, the developers of video- and multimedia tests focus special attention on response fidelity.