Development and validation of a technological and informational literacy test (TILT) for end of secondary school

The objective of this study was to develop a reliable and valid test to ascertain ICT literacy 0 = Information and Communication Technologies Literacy). It was designed as a paper-and-pencil test to ensure that it can be used flexibly. The results of two studies (pilot study: N = 308; validation sample of the final form of the test: N = 263) showed satisfactory item and scale values and indicated the one-dimensional nature of the construct. Tests of the test instruments for convergence and discrimination validity showed the expected links with computer-related pupil characteristics. To supplement this, expert reviews indicated a satisfactory content validity. Analyses of the construct validity showed that ICT literacy was clearly distinguishable from general cognitive abilities and, at the same time, possessed incremental validity in addition to other measures of computer literacy. The findings are discussed in relation to open questions about the construct validity of the test instrument.