Development and Validation of Written Exam Items for the Agricultural Hazardous Occupations Orders (AgHOs) Certification Training Program

Research was conducted to develop and validate a pool of exam items that can be used to test the readiness of youth, ages 14-15 years, to be certified under the current federally mandated Agricultural Hazardous Occupations Orders (AgHOs). The AgHOs require training prior to employment in agricultural workplaces that the Secretary of Labor has determined are especially hazardous for youth within the prescribed age range. Under the current provisions of the AgHOs certification process, non-exempt youth seeking employment in agriculture are required to pass a written exam concentrating on safe work practices as partial satisfaction to receive certification of eligibility for employment to perform certain tasks. However, the regulations provide little guidance concerning the format of the exam, subject matter to be covered, degree of difficulty, or minimum passing score. As part of the USDA-sponsored Hazardous Occupations Safety Training in Agriculture (HOSTA) initiative, efforts have been made to develop consistent and evidence-based testing methods for disseminating the test protocols to instructors. The goal was to expand, enhance, and maintain the reliability of the exam item pool for the AgHOs certification process. Item development was based on the HOSTA-supported Gearing Up for Safety: Production Agriculture Safety Training for Youth curriculum. To ensure adequate item availability, the current item pool was expanded to include a minimum of two test items for each of the 157 cognitive-based core competencies developed as part of the Gearing Up curriculum design process. Administering 70-item exams that were generated from the item pool to 568 youth, ages 13-18 years, provided evidence of item validity. The result was a pool of 367 validated exam items.