AN ANALYSIS OF VALIDITY AND RELIABILITY OF COGNITIVE TAXONOMY ITEMS ON ENGLISH SUMMATIVE TEST AT SMA NURUL FALAH PEKANBARU

Abstract

Abstract: This study aimed to analyze the quality of summative test that was
conducted by the teacher at the eleventh grade of SMA Nurul Pekanbaru and was
constructed as descriptive quantitative research. The sample consisted of 53 students in
the second semester of the academic year 2020/2021 and was selected by using total
sampling with the lottery method. Furthermore, the instrument of English final test that
constructed in the form of 40 multiple choice questions was firstly identified and
grouped based on the classification of each domain of cognitive dimension according to
Bloom’s taxonomy revision that contained two levels namely HOTS (High Order
Thinking Skills) and LOTS (Low Order Thinking Skills). Then, all students’ answers
were analyzed by using SPSS (Statistical Package for the Social Sciences) version 25
for windows to analyze the validity and reliability of the test. The result showed that the
test questions just obtained 50% of applying (C3), 27.5% of understanding (C2), and
22.5% of remembering (C1) of LOTS levels whereas HOTS levels (analyzing,
evaluating, and creating) weren’t even found. Furthermore, its reliability quotient was
just 0.729 (lower than 1.00) with 3 (8%) items categorized as invalid questions, and the
valid items of 37 (92%) questions were predominantly classified in low interpretation.
This research clearly showed that the test didn’t fulfill the qualification of a good test.
Key Words: Validity, Reliability, Cognitive, Educational Taxonomies, Summative Test