ICILS 2018 #Deutschland. Dokumentation der Erhebungsinstrumente der zweiten Computer and Information Literacy Study

Mit der international vergleichenden Schulleistungsstudie ICILS 2018 (International Computer and Information Literacy Study) wurden zum zweiten Mal die computer- und informationsbezogenen Kompetenzen von Achtklässlerinnen und Achtklässlern in Deutschland im internationalen Vergleich untersucht. Zudem wurden erstmals im Rahmen eines internationalen Zusatzmoduls die Kompetenzen im Bereich ‚Computational Thinking‘ getestet. Darüber hinaus wurden mit der Studie ICILS 2018 umfangreiche Rahmendaten zum Erwerb dieser Kompetenzen mittels Hintergrundfragebögen für Schülerinnen und Schüler, Lehrpersonen, Schulleitungen und IT-Koordinatorinnen und IT-Koordinatoren erfasst. Zudem wurden erstmals im Rahmen eines internationalen Zusatzmoduls, an dem sich auch Deutschland beteiligte, die Kompetenzen im Bereich 'Computational Thinking' erhoben. Mit dieser Publikation werden die im Rahmen der Studie in Deutschland eingesetzten Erhebungsinstrumente dokumentiert. Die Dokumentation der Instrumente umfasst sowohl die international eingesetzten Instrumente in der deutschen Fassung als auch die nationalen Ergänzungen, die zusätzlich für Deutschland entwickelt wurden. Diese Dokumentation ergänzt die von der IEA (International Association for the Evaluation of Educational Achievement) vorgelegten Materialen zur Studie. Die nationale Dokumentation der Erhebungsinstrumente richtet sich an Wissenschaftlerinnen und Wissenschaftler ebenso wie an interessierte Akteurinnen und Akteure aus der Bildungsadministration und der schulischen Praxis.

The relationship between differences in students’ computer and information literacy and response times: an analysis of IEA-ICILS data

Background Due to the increasing use of information and communication technology, computer-related skills are important for all students in order to participate in the digital age (Fraillon, J., Ainley, J., Schulz, W., Friedman, T. & Duckworth, D. (2019). Preparing for life in a digital world: IEA International Computer and Information Literacy Study 2018 International Report. Amsterdam: International Association for the Evaluation of Educational Achievement (IEA). Retrieved from https://www.iea.nl/sites/default/files/2019-11/ICILS%202019%20Digital%20final%2004112019.pdf). Educational systems play a key role in the mediation of these skills (Eickelmann. Second Handbook of Information Technology in Primary and Secondary Education. Cham: Springer, 2018). However, previous studies have shown differences in students’ computer and information literacy (CIL). Although various approaches have been used to explain these differences, process data, such as response times, have never been taken into consideration. Based on data from the IEA-study ICILS 2013 of the Czech Republic, Denmark and Germany, this secondary analysis examines to what extent response times can be used as an explanatory approach for differences in CIL also within different groups of students according to student background characteristics (gender, socioeconomic background and immigrant background). Methods First, two processing profiles using a latent profile analysis (Oberski 2016) based on response times are determined—a fast and a slow processing profile. To detect how these profiles are related to students’ CIL, also in conjunction with students’ background characteristics (socioeconomic and immigrant background), descriptive statistics are used. Results The results show that in the Czech Republic and Germany, students belonging to the fast processing profile have on average significantly higher CIL than students allocated to the slow processing profile. In Denmark, there are no significant differences. Concerning the student background characteristics in the Czech Republic, there are significant negative time-on-task effects for all groups except for students with an immigrant background and students with a high parental occupational status. There are no significant differences in Denmark. For Germany, a significant negative time-on-task effect can be found among girls. However, the other examined indicators for Germany are ambiguous. Conclusions The results show that process data can be used to explain differences in students’ CIL: In the Czech Republic and Germany, there is a correlation between response times and CIL (significant negative time-on-task effect). Further analysis should also consider other aspects of CIL (e.g. reading literacy). What becomes clear, however, is that when interpreting and explaining differences in competence, data should also be included that relates to the completion process during testing.

Diagnostik von ICT Literacy: Messen Multiple-Choice-Aufgaben und simulationsbasierte Aufgaben vergleichbare Konstrukte?

Zusammenfassung. ICT Literacy legt eine performanzbasierte Erfassung mit simulierten und interaktiven Testaufgaben nahe. Der vorliegende Beitrag untersucht, ob mit Multiple-Choice (MC)-Aufgaben ein vergleichbares Konstrukt wie mit Simulationsaufgaben erfasst wird. Hierfür wurden die Testergebnisse zweier Instrumente aus aktuellen Large-Scale-Studien gegenübergestellt, die an N = 2 075 Jugendlichen erhoben wurden: der auf MC-Aufgaben basierende ICT Literacy-Test für Klasse 9 des Nationalen Bildungspanels (National Educational Panel Study, NEPS) und der simulationsbasierte Kompetenztest der internationalen Schulleistungsstudie ICILS 2013 (International Computer and Information Literacy Study). Die Analysen unterstützen die Gültigkeit der Konstruktinterpretation des MC-basierten Tests in NEPS. Im Sinne der konvergenten Evidenz korrelieren die MC-Aufgaben substanziell mit den computer- und simulationsbasierten Aufgaben in ICILS 2013 (.68 ≤ r ≤ .90). Weiterhin ergeben sich positive und für beide Tests vergleichbar hohe Korrelationen mit ICT-bezogenen Schülermerkmalen (z. B. Selbstwirksamkeit). Weiterführende Analysen zum Zusammenhang mit allgemeinen kognitiven Fähigkeiten zeigen zudem, dass ICT Literacy und kognitive Grundfähigkeiten distinkte Faktoren repräsentieren.

An evaluation of the library connectivity project through the lens of the digital inclusion model

Purpose It has been a decade, as the collaboration between the Ghana Investment Fund for Electronic Communications (GIFEC) and the Ghana Library Authority (GhLA) to extend information and communication technology (ICT) and library services to rural deprived, unserved and underserved communities in Ghana dubbed the library connectivity project. This paper aims to evaluate this initiative from the perspective of relevant key stakeholders and through the lens of the digital inclusion model. Design/methodology/approach The study adopted a qualitative approach to evaluate the library connectivity project offered to deprived communities in the Upper East Region of Ghana. Interviews were conducted with the head librarians, ICT teachers and school librarians. Focus group discussions were held with pupils from four beneficiary schools of the project. The researchers also witnessed four of the outreach programmes and training sessions and observed the mode of instruction. Findings The study brought to fore the enormous benefits of the library connectivity project as it aided school pupils to acquire practical ICT skills, which were found to be useful towards their final exam. Despite the enormous benefit of the project, it was bereft with a lot of challenges such as inadequate logistics and personnel thereby restricting the project to very few schools. Low staff motivation and unmotorable roads were also found to be a challenge, which could all be as a result of lack of funds. Research limitations/implications The paper underscores the importance of computer and information literacy and reveals how the GhLA is using innovative mobile library services to bridge the digital divide through the library connectivity project. Originality/value This paper makes a further contribution to the paucity of literature on the role of mobile libraries in the promotion of computer and information literacy.