The IRMA Community
Newsletters
Research IRM
Click a keyword to search titles using our InfoSci-OnDemand powered search:
|
Analyzing Process Data from Problem-Solving Items with N-Grams: Insights from a Computer-Based Large-Scale Assessment
Abstract
This chapter draws on process data recorded in a computer-based large-scale program, the Programme for International Assessment of Adult Competencies (PIAAC), to address how sequences of actions recorded in problem-solving tasks are related to task performance. The purpose of this study is twofold: first, to extract and detect robust sequential action patterns that are associated with success or failure on a problem-solving item, and second, to compare the extracted sequence patterns among selected countries. Motivated by the methodologies of natural language processing and text mining, we utilized feature selection models in analyzing the process data at a variety of aggregate levels and evaluated the different methodologies in terms of predictive power of the evidence extracted from process data. It was found that action sequence patterns significantly differed by performance groups and were consistent across countries. This study also demonstrated that the process data were useful in detecting missing data and potential mistakes in item development.
Related Content
|
Deepak Gupta, Someshwar Siddi, Kuldipsinh Jadeja, Gunda Srinivasa Rao, V. Vijayavadivu, Prashant Ahire.
© 2026.
40 pages.
|
|
Mohamed Abdelhadi Mitwally, Lilia Cheniti-Belcadhi, Asma Hadyaoui.
© 2026.
36 pages.
|
|
Vladislav Valentinovich Sepp, Sandji Viktorovich Ubushaev, Konstantin Sergeevich Bakulin, Nguyen Thao Nguyen Phan.
© 2026.
40 pages.
|
|
Muhammad Usman Tariq.
© 2026.
30 pages.
|
|
Vivit Rosmayanti, Kurnia Rusli, Guntur Roryngosan Fara.
© 2026.
30 pages.
|
|
Arun Agrawal, Angel Ruth Shalom Banerjee, Manoj Kumar Jhariya, Neerja Garg, Iram Hashmi, Vinaydeep Brar, Deepak Gupta, Deepak Kumar Mishra.
© 2026.
26 pages.
|
|
Lilia Cheniti-Belcadhi, Asma Hadyaoui, Mohamed A. A. Mitwally.
© 2026.
36 pages.
|
|
|