Measuring Problem Solving with Technology: A Demonstration Study for NAEP

  • Randy E Bennett ETS
  • Hilary Persky ETS
  • Andy Weiss ETS
  • Frank Jenkins Westat
Keywords: performance assessment, constructed response, simulation, NAEP


This paper describes a study intended to demonstrate how an emerging skill, problem solving with technology, might be measured in the National Assessment of Educational Progress (NAEP). Two computer-delivered assessment scenarios were designed, one on solving science-related problems through electronic information search and the other on solving science-related problems by conducting simulated experiments. The assessment scenarios were administered in 2003 to nationally representative samples of 8th-grade students in over 200 schools. Results are reported on the psychometric functioning of the scenarios and the performance of population groups. Implications are offered for using online performance assessment to measure emerging skills in NAEP and other large-scale testing programs.
How to Cite
Bennett, R. E., Persky, H., Weiss, A., & Jenkins, F. (2010). Measuring Problem Solving with Technology: A Demonstration Study for NAEP. The Journal of Technology, Learning and Assessment, 8(8). Retrieved from