Naturally occurring data as research instrument: analyzing examination responses to study the novice programmer

Raymond Lister, Tony Clear, Simon [No value], Dennis J. Bouvier, Paul Carter, Anna Eckerdal, Jana Jacková, Mike Lopez, Robert McCartney, Phil Robbins, Otto Seppälä, Errol Thompson

Research output: Contribution to journalArticle

Abstract

In New Zealand and Australia, the BRACElet project has been investigating students' acquisition of programming skills in introductory programming courses. The project has explored students' skills in basic syntax, tracing code, understanding code, and writing code, seeking to establish the relationships between these skills. This ITiCSE working group report presents the most recent step in the BRACElet project, which includes replication of earlier analysis using a far broader pool of naturally occurring data, refinement of the SOLO taxonomy in code-explaining questions, extension of the taxonomy to code-writing questions, extension of some earlier studies on students' 'doodling' while answering exam questions, and exploration of a further theoretical basis for work that until now has been primarily empirical.
Original languageEnglish
Pages (from-to)156-173
Number of pages23
JournalSIGCSE Bulletin
Volume41
Issue number4
DOIs
Publication statusPublished - Dec 2009

Fingerprint

students
Taxonomies
Students
Research
taxonomy
New Zealand

Keywords

  • novice programmers
  • tracing
  • CS1
  • comprehension
  • SOLO taxonomy

Cite this

Lister, R., Clear, T., [No value], S., Bouvier, D. J., Carter, P., Eckerdal, A., ... Thompson, E. (2009). Naturally occurring data as research instrument: analyzing examination responses to study the novice programmer. SIGCSE Bulletin, 41(4), 156-173. https://doi.org/10.1145/1709424
Lister, Raymond ; Clear, Tony ; [No value], Simon ; Bouvier, Dennis J. ; Carter, Paul ; Eckerdal, Anna ; Jacková, Jana ; Lopez, Mike ; McCartney, Robert ; Robbins, Phil ; Seppälä, Otto ; Thompson, Errol. / Naturally occurring data as research instrument : analyzing examination responses to study the novice programmer. In: SIGCSE Bulletin. 2009 ; Vol. 41, No. 4. pp. 156-173.
@article{f2a978c187b943708a767aec580d2330,
title = "Naturally occurring data as research instrument: analyzing examination responses to study the novice programmer",
abstract = "In New Zealand and Australia, the BRACElet project has been investigating students' acquisition of programming skills in introductory programming courses. The project has explored students' skills in basic syntax, tracing code, understanding code, and writing code, seeking to establish the relationships between these skills. This ITiCSE working group report presents the most recent step in the BRACElet project, which includes replication of earlier analysis using a far broader pool of naturally occurring data, refinement of the SOLO taxonomy in code-explaining questions, extension of the taxonomy to code-writing questions, extension of some earlier studies on students' 'doodling' while answering exam questions, and exploration of a further theoretical basis for work that until now has been primarily empirical.",
keywords = "novice programmers, tracing, CS1, comprehension, SOLO taxonomy",
author = "Raymond Lister and Tony Clear and {[No value]}, Simon and Bouvier, {Dennis J.} and Paul Carter and Anna Eckerdal and Jana Jackov{\'a} and Mike Lopez and Robert McCartney and Phil Robbins and Otto Sepp{\"a}l{\"a} and Errol Thompson",
year = "2009",
month = "12",
doi = "10.1145/1709424",
language = "English",
volume = "41",
pages = "156--173",
journal = "SIGCSE Bulletin",
issn = "0097-8418",
publisher = "ACM",
number = "4",

}

Lister, R, Clear, T, [No value], S, Bouvier, DJ, Carter, P, Eckerdal, A, Jacková, J, Lopez, M, McCartney, R, Robbins, P, Seppälä, O & Thompson, E 2009, 'Naturally occurring data as research instrument: analyzing examination responses to study the novice programmer', SIGCSE Bulletin, vol. 41, no. 4, pp. 156-173. https://doi.org/10.1145/1709424

Naturally occurring data as research instrument : analyzing examination responses to study the novice programmer. / Lister, Raymond; Clear, Tony; [No value], Simon; Bouvier, Dennis J.; Carter, Paul; Eckerdal, Anna; Jacková, Jana; Lopez, Mike; McCartney, Robert; Robbins, Phil; Seppälä, Otto; Thompson, Errol.

In: SIGCSE Bulletin, Vol. 41, No. 4, 12.2009, p. 156-173.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Naturally occurring data as research instrument

T2 - analyzing examination responses to study the novice programmer

AU - Lister, Raymond

AU - Clear, Tony

AU - [No value], Simon

AU - Bouvier, Dennis J.

AU - Carter, Paul

AU - Eckerdal, Anna

AU - Jacková, Jana

AU - Lopez, Mike

AU - McCartney, Robert

AU - Robbins, Phil

AU - Seppälä, Otto

AU - Thompson, Errol

PY - 2009/12

Y1 - 2009/12

N2 - In New Zealand and Australia, the BRACElet project has been investigating students' acquisition of programming skills in introductory programming courses. The project has explored students' skills in basic syntax, tracing code, understanding code, and writing code, seeking to establish the relationships between these skills. This ITiCSE working group report presents the most recent step in the BRACElet project, which includes replication of earlier analysis using a far broader pool of naturally occurring data, refinement of the SOLO taxonomy in code-explaining questions, extension of the taxonomy to code-writing questions, extension of some earlier studies on students' 'doodling' while answering exam questions, and exploration of a further theoretical basis for work that until now has been primarily empirical.

AB - In New Zealand and Australia, the BRACElet project has been investigating students' acquisition of programming skills in introductory programming courses. The project has explored students' skills in basic syntax, tracing code, understanding code, and writing code, seeking to establish the relationships between these skills. This ITiCSE working group report presents the most recent step in the BRACElet project, which includes replication of earlier analysis using a far broader pool of naturally occurring data, refinement of the SOLO taxonomy in code-explaining questions, extension of the taxonomy to code-writing questions, extension of some earlier studies on students' 'doodling' while answering exam questions, and exploration of a further theoretical basis for work that until now has been primarily empirical.

KW - novice programmers

KW - tracing

KW - CS1

KW - comprehension

KW - SOLO taxonomy

UR - http://dl.acm.org/citation.cfm?id=1709460&CFID=646361091&CFTOKEN=99615826

U2 - 10.1145/1709424

DO - 10.1145/1709424

M3 - Article

VL - 41

SP - 156

EP - 173

JO - SIGCSE Bulletin

JF - SIGCSE Bulletin

SN - 0097-8418

IS - 4

ER -