LLM-KCI: Leveraging Large Language Models to Identify Programming Knowledge Components (SIGCSE TS 2025 - Posters)

Who

Rose Niousha, Abby O'Neill, Ethan Chen, Vedansh Malhotra, Bita Akram, Narges Norouzi

Track

SIGCSE TS 2025 Posters

This program is tentative and subject to change.

Time Zone

The program is currently displayed in (GMT-05:00) Eastern Time (US & Canada).

Use conference time zone: (GMT-05:00) Eastern Time (US & Canada)Select other time zone

The GMT offsets shown reflect the offsets at the moment of the conference.

Time Band

By setting a time band, the program will dim events that are outside this time window. This is useful for (virtual) conferences with a continuous program (with repeated sessions).
The time band will also limit the events that are included in the personal iCalendar subscription service.

Display full programSpecify a time band

Save

When

Fri 28 Feb 2025 10:00 - 12:00 at Exhibit Hall C - Posters - Posters #2

Abstract

Identifying Knowledge Components (KCs) in computer science education improves curriculum design and teaching strategies. We introduce a framework using Large Language Models LLMs to identify KCs from programming assignments automatically. Our framework helps educators align assignments with course objectives. GPT-4 identifies relevant KCs well, though there’s a low match with expert-generated KCs at the course level. At the problem level, performance is lower, but key KCs are reasonably identified.

Rose Niousha

University of California, Berkeley

United States

Abby O'Neill

University of California, Berkeley

United States

Ethan Chen

University of California, Berkeley

Vedansh Malhotra

Stanford University

United States

Bita Akram

North Carolina State University

United States

Narges Norouzi

University of California, Berkeley

United States

This program is tentative and subject to change.

Time Zone

The program is currently displayed in (GMT-05:00) Eastern Time (US & Canada).

Use conference time zone: (GMT-05:00) Eastern Time (US & Canada)Select other time zone

The GMT offsets shown reflect the offsets at the moment of the conference.

Time Band

Display full programSpecify a time band

Save

Session Program

Fri 28 Feb
Displayed time zone: Eastern Time (US & Canada) change

10:00 - 12:00	Posters #2Posters at Exhibit Hall C - Posters

10:00 2h Talk		Maine AI Arena Posters Zachary Hutchinson University of Maine, School of Computing and Information Science, Graham Berry University of Maine, School of Computing and Information Science, Henry Kindler University of Maine, School of Computing and Information Science
10:00 2h Talk		Leveraging LLM for Detecting and Explaining LLM-generated Code in Python Programming Courses Posters Jeonghun Baek The University of Tokyo, Tetsuro Yamazaki The University of Tokyo, Akimasa Morihata The University of Tokyo, Junichiro Mori The University of Tokyo, Yoko Yamakata The University of Tokyo, Kenjiro Taura The University of Tokyo, Shigeru Chiba The University of Tokyo
10:00 2h Talk		GraySim Virtual-Memory Page Replacement Simulation Posters Melinda Zhang U.S. Army, Maria R. Ebling United States Military Academy, West Point
10:00 2h Talk		LLM-KCI: Leveraging Large Language Models to Identify Programming Knowledge Components Posters Rose Niousha University of California, Berkeley, Abby O'Neill University of California, Berkeley, Ethan Chen University of California, Berkeley, Vedansh Malhotra Stanford University, Bita Akram North Carolina State University, Narges Norouzi University of California, Berkeley
10:00 2h Talk		Broadening CS Research Opportunities for Online Graduate Students Posters Bobbie Eicher Georgia Institute of Technology, Alex Duncan Georgia Institute of Technology, Dante Ciolfi Georgia Institute of Technology, Maria Konte Georgia Institute of Technology, Nicholas Lytle Georgia Institute of Technology
10:00 2h Talk		Mining Hierarchies with Conviction: Constructing the CS1 Skill Hierarchy with Pairwise Comparisons over Skill Distributions Posters Dip Kiran Pradhan Newar Utah State University, Max Fowler University of Illinois, David Smith University of Illinois at Urbana-Champaign, Seth Poulsen Utah State University
10:00 2h Talk		Coding Pathfinder: A Platform for Creative, Self-Guided Mastery in Programming Posters Ishita Gupta Stanford University, Maya Bridgman Stanford University, Sierra Wang Stanford University, John C. Mitchell Stanford University
10:00 2h Talk		Teacher Reviews of Block-Based Coding for K-12 ClassroomsK12 Posters Joanne Barrett University of Florida, Michael Johnson University of Florida, Maya Israel University of Florida
10:00 2h Talk		Finding Misleading Identifiers in Novice Code Using LLMs Posters Anna Rechtackova Masaryk University Brno, Alexandra Maximova Department of Computer Science, ETH Zurich, Griffin Pitts University of Florida
10:00 2h Talk		Assessing Elementary Teachers’ Knowledge of Integrated Computational ThinkingK12 Posters Deepti Joshi The Citadel, Candace Joswick University of Texas at Arlington, Robin Jocius University of Texas - Arlington, Jennifer Albert The Citadel, Melanie Blanton The Citadel, Bob Petrulis EPRE Consulting, Trent Dawson University of Texas at Arlington
10:00 2h Talk		Teaching Assistants' Experiences of and Opinions on CS Ethics Posters Grace Barkhuff Georgia Institute of Technology, Ian Pruitt Georgia State University
10:00 2h Talk		Balanced Creative Coding for Motivation and Learning Transfer Posters Alejandro Lobo University of California, San Diego, Amy Eguchi University of California, San Diego, Robert Twomey UC San Diego, Ying Wu UC San Diego
10:00 2h Talk		How Teachers Integrate Data Science into Their Instruction for Middle-Grades LearnersK12 Posters Ismaila Temitayo Sanusi University of Texas at San Antonio, Marissa Munoz University of Texas at San Antonio, Fred Martin University of Texas at San Antonio
10:00 2h Talk		Lightweight Social Computing Tools for Undergraduate Research Community Building Posters Noel Chacko Temple University, Hannah Nguyen Temple University, Sophie Chen Temple University, Stephen MacNeil Temple University
10:00 2h Talk		Impact of Retake Policy on Student Performance in a CS0 Course with Mastery Learning Posters Elise Vambenepe UC Berkeley, Kerry Pan UC Berkeley, Aanvi Kothari UC Berkeley, Anneliese Galler UC Berkeley, Connor Bernard University of California, Berkeley, Daniel Garcia University of California Berkeley
10:00 2h Talk		Scope Rule Comprehension by Novice Python Programmers Posters Mark Holliday Western Carolina University
10:00 2h Talk		SAFARI-P: Swahili-Focused Adaptive Framework for Accelerated Reinforcement in Intelligent Python Education Posters Vasu Jindal Columbia University
10:00 2h Talk		"Like a GPS": Analyzing Middle School Student Responses to an Interactive Pathfinding ActivityK12 Posters Claire Aguiar North Carolina State University, Dan Carpenter North Carolina State University, Jessica Vandenberg North Carolina State University, Alex Goslen North Carolina State University, Wookhee Min North Carolina State University, Veronica Catete North Carolina State University, Bradford Mott North Carolina State University
10:00 2h Talk		Connecting Education and Fun: Using Turing Machine Games in Theory of Computation Posters Tammy Vandegrift University of Portland
10:00 2h Talk		Learning Programming for Non-Native English-Speaking Students: Insight from Japanese StudentsGlobal Posters Niken Prasasti Martono Tokyo University of Science, Hayato Ohwada Tokyo University of Science
10:00 2h Talk		Predicting Student Reasoning for Self-Reported Affect in Game-Based Learning Environments Posters Jordan Esiason North Carolina State University, Alex Goslen North Carolina State University, Andres Felipe Zambrano University of Pennsylvania, Nidhi Nasiar University of Pennsylvania, Stephen Hutt University of Denver, Jonathan Rowe North Carolina State University, Jaclyn Ocumpaugh University of Pennsylvania, Jessica Vandenberg North Carolina State University
10:00 2h Talk		Novice Difficulties in Graph Layering for Algorithm Design Posters Hongxuan Chen University of Illinois at Urbana-Champaign, Katherine Braught University of Illinois at Urbana-Champaign, Geoffrey Herman University of Illinois at Urbana-Champaign, Jeff Erickson University of Illinois at Urbana-Champaign
10:00 2h Talk		Exploring the Impact of Unsupervised Clustering Methods in Systematic Literature Reviews Posters Emily Bolger Department of Computational Mathematics, Science, and Engineering; Michigan State University, Marcos Caballero Michigan State University
10:00 2h Talk		Student and Teacher Perspectives on Requiring a Computer Science Course in High SchoolK12 Posters Julie Smith Institute for Advancing Computing Education, Monica McGill Institute for Advancing Computing Education, Jacob Koressel Computer Science Teachers Association (CSTA), Bryan Twarek Computer Science Teachers' Association
10:00 2h Talk		Menagerie: A Dataset of Graded Programming AssignmentsGlobal Posters Marcus Messer King's College London, Neil Brown King's College London, Michael Kölling King's College London, Miaojing Shi Tongji University
10:00 2h Talk		Investigating Autograder Usage in the Post- Pandemic and LLM Era Posters Jason Weber University of California, Irvine, Hyunjun Park University of California, Irvine, Daniel J Song University of California, Irvine, Jared Apillanes University of California, Irvine, Barbara Martinez Neda University of California, Irvine, Jennifer Wong-Ma University of California, Irvine, Sergio Gago-Masague University of California, Irvine
10:00 2h Talk		Mathematics for Machine Learning: A Bridge Course Posters Samuel Deng Columbia University
10:00 2h Talk		The Effects of Game-Based Learning on STEM Career Awareness for Elementary Aged GirlsK12 Posters Abi Olukeye University Of North Carolina at Charlotte, Nisaa Kirtman Rockman et al Cooperative, Adam Moylan Rockman et al Cooperative
10:00 2h Talk		Predicting Students’ Interest from Small Group Conversational Characteristics: Insights from an AI Literacy Education with High School StudentsK12 Posters Shenghua Zha University of South Alabama, Lujie Karen Chen University of Maryland, Baltimore County, Woei Hung University of North Dakota, Na Gong University of South Alabama, Pamela Moore University of South Alabama, Bethany Klemetsrud University of North Dakota
10:00 2h Talk		Challenging the Status Quo in a Computing Ethics Course, One Water Cooler Conversation at a Time Posters Su Min Park University of California, Berkeley, Carol Li University of California, Berkeley, Jedidiah Tsang University of California, Berkeley, Lisa Yan UC Berkeley
10:00 2h Talk		Dynamic, Randomizable, Autogradable Visual Programming Simulations for Python Using Prairielearn Posters Noemi Chulo UC Berkeley, Gabriel Classon UC Berkeley, Ashley Chiu UC Berkeley, Daniel Garcia University of California Berkeley, Armando Fox UC Berkeley, Narges Norouzi University of California, Berkeley
10:00 2h Talk		What Could Impact Indigenous-serving Teachers’ Computing Integration After A Culturally Responsive Professional Development?MSIK12 Posters Wei Yan Northern Arizona University, Ashish Amresh Northern Arizona University, Jeffrey Hovermill Northern Arizona University, Paige Prescott Computer science alliance
10:00 2h Talk		Design of a User Study to evaluate the effectiveness of a Software Security Module for Neurodivergent Students Posters Sushma Indrani Dangeti University of North Carolina at Charlotte, Harini Ramaprasad UNC Charlotte, Meera Sridhar University of North Carolina Charlotte, USA, Soham Pradhan University of North Carolina at Charlotte
10:00 2h Talk		Design Principles for CT Integrated Lesson Design and Implementation Posters Merijke Coenraad Digital Promise, Kyle Dunbar Digital Promise Global, Alessandra Rangel Digital Promise, Wanjoo Ahn Michigan State University, Aman Yadav Michigan State University, Sharin Jacob Digital Promise
10:00 2h Talk		Praxly: An Online IDE for the Praxis CS Test PseudocodeK12 Posters Benjamin Saupp James Madison University, Ellona Macmillan James Madison University, Chris Mayfield James Madison University, Chris Johnson James Madison University, Michael Stewart James Madison University, Shelita Hodges Richmond Public Schools
10:00 2h Talk		Streamlining Web Development Education: The Impact and Implementation of the ECS-WL Website Posters Samuel Mazzone Marquette University, Dennis Brylow Marquette University
10:00 2h Talk		The AI-Enhanced Software Engineer: A Snapshot of the Profession Posters Irene Lee Education Development Center, Joyce Malyn Smith Education Development Center, Matthew Kam Google, Cody Miller Google, Miaoxin Wang Trilyon
10:00 2h Talk		Innovative Approaches to Information Communication Technology and Development (ICTD) Course Design Posters Susan Wyche Michigan State University, Osafenwen Diawara Michigan State University
10:00 2h Talk		RAFIKI: Leveraging Large Language Models to Increase AP Computer Science A Enrollment among Disadvantaged High School FemalesK12 Posters Ryka Chopra Mission San Jose High School, Suparna Chakraborty University of San Francisco
10:00 2h Talk		Undergraduate Research Opportunities in CS Education: A Literature Map Posters Brian Harrington University of Toronto Scarborough, Shreeansha Bhattarai University of Toronto Scarborough, Han-Shin Chen University of Toronto Scarborough, Yuxin Chen University of Toronto Scarborough, Kian Dianati University of Toronto Scarborough, Serena Ju University of Toronto Scarborough, Yuhan Pan University of Toronto Scarborough, Zhiyu Pan University of Toronto Scarborough, Neha Prabu University of Toronto Scarborough, Zhifei Song , Like Wang University of Toronto Scarborough
10:00 2h Talk		Simulating Real IT Project Life for Students – The StudyTalk Case StudyGlobal Posters Anna Pakosch Hochschule Hannover, Dennis Allerkamp Hochschule Hannover – University of Applied Sciences and Arts, Arne Koschel Hochschule Hannover
10:00 2h Talk		Conceptualizing the Support and Learning of K-2 Educators around Artificial Intelligence in Language ArtsK12 Posters Jessica Vandenberg North Carolina State University, Ryan Torbey American Institutes for Research, Cecilia Xuning Zhang American Institutes for Research, Bradford Mott North Carolina State University, Keisha Bailey American Institutes for Research, Joseph Wilson American Institutes for Research
10:00 2h Talk		The Development and Validation of the Critical Reflection and Agency in Computing Scale Posters Aadarsh Padiyath University of Michigan - Ann Arbor, Mark Guzdial University of Michigan, Barbara Ericson University of Michigan
10:00 2h Talk		Implementing the AI-Lab Framework: Enhancing Introductory Programming Education for CS Majors Posters Ethan Dickey Purdue University, Andres Mauricio Bejarano Posada Purdue University, Rhianna Setsma Purdue University