SIGCSE TS 2025 (series) / Posters /
Leveraging LLM for Detecting and Explaining LLM-generated Code in Python Programming Courses
This program is tentative and subject to change.
Fri 28 Feb 2025 10:00 - 12:00 at Exhibit Hall C - Posters - Posters #2
As large language models (LLMs) have become more advanced, generating code to solve exercises in programming courses has become significantly easier. However, this convenience raises the concern of over-reliance on these tools, potentially hindering students from developing independent coding skills. To address this concern, we introduce an LLM-based detector that not only detects LLM-generated code but also explains the reasons for its judgments. These reasons provide insight into the characteristics of LLM-generated code, enhancing transparency in the detection process. We evaluate the detector in an introductory Python programming course, achieving over 99% accuracy. Additionally, instructors manually reviewed the reasons provided by the detector and verified that 64.7% of reasons for classifying code as LLM-generated were appropriate. These reasons can also serve as feedback, helping students improve their coding skills by understanding the characteristics of expert-level LLM-generated code.
This program is tentative and subject to change.
Fri 28 FebDisplayed time zone: Eastern Time (US & Canada) change
Fri 28 Feb
Displayed time zone: Eastern Time (US & Canada) change
10:00 - 12:00 | |||
10:00 2hTalk | Maine AI Arena Posters Zachary Hutchinson University of Maine, School of Computing and Information Science, Graham Berry University of Maine, School of Computing and Information Science, Henry Kindler University of Maine, School of Computing and Information Science | ||
10:00 2hTalk | Leveraging LLM for Detecting and Explaining LLM-generated Code in Python Programming Courses Posters Jeonghun Baek The University of Tokyo, Tetsuro Yamazaki The University of Tokyo, Akimasa Morihata The University of Tokyo, Junichiro Mori The University of Tokyo, Yoko Yamakata The University of Tokyo, Kenjiro Taura The University of Tokyo, Shigeru Chiba The University of Tokyo | ||
10:00 2hTalk | AnonSim Virtual-Memory Page Replacement Simulation Posters | ||
10:00 2hTalk | LLM-KCI: Leveraging Large Language Models to Identify Programming Knowledge Components Posters Rose Niousha University of California, Berkeley, Abby O'Neill University of California, Berkeley, Ethan Chen University of California, Berkeley, Vedansh Malhotra Stanford University, Bita Akram North Carolina State University, Narges Norouzi University of California, Berkeley | ||
10:00 2hTalk | Broadening CS Research Opportunities for Online Graduate Students Posters Bobbie Eicher Georgia Institute of Technology, Alex Duncan Georgia Institute of Technology, Dante Ciolfi Georgia Institute of Technology, Maria Konte Georgia Institute of Technology, Nicholas Lytle Georgia Institute of Technology | ||
10:00 2hTalk | Mining Hierarchies with Conviction: Constructing the CS1 Skill Hierarchy with Pairwise Comparisons over Skill Distributions Posters Dip Kiran Pradhan Newar Utah State University, Max Fowler University of Illinois, David Smith University of Illinois at Urbana-Champaign, Seth Poulsen Utah State University | ||
10:00 2hTalk | Coding Pathfinder: A Platform for Creative, Self-Guided Mastery in Programming Posters Ishita Gupta Stanford University, Maya Bridgman Stanford University, Sierra Wang Stanford University, John C. Mitchell Stanford University | ||
10:00 2hTalk | Teacher Reviews of Block-Based Coding for K-12 Classrooms Posters Joanne Barrett University of Florida, Michael Johnson University of Florida, Maya Israel University of Florida | ||
10:00 2hTalk | Finding Misleading Identifiers in Novice Code Using LLMs Posters Anna Rechtackova Masaryk University Brno, Alexandra Maximova Department of Computer Science, ETH Zurich, Griffin Pitts University of Florida | ||
10:00 2hTalk | Assessing Elementary Teachers’ Knowledge of Integrated Computational Thinking Posters Deepti Joshi The Citadel, Candace Joswick University of Texas at Arlington, Robin Jocius University of Texas - Arlington, Jennifer Albert The Citadel, Melanie Blanton The Citadel, Bob Petrulis EPRE Consulting, Trent Dawson University of Texas at Arlington | ||
10:00 2hTalk | Teaching Assistants' Experiences of and Opinions on CS Ethics Posters | ||
10:00 2hTalk | Balanced Creative Coding for Motivation and Learning Transfer Posters Alejandro Lobo University of California, San Diego, Amy Eguchi University of California, San Diego, Robert Twomey UC San Diego, Ying Wu UC San Diego | ||
10:00 2hTalk | How Teachers Integrate Data Science into Their Instruction for Middle-Grades Learners Posters Ismaila Temitayo Sanusi University of Texas at San Antonio, Marissa Munoz University of Texas at San Antonio, Fred Martin University of Texas at San Antonio | ||
10:00 2hTalk | Lightweight Social Computing Tools for Undergraduate Research Community Building Posters Noel Chacko Temple University, Hannah Nguyen Temple University, Sophie Chen Temple University, Stephen MacNeil Temple University | ||
10:00 2hTalk | Impact of Retake Policy on Student Performance in a CS0 Course with Mastery Learning Posters Elise Vambenepe UC Berkeley, Kerry Pan UC Berkeley, Aanvi Kothari UC Berkeley, Anneliese Galler UC Berkeley, Connor Bernard University of California, Berkeley, Daniel Garcia University of California Berkeley | ||
10:00 2hTalk | Scope Rule Comprehension by Novice Python Programmers Posters Mark Holliday Western Carolina University | ||
10:00 2hTalk | SAFARI-P: Swahili-Focused Adaptive Framework for Accelerated Reinforcement in Intelligent Python Education Posters Vasu Jindal Columbia University | ||
10:00 2hTalk | "Like a GPS": Analyzing Middle School Student Responses to an Interactive Pathfinding Activity Posters Claire Aguiar North Carolina State University, Dan Carpenter North Carolina State University, Jessica Vandenberg North Carolina State University, Alex Goslen North Carolina State University, Wookhee Min North Carolina State University, Veronica Catete North Carolina State University, Bradford Mott North Carolina State University | ||
10:00 2hTalk | Connecting Education and Fun: Using Turing Machine Games in Theory of Computation Posters Tammy Vandegrift University of Portland | ||
10:00 2hTalk | Learning Programming for Non-Native English-Speaking Students: Insight from Japanese Students Posters | ||
10:00 2hTalk | Predicting Student Reasoning for Self-Reported Affect in Game-Based Learning Environments Posters Jordan Esiason North Carolina State University, Alex Goslen North Carolina State University, Andres Felipe Zambrano University of Pennsylvania, Nidhi Nasiar University of Pennsylvania, Stephen Hutt University of Denver, Jonathan Rowe North Carolina State University, Jaclyn Ocumpaugh University of Pennsylvania, Jessica Vandenberg North Carolina State University | ||
10:00 2hTalk | Novice Difficulties in Graph Layering for Algorithm Design Posters Hongxuan Chen University of Illinois at Urbana-Champaign, Katherine Braught University of Illinois at Urbana-Champaign, Geoffrey Herman University of Illinois at Urbana-Champaign, Jeff Erickson University of Illinois at Urbana-Champaign | ||
10:00 2hTalk | Exploring the Impact of Unsupervised Clustering Methods in Systematic Literature Reviews Posters Emily Bolger Department of Computational Mathematics, Science, and Engineering; Michigan State University, Marcos Caballero Michigan State University | ||
10:00 2hTalk | Student and Teacher Perspectives on Requiring a Computer Science Course in High School Posters Julie Smith Institute for Advancing Computing Education, Monica McGill Institute for Advancing Computing Education, Jacob Koressel Computer Science Teachers Association (CSTA), Bryan Twarek Computer Science Teachers' Association | ||
10:00 2hTalk | Anonymous: A Dataset of Graded Programming Assignments Posters Marcus Messer King's College London, Neil Brown King's College London, Michael Kölling King's College London, Miaojing Shi Tongji University | ||
10:00 2hTalk | Investigating Autograder Usage in the Post- Pandemic and LLM Era Posters Jason Weber University of California, Irvine, Hyunjun Park University of California, Irvine, Daniel J Song University of California, Irvine, Jared Apillanes University of California, Irvine, Barbara Martinez Neda University of California, Irvine, Jennifer Wong-Ma University of California, Irvine, Sergio Gago-Masague University of California, Irvine | ||
10:00 2hTalk | Mathematics for Machine Learning: A Bridge Course Posters Samuel Deng Columbia University | ||
10:00 2hTalk | The Effects of Game-Based Learning on STEM Career Awareness for Elementary Aged Girls Posters Abi Olukeye University Of North Carolina at Charlotte, Nisaa Kirtman Rockman et al Cooperative, Adam Moylan Rockman et al Cooperative | ||
10:00 2hTalk | Predicting Students’ Interest from Small Group Conversational Characteristics: Insights from an AI Literacy Education with High School Students Posters Shenghua Zha University of South Alabama, Lujie Karen Chen University of Maryland, Baltimore County, Woei Hung University of North Dakota, Na Gong University of South Alabama, Pamela Moore University of South Alabama, Bethany Klemetsrud University of North Dakota | ||
10:00 2hTalk | Challenging the Status Quo in a Computing Ethics Course, One Water Cooler Conversation at a Time Posters Su Min Park University of California, Berkeley, Carol Li University of California, Berkeley, Jedidiah Tsang University of California, Berkeley, Lisa Yan UC Berkeley | ||
10:00 2hTalk | Dynamic, Randomizable, Autogradable Visual Programming Simulations for Python Using Prairielearn Posters Noemi Chulo UC Berkeley, Gabriel Classon UC Berkeley, Ashley Chiu UC Berkeley, Daniel Garcia University of California Berkeley, Armando Fox UC Berkeley, Narges Norouzi University of California, Berkeley | ||
10:00 2hTalk | What Could Impact Indigenous-serving Teachers’ Computing Integration After A Culturally Responsive Professional Development? Posters Wei Yan Northern Arizona University, Ashish Amresh Northern Arizona University, Jeffrey Hovermill Northern Arizona University, Paige Prescott Computer science alliance | ||
10:00 2hTalk | Design of a User Study to evaluate the effectiveness of a Software Security Module for Neurodivergent Students Posters Sushma Indrani Dangeti University of North Carolina at Charlotte, Harini Ramaprasad UNC Charlotte, Meera Sridhar University of North Carolina Charlotte, USA, Soham Pradhan University of North Carolina at Charlotte | ||
10:00 2hTalk | Design Principles for CT Integrated Lesson Design and Implementation Posters Merijke Coenraad Digital Promise, Kyle Dunbar Digital Promise Global, Alessandra Rangel Digital Promise, Wanjoo Ahn Michigan State University, Aman Yadav Michigan State University, Sharin Jacob Digital Promise | ||
10:00 2hTalk | Praxly: An Online IDE for the Praxis CS Test Pseudocode Posters Benjamin Saupp James Madison University, Ellona Macmillan James Madison University, Chris Mayfield James Madison University, Chris Johnson James Madison University, Michael Stewart James Madison University, Shelita Hodges Richmond Public Schools | ||
10:00 2hTalk | Streamlining Web Development Education: The Impact and Implementation of the ECS-WL Website Posters | ||
10:00 2hTalk | The AI-Enhanced Software Engineer: A Snapshot of the Profession Posters Irene Lee Education Development Center, Joyce Malyn Smith Education Development Center, Matthew Kam Google, Cody Miller Google, Miaoxin Wang Trilyon | ||
10:00 2hTalk | Innovative Approaches to Information Communication Technology and Development (ICTD) Course Design Posters | ||
10:00 2hTalk | RAFIKI: Leveraging Large Language Models to Increase AP Computer Science A Enrollment among Disadvantaged High School Females Posters | ||
10:00 2hTalk | Undergraduate Research Opportunities in CS Education: A Literature Map Posters Brian Harrington University of Toronto Scarborough, Shreeansha Bhattarai University of Toronto Scarborough, Han-Shin Chen University of Toronto Scarborough, Yuxin Chen University of Toronto Scarborough, Kian Dianati University of Toronto Scarborough, Serena Ju University of Toronto Scarborough, Yuhan Pan University of Toronto Scarborough, Zhiyu Pan University of Toronto Scarborough, Neha Prabu University of Toronto Scarborough, Zhifei Song , Like Wang University of Toronto Scarborough | ||
10:00 2hTalk | Simulating Real IT Project Life for Students – The StudyTalk Case Study Posters Anna Pakosch Hochschule Hannover, Dennis Allerkamp Hochschule Hannover – University of Applied Sciences and Arts, Arne Koschel Hochschule Hannover | ||
10:00 2hTalk | Conceptualizing the Support and Learning of K-2 Educators around Artificial Intelligence in Language Arts Posters Jessica Vandenberg North Carolina State University, Ryan Torbey American Institutes for Research, Cecilia Xuning Zhang American Institutes for Research, Bradford Mott North Carolina State University, Keisha Bailey American Institutes for Research, Joseph Wilson American Institutes for Research | ||
10:00 2hTalk | The Development and Validation of the Critical Reflection and Agency in Computing Scale Posters Aadarsh Padiyath University of Michigan - Ann Arbor, Mark Guzdial University of Michigan, Barbara Ericson University of Michigan | ||
10:00 2hTalk | Implementing the AI-Lab Framework: Enhancing Introductory Programming Education for CS Majors Posters Ethan Dickey Purdue University, Andres Mauricio Bejarano Posada Purdue University, Rhianna Setsma Purdue University | ||