Papers for

software engineering educators

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Novice software students review and adjust AI outputs beyond correctness

Beyond Correctness: How Novice Software Engineering Students Exercise Oversight of Generative AI

Abstract: Generative AI (GenAI) is shifting software engineering students' work from producing artefacts towards evaluating and supervising AI-generated outputs. However, little is known about what characteristics students identify in outputs when reporting interventions, or how they exercise oversight during authentic software engineering work. We analysed 962 student-AI interaction turns documented by 145 first-year software engineering students through structured AI Journals, including 172 student-declared interventions. Using a multi-dimensional coding framework, we characterised the output characteristics identified in these reported interventions, students' reasons for intervening, the actions they took, and how those actions were enacted. Fitness problems were identified in 74.4% of interventions, compared with 16.9% involving correctness problems, indicating that oversight more often concerned whether plausible AI outputs were suitable for the engineering task than whether they contained explicit errors. Among classifiable interventions, students most frequently modified generated outputs (51.0%) or refined their prompts (28.2%), with both response types commonly associated with engineering fit. Within-student analysis further showed that outputs perceived as containing minor flaws were associated with lower evaluation confidence than outputs perceived as perfect. Taken together, these findings characterise novice AI oversight as a process that extends beyond error detection to encompass both judgement of fitness for purpose and active intervention in AI-assisted engineering work.

Fri 23 OctSoftware EngineeringHuman-Computer Interaction
The gist
Software engineering students working with AI tools don’t just check for mistakes; they also judge how well AI-generated solutions fit their project needs. The authors studied how first-year students recorded AI interactions and found that students often focused on whether the AI’s answers were suitable rather than just correct. Students frequently changed AI outputs or rephrased their questions to get better results. This shows that early learners exercise judgment and take active roles in supervising AI as part of their work.
Open → 2610.32118v1

Developers interact differently with ai coding tools depending on understanding and testing

Beyond the Prompt: Linking What Developers Ask, Do, and Understand with Coding Agents

Abstract: Coding agents can now change code for developers, who describe goals, supply context, and respond to the agent's work. Yet prompts, screen activity, and task success each tell only part of this story. We present Say, Do, Understand, an end-to-end workflow for analyzing what developers write to an agent, what they do while it works, and what they can explain afterwards. The workflow has five stages (Capture, Prepare, Analyze, Integrate, and Interpret) and three instruments: a prompt codebook, a scheme for coding screen-recorded activities and events, and separate rubrics for explaining the process and the solution. We applied it in an observational study of ten experienced developers who used GitHub Copilot on an unfamiliar codebase. Crossing task performance with understanding produced four personas. The two measures agreed for eight developers but split for two: one passed most tests but could not explain the solution, and another passed few tests but explained it well. In this sample, the personas that most often asked the agent to check its work spent the least time testing on their own. These patterns are descriptive and do not generalize beyond the sample. We recommend the workflow to computing educators, industry practitioners, and researchers to adapt and evaluate human--AI communication in software engineering.

Sun 27 SeptSoftware Engineering
The gist
Developers using AI tools to write code don’t all work the same way. The authors studied how developers ask questions, what they do while the AI works, and how well they understand the results. They found that some developers rely more on the AI to check their code, while others test more themselves. Understanding these differences can help improve how people and AI tools work together in programming.
Open → 2609.33712v1

Software engineering education adapts to responsible ai use challenges

Judgment-Centred Software Engineering Education: A Post-Hype Review and Framework for AI-Augmented Learning

Abstract: Generative artificial intelligence has moved from a disruptive novelty to a recurring part of software-development and computing-education workflows, while software agents are beginning to act across repositories, command lines, browsers, tests, and other tools. The educational problem is no longer whether students should be allowed to generate code, but whether software-engineering (SE) programs can preserve and assess human understanding while preparing students to work responsibly with increasingly capable AI systems. This paper presents a structured integrative review of research and practice from 2023 through 23 September 2026, supplemented by established work on AI literacy, technical debt, and human-AI collaboration. The evidence supports a conditional conclusion: GenAI can improve access to explanations, feedback, practice, and short-term task completion, but learning outcomes depend on prior knowledge, scaffolding, verification, task design, and assessment. We examine student help-seeking and authorship, faculty assessment and policy demands, and the wider SE risks created when generated artifacts persist across repositories, teams, architectures, and deployed systems. We extend the concept of comprehension debt: the deferred learning and maintenance cost that arises when AI-assisted production outpaces a learner's or team's ability to explain, test, modify, and justify the resulting software. We then refine the AI-Augmented Software Engineering Education (AASEE) framework into five non-linear integration levels and four cross-cutting evidence obligations: explain, verify, modify, and account. The framework links delegation to evidence, governance, and recovery mechanisms appropriate to its consequences.

Thu 24 SeptSoftware EngineeringComputers and Society
The gist
Software engineering students today use AI tools to write code, but this creates new challenges in making sure they really understand what the AI produces. The authors reviewed a lot of research and practice about how AI affects learning in software engineering from 2023 to 2026. They found that AI helps with some tasks like giving explanations and feedback, but students still need guidance and ways to check if AI-generated code is correct. They introduced a framework to help educators design learning that balances using AI and making sure students can explain, verify, modify, and account for their software.
Open → 2609.29473v1

Software architecture practices in open source shaped by social and ethical factors

Socio-technical and Ethical Dimensions of Architecture Practices in FLOSS

Abstract: This project investigates how software architecture practices in Free/Libre Open Source Software (FLOSS) are shaped by socio-technical and ethical factors, and how education can support more explicit, inclusive, and reflective architectural work. Motivated by FLOSS's role in digital sovereignty, it is observed that architectural decisions are often undocumented and scattered across issues, pull requests, and mailing lists. While prior research has studied architectural artifacts, erosion, and communication, the interplay between architectural work, governance arrangements, and ethical commitments in FLOSS remains underexplored. The research follows a three-phase design: (1) multi-method case studies of 3-4 domain-pairs of architecturally non-trivial FLOSS projects, (2) framework and intervention design with practitioners and educators, and (3) pilot evaluations in projects and courses. It will produce (i) cross-case empirical evidence on FLOSS architecture practices, (ii) a conceptual framework linking architecture practices to socio-technical conditions and ethical dimensions, and (iii) lightweight practices and teaching formats that render architectural work more explicit and inclusive.

Wed 9 SeptSoftware Engineering
The gist
Figuring out how to design big open source software projects is important but often unclear because decisions are scattered and not well documented. The paper looks at how social rules, teamwork, and ethics influence these design choices in open source projects. The authors plan to study several projects, create ideas and tools with developers and teachers to improve transparency and fairness in designs, and test these ideas in real projects and classes.
Open → 2609.09975v1