MSR 2025
Mon 28 - Tue 29 April 2025 Ottawa, Ontario, Canada
co-located with ICSE 2025
Mon 28 Apr 2025 16:50 - 17:30 at 214 - LLMs for Code Chair(s): Ali Ouni

Qualitative bottom-up coding is essential for identifying themes and patterns in complex data. This tutorial demonstrates how LLMs such as ChatGPT can support the qualitative coding process for software engineering research. Participants will walk through an entire coding exercise, learning to identify themes through open coding, consolidate themes by refining and merging codes, and conduct inter-rater agreement by standardizing codebooks and testing agreement between human and AI coders. Using hands-on exercises and real-world examples, this session highlights effective human-AI collaboration and strategies to ensure transparency, trustworthiness, and methodological rigor. Designed for researchers at all levels of experience, this tutorial equips participants with practical techniques to analyze software engineering data.

Mon 28 Apr

Displayed time zone: Eastern Time (US & Canada) change

16:00 - 17:30
LLMs for CodeTechnical Papers / Data and Tool Showcase Track / Tutorials at 214
Chair(s): Ali Ouni ETS Montreal, University of Quebec
16:00
10m
Talk
How Much Do Code Language Models Remember? An Investigation on Data Extraction Attacks before and after Fine-tuning
Technical Papers
Fabio Salerno Delft University of Technology, Ali Al-Kaswan Delft University of Technology, Netherlands, Maliheh Izadi Delft University of Technology
16:10
10m
Talk
Can LLMs Generate Higher Quality Code Than Humans? An Empirical Study
Technical Papers
Mohammad Talal Jamil Lahore University of Management Sciences, Shamsa Abid National University of Computer and Emerging Sciences, Shafay Shamail LUMS, DHA, Lahore
Pre-print
16:20
10m
Talk
Prompt Engineering or Fine-Tuning: An Empirical Assessment of LLMs for Code
Technical Papers
Jiho Shin York University, Clark Tang , Tahmineh Mohati University of Calgary, Maleknaz Nayebi York University, Song Wang York University, Hadi Hemmati York University
16:30
5m
Talk
Drawing Pandas: A Benchmark for LLMs in Generating Plotting Code
Data and Tool Showcase Track
Timur Galimzyanov JetBrains Research, Sergey Titov JetBrains Research, Yaroslav Golubev JetBrains Research, Egor Bogomolov JetBrains Research
Pre-print
16:35
5m
Talk
SnipGen: A Mining Repository Framework for Evaluating LLMs for Code
Data and Tool Showcase Track
Daniel Rodriguez-Cardenas William & Mary, Alejandro Velasco William & Mary, Denys Poshyvanyk William & Mary
Pre-print
16:50
40m
Tutorial
Harmonized Coding with AI: LLMs for Qualitative Analysis in Software Engineering Research
Tutorials
Christoph Treude Singapore Management University, Youmei Fan Nara Institute of Science and Technology, Tao Xiao Kyushu University, Hideaki Hata Shinshu University
Hide past events