Master Thesis Defense: AI Tutors with LLMs and HPC

Mr. Arnad Lekić successfully defended his master’s thesis titled “Development of an AI Tutor Using Large Language Models and HPC” at the Faculty of Information Systems and Technologies, University of Donja Gorica.

Mr Arnad Lekic

ABSTRACT – This thesis explores the development of a personalized AI tutor using large language models (LLMs), with a specific focus on the LLaMA architecture and the application of High-Performance Computing (HPC) resources. The research involves the acquisition, setup, and evaluation of an open-source LLaMA model, with the goal of building a system capable of automated test grading. Special emphasis is placed on the training efficiency and feasibility of running the model locally using the available computing nodes, compared to cloud-based solutions like Google Colab. Beyond the technical implementation, the study also addresses the ethical challenges of using generative AI in education. Through experimental analysis, the research demonstrates that open models can be effectively adapted for educational purposes, with the potential to expand to grading diverse exam formats and generating educational content. The work provides directions for future development of systems leveraging advanced multimodal models for more complex tasks.

The defence was attended by over 30 people. We had three candidates that day, all in the context of EuroCC2 and EuroCC4SEE