As a part of the orientation week for new students, the EuroCC National Competence Centre Montenegro has organized a Supercomputing Workshop aimed at introducing incoming university students to the exciting world of high-performance computing (HPC).
The workshop featured interactive sessions where students could get insights into cutting-edge technologies used in supercomputing, such as parallel processing, intelligent algorithms, and data analytics. Experts from the NCC guided the participants through the technical fundamentals of HPC systems, demonstrated real-world applications related to Big Data processing and advanced AI modelling, but also provided examples of academic study cases and industry use cases, including Montenegro’s success stories.
The aim of the workshop was also to provide brief overview on HPC/AI related academic programs, training portfolio and NCC activities, to show how students can leverage supercomputing resources for academic projects and scientific research, or even for startup ideas and potential industry collaboration.
By exposing new students to the potential of supercomputing early in their academic journey, the NCC aims to support students’ development in high-demand, tech-driven carriers, and to foster community of innovative thinkers prepared to tackle complex and critical challenges of the modern world.
The University of Donja Gorica, with the support of the Innovation Fund of Montenegro, as part of the program for the organization of education in the areas of smart specialization of Montenegro, organizes a three-month training called “AIFUSION – Artificial intelligence in agriculture, medicine and energy.” The course will be held in the period from the end of September (September 21) to the end of December (December 21) 2024.
The education program is divided into 5 modules: Introduction to artificial intelligence, Computer vision, Natural language processing, Artificial intelligence and S3 in practice and Ethics and responsible use of artificial intelligence and work on the final project.
Apart from the fact that the participants will acquire enough knowledge and skills needed for further research in this very current field, they will have the opportunity to expand their network of acquaintances and meet young people with similar interests.
To apply, you need to fill out the Google form found at the link https://forms.gle/f8Pc8ozu9U3tHKY98. Applications last until September 20 (11:59 p.m.), and the course is scheduled to start on September 21.
NCC Montenegro representative Luka Filipovic took an active part as a Teaching Assistant in the Nvidia and EuroCC2 supported bootcamp “AI for Scientific Computing”, successfully organized by NCCs Germany, Sweden, Austria and Montenegro, on June 25–26, 2024.
The Bootcamp offered a comprehensive introduction to deep neural networks, focusing on applications in scientific computing and physical systems defined by differential equations. The curriculum included advanced topics based on NVIDIA Modulus to develop and train the models in various areas. This online Bootcamp features guided instructions and support from cross-NCC teaching assistants to facilitate learning, supporting participants to build and enhance AI/DL models.
Representatives from NCC Montenegro in joint efforts with young researchers from UDG, published two scientific papers at the SymOrg 2024 conference, organized by the Faculty of Organizational Science, University of Belgrade, at Zlatibor, Serbia on June 12-14, 2024. The conference, traditionally envisioned as a platform for knowledge innovation and empirical research, bringing together representatives from the scientific and professional community, was themed: ”Unlocking The Hidden Potential Of Organization Through Merging Of Humans And Digitals”, aiming to address the newfound need for balance in the era of AI.
Image source: SymOrg 2024 website
The scientific paper “Detection of Scoliosis” by Elvis Taruh, Enisa Trubljanin, and Dejan Babić explores the application of a deep learning model integrated with a web application to detect scoliosis using x-ray images. Utilizing a dataset of 198 x-ray images from Roboflow, the initial model performance was unsatisfactory, prompting manual annotation of 245 images, which significantly improved the model’s accuracy. YOLOv8, a state-of-the-art object detection algorithm, was used to train two models, demonstrating improved performance with manual annotations. The web application, built with Flask, HTML, CSS, and JavaScript, provides a user-friendly interface for analyzing scoliosis detection results. The backend uses MySQL for data storage and management, facilitating efficient image processing, result display, and feedback from doctors. Evaluation metrics indicate that the second model, which underwent refined annotation and augmentation, performed better, avoiding overfitting and demonstrating higher precision. This approach enhances early scoliosis diagnosis and offers a scalable solution for other medical detection challenges, supporting healthcare providers with more accurate diagnostic tools and improving patient care.
Click on image to open SymOrg 2024 proceedings
In the paper “LLM Consistent Character Bias”, the authors Igor Culafic and Tomo Popovic investigate the potential of Large Language Models (LLMs) for character imitation in media, education, and entertainment. Traditionally, LLMs have been used for tasks like web search and programming, but this study focuses on their application in mimicking specific characters from books. Using a dataset created from the Ciaphas Cain anthology of Warhammer 40k, the authors trained models using Low-Rank Adaptation (LoRA) methods. Three models of varying sizes (1.1B, 7B, and 10.7B parameters) were tested, with training conducted on a NVIDIA RTX 4090 GPU. The study found that the larger models (7B and 10.7B) performed well in maintaining character consistency, though they occasionally struggled with specific details and displayed unexpected behaviors like excessive emoji usage. The smallest model (1.1B), despite higher LoRA Rank parameters, was less effective and prone to errors such as repetitive responses and long rants. The authors conclude that LLMs can successfully imitate fictional characters given adequate data and training, suggesting future improvements could make them useful in various fields, including education and therapy. These models have the potential to enhance interactive experiences in theme parks, video games, and educational tools by providing authentic character interactions. However, they caution against using these models as replacements for human therapists due to their limitations and tendency for inaccuracies.
Click on image to open SymOrg 2024 proceedings
Both research papers were partly supported by the EuroCC2 project that is funded by the European High-Performance Computing Joint Undertaking (JU) under Grant Agreement No 101101903.
Representative of NCC Montenegro Ms. Sanja Nikolic participated in the HPC Masterclass, a hybrid event held at “Ovidius” University of Constanța (20-24.05.2024) co-organized by NCC Romania. The second day of the training event was dedicated to NCC’s shared experience on HPC academic utilization and research excellence, introducing presenters from NCC Portugal, Montenegro, Bulgaria, France, and Luxembourg. Ms. Nikolic presented the development of the HPC+ (HPC and related technologies) educational ecosystem in Montenegro, intensively driven by the EuroCC project, NCC Montenegro and the University of Donja Gorica.
NCC Montenegro is focused on developing HPC/HPDA/AI academic programs, study courses, and training portfolios, following a sustained learning pathway:
• HPC/AI-related seasonal schools to mobilize high-school students and high-tech enthusiasts to enroll in HPC/AI-related academic programs. (“Open Mind Academy”). • BSc restructured program (M1-Software Development and M2-Digital Transformation), and first nationally accredited AI Master Program, at Faculty for Information Systems and Technologies. • Professional training courses, workshops, and networking events for academia and industry participants providing in-demand HPC/AI knowledge, technical upskilling, and supercomputing hands-on sessions.
NCC Montenegro’s training portfolio covers technology-specific know-how (HPC system architecture and applications, Parallel Programming, Python Programming, Deep Learning, Edge IoT, Computer Vision, NLL) and industry-specific priority domains, defined by the Smart Specialization Strategy of Montenegro (energy, health, tourism, agriculture, ICT).
NCC Montenegro is also fully exploiting joint training opportunities within the pan-European NCC network – to capitalize on their HPC expertise and resources, as well as productive collaboration with key MNE stakeholders (business associations, technical affiliations, and funding institutions) – to enhance national HPC/AI awareness, outreach and uptake.
The AI for Scientific Computing Bootcamp provides a step-by-step overview of the fundamentals of deep neural networks and walks attendees through the hands-on experience of building and improving deep learning models for applications related to scientific computing and physical systems defined by differential equations. The material will cover more advanced topics such as physics-informed neural networks (PINNs) and operator learning and make use of tools like NVIDIA Modulus to develop and train the models. This online bootcamp is a hands-on learning experience where you will be guided through step-by-step instructions with teaching assistants on hand to help throughout.
NCC Montenegro and NCC Spain, collaborators at the EuroCC project, organized the “HPC and AI Workshop” designed for academia, scholars, researchers who are interested in learning how to use Artificial Intelligence and High-performance Computing in real case scenarios. This has been achieved through five lectures featuring educators from Spain and Montenegro presenting successful case studies:
Borja Perez Pavon, from Universidad de Cantabria, talked about HPC systems and highlighted they are available for different research projects by accessing various free access calls.
Ivan Jovovic, AI researcher and PhD candidate at the University of Donja Gorica explained from the use of multiple GPUs to handle large data sets to the cons and pros of data parallelism.
Stevan Cakic is a PhD student at the University of Donja Gorica, talked about the application of AI and HPC in agriculture, delving into deep learning and high-performance computing.
Ahmad Al Mughrabi, active researcher and multidisciplinary predoctoral scholar at the Universitat de Barcelona, discussed the applications of HPC and generative AI, acknowledging certain challenges that need consideration in the implementation of HPC in real-case scenarios.
Dejan Babic, a PhD candidate at the University of Donja Gorica presented the concept AI and HPC use cases in medicine.