The next PGR seminar is taking place this Friday 30th May at 2PM in JC 1.33a
Below are the Titles and Abstracts for Lina and Victor’s talks – Please do come along if you are able.
Lina Hadji-Kyriacou
Title: Context-PEFT: Efficient Cross-Domain Transfer Learning
Abstract: Parameter-Efficient Fine-Tuning (PEFT) techniques such as LoRA, BitFit and IA3 have demonstrated comparable performance to full fine-tuning of pre-trained models for specific downstream tasks, all while demanding significantly fewer trainable parameters and reduced GPU memory consumption. However, in the context of cross-domain transfer learning, the need for architectural modifications or full fine-tuning often becomes apparent. To address this we propose Context-PEFT, which learns different groups of adaptor parameters based on the current input domain. This approach enables LoRA-like weight injection without requiring additional architectural changes. Our method is evaluated on the COCO captioning task, where it outperforms full fine-tuning under similar data constraints while simultaneously offering a substantially more parameter-efficient and computationally economical solution.
Victor Yuan
Title: Methodologies for Creating Interactive and Lifelike Historical Characters Based on MetaHuman
Abstract: Virtual characters have long held promise as pedagogical tools in heritage education, particularly for creating immersive interactions with historical figures. Researchers have envisioned systems capable of emulating these figures, enabling users to engage in life-like, face-to-face dialogues over time. While technological constraints historically limited such applications, recent advancements in computational graphics and language models have now made them viable. This paper presents a framework for constructing interactive virtual character systems, outlining their core components through two critical dimensions: photorealism and interaction. The photorealism dimension leverages modern graphics tools to achieve high-fidelity visual representation, while the interaction dimension utilizes language models to enable socially believable and contextually responsive dialogue. We examine the necessity of each component and analyze available technological solutions with their respective trade-offs. Beyond the technical framework, we discuss potential future improvements and address ethical and practical concerns inherent to such systems. By synthesizing current technologies and their applicability, this work provides institutions with practical guidance for developing customized interactive systems that balance functionality with cost-efficiency.