anastasios-gerontopoulos
Anastasios Gerontopoulos
PhD student (UoC) & Academic fellow
University of Crete

Short Bio

Anastasios holds an M.Eng. degree in Electrical and Computer Engineering from Aristotle University of Thessaloniki. During his diploma thesis, he conducted research on efficient computer vision solutions for natural disaster management under the supervision of Professor I. Pitas. He has also worked as an R&D intern at Net2Grid, focusing on electricity theft detection using machine learning. Currently, he is a PhD fellow jointly affiliated with the Archimedes Research Unit and the University of Crete, where he works with Professor Nikos Komodakis on generative AI methods and their applications.

Research Interests

Anastasios’ research interests lie in generative artificial intelligence, with a particular focus on language modeling architectures, training objectives, and reasoning in Large Language Models.

PhD research on "Multi-Token Prediction Needs Registers"
Abstract: We propose MuToR, a simple and effective approach that leverages register tokens to predict future targets and enrich supervision for autoregressive transformers. Our method introduces only a negligible number of additional parameters and requires no architectural changes—ensuring compatibility with off-the-shelf pretrained language models.

 
 

The project “ARCHIMEDES Unit: Research in Artificial Intelligence, Data Science and Algorithms” with code OPS 5154714 is implemented by the National Recovery and Resilience Plan “Greece 2.0” and is funded by the European Union – NextGenerationEU.

greece2.0 eu_arch_logo_en

 

Stay connected! Subscribe to our mailing list by emailing sympa@lists.athenarc.gr
with the subject "subscribe archimedes-news Firstname LastName"
(replace with your details)