archimedes-Artificial Intelligence, Data Science, Algorithms-greece

 
Artificial Intelligence
 
Data Science
 
Algorithms

[Archimedes NLP Theme Meeting] Scale Equivariant Graph Metanetworks -Paper presentation

Dates
2025-02-17 17:30 - 18:30
Venue
Pythagoras, Archimedes Unit
Title: Scale Equivariant Graph Metanetworks

Speaker: Giannis Kalogeropoulos, Ph.D. student of Department of Informatics and Telecommunications of the National and Kapodistrian University of Athens (NKUA)

Abstract: We introduce a graph metanetwork framework that allows scaling and permutation equivariant neural network processing.

This paper pertains to an emerging machine learning paradigm: learning higher- order functions, i.e. functions whose inputs are functions themselves, particularly when these inputs are Neural Networks (NNs). With the growing interest in architectures that process NNs, a recurring design principle has permeated the field: adhering to the permutation symmetries arising from the connectionist structure of NNs. However, are these the sole symmetries present in NN parameterizations? Zooming into most practical activation functions (e.g. sine, ReLU, tanh) answers this question negatively and gives rise to intriguing new symmetries, which we collectively refer to as scaling symmetries, that is, non-zero scalar multiplications and divisions of weights and biases. In this work, we propose Scale Equivariant Graph MetaNetworks - ScaleGMNs, a framework that adapts the Graph Metanetwork (message-passing) paradigm by incorporating scaling symmetries and thus rendering neuron and edge representations equivariant to valid scalings. We introduce novel building blocks, of independent technical interest, that allow for equivariance or invariance with respect to individual scalar multipliers or their product and use them in all components of ScaleGMN. Furthermore, we prove that, under certain expressivity conditions, ScaleGMN can simulate the forward and backward pass of any input feedforward neural network. Experimental results demonstrate that our method advances the state-of-the-art performance for several datasets and activation functions, highlighting the power of scaling symmetries as an inductive bias for NN processing. The source code is publicly available at https://github.com/jkalogero/scalegmn.

Short Bio: Giannis holds an MEng in Electrical and Computer Engineering from the National Technical University of Athens, focusing on Computer Science. During his studies, he studied a lot of state-of-the-art deep learning techniques and cultivated a strong interest in Geometric Deep Learning. While working on his Diploma Thesis, he employed Graph Neural Networks and incorporated external knowledge for the multimodal task of Visual Dialog.
He has professional and research experience in studying and implementing machine learning models in a wide range of fields. Specifically, as a Machine Learning Engineer, he has worked on Natural Language Processing and Time Series Forecasting problems, employing, among others, pre-trained Language Models. Moreover, he has dove deeper into the MLOps techniques for orchestrating the whole lifecycle of an ML model. Finally, he has published and presented at an IEEE conference his work on Machine Learning and Edge Computing.


Room: Pythagoras, Archimedes Unit (1 Artemidos str., ART1 building, ground floor)
and virtually via Zoom Meetings - https://zoom.us/j/97800909461?pwd=hZN57oYaZnqG75U2OZYkK9vC0M0Tdj.1
Meeting ID: 978 0090 9461
Passcode: oIuc3O

Check for additional ways to participate/dial in at the bottom of the announcement.

Video: https://neurips.cc/virtual/2024/oral/97993

Stay tuned!
For ways to receive news about the NLP Group and its meetings, as well as to get check the latest information about the meetings of Archimedes NLP Theme and AUEB NLP Group, check http://nlp.cs.aueb.gr/news.html. To subscribe to the mailing list of AUEB NLP Group, send a message with subject "subscribe nodigest" to This email address is being protected from spambots. You need JavaScript enabled to view it.. If you have an AUEB account and want to receive announcements about AUEB NLP Group Meetings through MS Teams, subscribe to "AUEB NLP Group meetings" group on MS Teams (code: 01j65ny). Team members can also send text messages (chat) to other team members.

If you are an AI researcher or practitioner, please consider becoming a member of the Hellenic Artificial Intelligence Society (EETN, http://www.eetn.gr/en/).

Dial-in information:
One tap mobile
+302311180599,,97800909461#,,,,*314861# Greece
+302111984488,,97800909461#,,,,*314861# Greece

Dial by your location
• +30 231 118 0599 Greece
• +30 211 198 4488 Greece

Meeting ID: 978 0090 9461
Passcode: 314861

Find your local number: https://zoom.us/u/ab4yJClOiz


 
 

Vision

To position Greece as a leading player in AI and Data Science

image
image

Mission

To build an AI Excellence Hub in Greece where the international research community can connect, groundbreaking ideas can thrive, and the next generation of scientists emerges, shaping a brighter future for Greece and the world

 

Welcome to ARCHIMEDES, a vibrant research hub connecting the global AI and Data Science research community fostering groundbreaking research in Greece and beyond. Its dedicated core team, comprising lead researchers, affiliated researchers, Post-Docs, PhDs and interns, is committed to advancing basic and applied research in Artificial Intelligence and its supporting disciplines, including Algorithms, Statistics, Learning Theory, and Game Theory organized around 8 core research areas. By collaborating with Greek and Foreign Universities and Research Institutes, ARCHIMEDES disseminates its research findings fostering knowledge exchange and providing enriching opportunities for students. Leveraging AI to address real-world challenges, ARCHIMEDES promotes innovation within the Greek ecosystem and extends its societal impact. Established in January 2022, as a research unit of the Athena Research Center with support from the Committee Greece 2021, ARCHIMEDES is funded for its first four years by the EU Recovery and Resilience Facility (RRF).

 
 

NEWS

 
Archimedes Talk by Manos Athanassoulis on

Archimedes Talk by Manos Athanassoulis on "Harnessing the Untapped Benefits of Near-Sortedness for Data Systems"

On Tuesday 21 October, 2025, from 1:00 pm to 2:00 pm, at the Archimedes Amphitheatre (1 Artemidos Street, 15125, Marousi, Archimedes, Athena Research Center, Greece), Professor Manos Athanassoulis, Associate Professor of Computer Science at Boston University (BU), USA, Director and Founder of the BU Data-intensive Systems and Computing Laboratory, BU, USA, and Co-Director of the BU Massive Data Algorithms and Systems Group, BU, USA, will deliver an Archimedes talk on "Harnessing the Untapped Benefits of Near-Sortedness for Data Systems."

GameSec 2025 just Around the Corner!

GameSec 2025 just Around the Corner!

The 16th Conference on Game Theory and AI for Security (GameSec25), an event strongly supported by Archimedes, Athena Research Center, Greece will take place at the National Technical University of Athens, Greece from October 13-15 2025. "With the rapid advancement of artificial intelligence, game theory, and security technologies, the resilience and trustworthiness of modern systems is more critical than ever. The 2025 Conference on Game Theory and AI for Security focuses on leveraging strategic decision-making, adversarial reasoning, and computational intelligence to address security challenges in complex and dynamic environments.

11 Papers Accepted at NeurIPS 2025!

11 Papers Accepted at NeurIPS 2025!

We are happy to announce that 11 papers from Archimedes, Athena Research Center, Greece, have been accepted at the Thirty-Ninth Annual Conference on Neural Information Processing Systems (NeurIPS 2025)!NeurIPS is a major annual event in the artificial intelligence and machine learning community and this year it will take place from December 2 to December 7 at the San Diego Convention Center, California, USA.

Archimedes Postdoc will Conduct a Tutorial at the International Conference on Microelectronics 2025

Archimedes Postdoc will Conduct a Tutorial at the International Conference on Microelectronics 2025

Vassilis Alimisis, a postdoctoral researcher at Archimedes, Athena Research Center, Greece, will deliver a tutorial on "Low-Power Analog Hardware Classifier Architecture for ML Applications: From A to Z" at the International Conference on Microelectronics (ICM 2025), taking place on 14-17 December, 2025, in Cairo, Egypt.Abstract: This tutorial provides a comprehensive introduction to the design and implementation of low-power analog hardware classifiers tailored for machine learning (ML) applications, with a focus on energy-constrained environments such as edge devices and biomedical wearables. With the growing need for fast, efficient, and real-time data processing, analog computing has re-emerged as a promising solution that enables in-memory computation and significantly reduces power consumption compared to conventional digital processors.

Archimedes Flagship Project in Cardiology and AI is Featured in the News!

Archimedes Flagship Project in Cardiology and AI is Featured in the News!

Archimedes Research Unit of the Athena Research Center, Greece, is featured in a recent article in Dnews. This article is about an Archimedes flagship project in cardiology and AI that aims to use "two-dimensional echocardiographic data to develop deep learning tools and improve the treatment of heart problems."This project will be developed in collaboration with the Onassis Cardiac Surgery Center and the Archimedes Research Unit of the Athena Research Center, Greece. The Onassis Cardiac Surgery Center will contribute cardiac data and medical expertise, while the Archimedes Research Unit will set up a team of researchers who will develop advanced techniques and AI models that will address specific cardiological issues.

 
 

The project “ARCHIMEDES Unit: Research in Artificial Intelligence, Data Science and Algorithms” with code OPS 5154714 is implemented by the National Recovery and Resilience Plan “Greece 2.0” and is funded by the European Union – NextGenerationEU.

greece2.0 eu_arch_logo_en

 

Stay connected! Subscribe to our mailing list by emailing sympa@lists.athenarc.gr
with the subject "subscribe archimedes-news Firstname LastName"
(replace with your details)