archimedes-Artificial Intelligence, Data Science, Algorithms-greece

 
Artificial Intelligence
 
Data Science
 
Algorithms

[Archimedes Seminar Series] Uncertainty in NLP: Quantification, interpretation, evaluation and beyond

Dates
2024-07-03 11:00 - 13:00
Venue
Artemidos 1 - Amphitheater

 

Title: Uncertainty in NLP: Quantification, interpretation, evaluation and beyond.

Presenter: Prof Chrysoula (Chryssa) Zerva (Instituto Superior Tecnico, Portugal)

Screenshot 2024 07 03 at 11am
Abstract:
As the popularity, availability (and size) of language models keep increasing, so do their applications to different tasks, rendering them ubiquitous in modern society. This, in turn, brings forward the question of reliability. We know models don’t always “know what they don’t know” and may end up generating seemingly convincing answers that are entirely wrong. Hence, being able to quantify the uncertainty over their predictions is a key step in the path towards the reliability of language models.  
 
This talk will discuss the challenges of uncertainty estimation for natural language processing, emphasising aspects such as multiple sources of uncertainty and limited access to the model parameters (black box models) as well as aspects of interpretation and evaluation. I will focus on generation and evaluation tasks, using machine translation as the main paradigm, and discuss how the conformal prediction framework can be leveraged to provide meaningful confidence intervals with statistical guarantees, while also allowing us to calibrate our confidence to obtain more interpretable and fair uncertainty representations.  

Bio: Dr. Chrysoula Zerva is an Assistant Professor in Artificial Intelligence at the Instituto Superior Técnico in Lisbon, Portugal and a researcher at the Lisbon branch of the Instituto de Telecomunicações. She is a member of the ELLIS network as well as a member of LUMLIS, the Lisbon ELLIS unit.  
 
Dr. Chrysoula Zerva obtained her PhD in 2019 from the University of Manchester working on “Automated identification of textual uncertainty” under the supervision of Prof. Sophia Ananiadou. She was subsequently awarded the EPSRC doctoral prize fellowship to work on (mis)information propagation in the health and science domains. In 2021, she joined the Instituto de Telecomunicações in Lisbon as a post-doc researcher for the DeepSPIN project led by Prof. André Martins, focussing on uncertainty quantification, machine translation and quality estimation.  
 
She is co-PI in the Centre of Responsible AI, a PRR-funded initiative aiming to promote AI technology that is trustworthy, privacy-preserving, sustainable and fair, contributing towards a more equal society. She is also participating in the UTTER project, which aims to advance transcription and translation for extended reality models, where she leads the work related to Adaptable and context-aware models.  Overall, her research interests lie in the areas of machine learning (ML) and natural language processing (NLP). In more detail, she is interested in topics of uncertainty (both in models and data), fairness, contextualization and explainability and is keen on exploring multilingual and multimodal setups along the aforementioned directions. 
 

 

________________________________________________________________________________
Microsoft Teams Need help?
Meeting ID: 332 690 580 834
Passcode: VWdWex

For organizers: Meeting options
 
 
________________________________________________________________________________
 
 

Vision

To position Greece as a leading player in AI and Data Science

image
image

Mission

To build an AI Excellence Hub in Greece where the international research community can connect, groundbreaking ideas can thrive, and the next generation of scientists emerges, shaping a brighter future for Greece and the world

 

Welcome to ARCHIMEDES, a vibrant research hub connecting the global AI and Data Science research community fostering groundbreaking research in Greece and beyond. Its dedicated core team, comprising lead researchers, affiliated researchers, Post-Docs, PhDs and interns, is committed to advancing basic and applied research in Artificial Intelligence and its supporting disciplines, including Algorithms, Statistics, Learning Theory, and Game Theory organized around 8 core research areas. By collaborating with Greek and Foreign Universities and Research Institutes, ARCHIMEDES disseminates its research findings fostering knowledge exchange and providing enriching opportunities for students. Leveraging AI to address real-world challenges, ARCHIMEDES promotes innovation within the Greek ecosystem and extends its societal impact. Established in January 2022, as a research unit of the Athena Research Center with support from the Committee Greece 2021, ARCHIMEDES is funded for its first four years by the EU Recovery and Resilience Facility (RRF).

 
 

NEWS

 
Archimedes Talk by Manos Athanassoulis on

Archimedes Talk by Manos Athanassoulis on "Harnessing the Untapped Benefits of Near-Sortedness for Data Systems"

On Tuesday 21 October, 2025, from 1:00 pm to 2:00 pm, at the Archimedes Amphitheatre (1 Artemidos Street, 15125, Marousi, Archimedes, Athena Research Center, Greece), Professor Manos Athanassoulis, Associate Professor of Computer Science at Boston University (BU), USA, Director and Founder of the BU Data-intensive Systems and Computing Laboratory, BU, USA, and Co-Director of the BU Massive Data Algorithms and Systems Group, BU, USA, will deliver an Archimedes talk on "Harnessing the Untapped Benefits of Near-Sortedness for Data Systems."

GameSec 2025 just Around the Corner!

GameSec 2025 just Around the Corner!

The 16th Conference on Game Theory and AI for Security (GameSec25), an event strongly supported by Archimedes, Athena Research Center, Greece will take place at the National Technical University of Athens, Greece from October 13-15 2025. "With the rapid advancement of artificial intelligence, game theory, and security technologies, the resilience and trustworthiness of modern systems is more critical than ever. The 2025 Conference on Game Theory and AI for Security focuses on leveraging strategic decision-making, adversarial reasoning, and computational intelligence to address security challenges in complex and dynamic environments.

11 Papers Accepted at NeurIPS 2025!

11 Papers Accepted at NeurIPS 2025!

We are happy to announce that 11 papers from Archimedes, Athena Research Center, Greece, have been accepted at the Thirty-Ninth Annual Conference on Neural Information Processing Systems (NeurIPS 2025)!NeurIPS is a major annual event in the artificial intelligence and machine learning community and this year it will take place from December 2 to December 7 at the San Diego Convention Center, California, USA.

Archimedes Postdoc will Conduct a Tutorial at the International Conference on Microelectronics 2025

Archimedes Postdoc will Conduct a Tutorial at the International Conference on Microelectronics 2025

Vassilis Alimisis, a postdoctoral researcher at Archimedes, Athena Research Center, Greece, will deliver a tutorial on "Low-Power Analog Hardware Classifier Architecture for ML Applications: From A to Z" at the International Conference on Microelectronics (ICM 2025), taking place on 14-17 December, 2025, in Cairo, Egypt.Abstract: This tutorial provides a comprehensive introduction to the design and implementation of low-power analog hardware classifiers tailored for machine learning (ML) applications, with a focus on energy-constrained environments such as edge devices and biomedical wearables. With the growing need for fast, efficient, and real-time data processing, analog computing has re-emerged as a promising solution that enables in-memory computation and significantly reduces power consumption compared to conventional digital processors.

Archimedes Flagship Project in Cardiology and AI is Featured in the News!

Archimedes Flagship Project in Cardiology and AI is Featured in the News!

Archimedes Research Unit of the Athena Research Center, Greece, is featured in a recent article in Dnews. This article is about an Archimedes flagship project in cardiology and AI that aims to use "two-dimensional echocardiographic data to develop deep learning tools and improve the treatment of heart problems."This project will be developed in collaboration with the Onassis Cardiac Surgery Center and the Archimedes Research Unit of the Athena Research Center, Greece. The Onassis Cardiac Surgery Center will contribute cardiac data and medical expertise, while the Archimedes Research Unit will set up a team of researchers who will develop advanced techniques and AI models that will address specific cardiological issues.

 
 

The project “ARCHIMEDES Unit: Research in Artificial Intelligence, Data Science and Algorithms” with code OPS 5154714 is implemented by the National Recovery and Resilience Plan “Greece 2.0” and is funded by the European Union – NextGenerationEU.

greece2.0 eu_arch_logo_en

 

Stay connected! Subscribe to our mailing list by emailing sympa@lists.athenarc.gr
with the subject "subscribe archimedes-news Firstname LastName"
(replace with your details)