archimedes-Artificial Intelligence, Data Science, Algorithms-greece

 
Artificial Intelligence
 
Data Science
 
Algorithms

[Archimedes Talks&Tutorial Series] Tensor Decompositions in Large Scale Deep Learning

Dates
2024-06-13 12:00 - 15:30
Venue
Artemidos 1 - Amphitheater

 

Archimedes Talks & Tutorial Series: Tensor Decompositions in Large Scale Deep Learning.

Prof. Mihalis A. Nicolaou (Associate Professor at the Computation-based Science and Technology Research Center at The Cyprus Institute) & James Oldfield (PhD Student at Queen Mary University of London)

Talk (12:00-13:00, Mihalis Nicolaou)

Despite the initial success of deep learning in discriminative tasks, most recently, large-scale, often generative models (i.e., foundation models) have emerged as a dominant paradigm. Utilizing broad-data pre-training at scale, such models have proven more robust and generalizable to alternatives, albeit being considered more opaque due to their sheer scale. In this talk, we will discuss recent works that leverage tensor methods to make large-scale deep networks more interpretable, controllable, fair, and efficient – for example, by enabling unsupervised local editing in pre-trained networks, making fine-tuning of large models to new tasks efficient, scaling sub computations to achieve specialization, and grounding visual variability to concepts in vision-language models.


Tutorial (13:15-15:15, James Oldfield)

Modern deep learning architectures, such as transformers and convolutional neural networks (CNNs), leverage multi-dimensional representations (tensors) to process input data effectively. Consequently, many standard operations in deep neural networks can be understood through repeated multiplications and summations over various intermediate tensors and weights. In this tutorial, we explore how to unify these common operations in PyTorch through multilinear operations, and how this paradigm provides a flexible framework for designing and implementing novel deep learning architectures and techniques. Concrete examples from our recent work will be presented, including using factorized computation with einsum to efficiently scale the expert count in mixture of experts (μMoE layer).



Bio:Mihalis A. Nicolaou is Associate Professor at the Computation-based Science and Technology Research Center at The Cyprus Institute. Previously, he has held positions at Imperial College London and the University of London. He received the B.Sc. degree from the University of Athens, Greece, and the M.Sc. and Ph.D. degrees from the Department of Computing, Imperial College London, U.K.


Bio:James Oldfield is currently a PhD student at Queen Mary University of London. Previously, he was a research intern at The Cyprus Institute and Huawei Noah's Ark. His recent research focuses on interpretable and controllable deep learning models.


 

________________________________________________________________________________
Microsoft Teams Need help?
Meeting ID: 362 050 420 962
Passcode: 5HMeLm

For organizers: Meeting options
 
 
________________________________________________________________________________
 
 

Vision

To position Greece as a leading player in AI and Data Science

image
image

Mission

To build an AI Excellence Hub in Greece where the international research community can connect, groundbreaking ideas can thrive, and the next generation of scientists emerges, shaping a brighter future for Greece and the world

 

Welcome to ARCHIMEDES, a vibrant research hub connecting the global AI and Data Science research community fostering groundbreaking research in Greece and beyond. Its dedicated core team, comprising lead researchers, affiliated researchers, Post-Docs, PhDs and interns, is committed to advancing basic and applied research in Artificial Intelligence and its supporting disciplines, including Algorithms, Statistics, Learning Theory, and Game Theory organized around 8 core research areas. By collaborating with Greek and Foreign Universities and Research Institutes, ARCHIMEDES disseminates its research findings fostering knowledge exchange and providing enriching opportunities for students. Leveraging AI to address real-world challenges, ARCHIMEDES promotes innovation within the Greek ecosystem and extends its societal impact. Established in January 2022, as a research unit of the Athena Research Center with support from the Committee Greece 2021, ARCHIMEDES is funded for its first four years by the EU Recovery and Resilience Facility (RRF).

 
 

NEWS

 
Archimedes and the Biomedical Research Foundation Share Latest Findings in AI and Medicine

Archimedes and the Biomedical Research Foundation Share Latest Findings in AI and Medicine

Archimedes and the Biomedical Research Foundation of the Academy of Athens successfully hosted a special collaborative session at the Panhellenic Working Group Seminars of the Hellenic Society of Cardiology. This session focused on innovative applications of artificial intelligence in medicine, with a particular emphasis on advancements in cardiology. Held on Friday, February 7, 2025, in Room MC2 of the Megaron Athens International Conference Centre, the event brought together leading experts to explore how artificial intelligence is transforming cardiovascular medicine.

Archimedes Reaches Milestone of 200 Publications

Archimedes Reaches Milestone of 200 Publications

Archimedes is proud to announce that its researchers have published over 200 scientific publications in top-tier conferences (NeurIPS, ICLR, ICML) and journals.Archimedes maintains a vibrant scientific community of over 130 researchers, including more than 60 senior researchers (faculty members from Greece and abroad), 12 postdoctoral fellows, and 55 PhD students, along with over 20 undergraduate interns from various disciplines.

Happy International Greek Language Day!

Happy International Greek Language Day!

Today, we celebrate the historical, cultural, and linguistic significance of the Greek language. While Standard Modern Greek often takes center stage, we at Archimedes - AI and Data Science Research Hub recognize the impressive diversity and great cultural significance of its numerous dialects. These dialects present both exciting opportunities and complex challenges for AI and Large Language Models (LLMs) because each one of them presents unique linguistic features and all of them are low resourced. That’s why we’re using cutting-edge AI to document, digitize, and analyze these invaluable linguistic treasures, ensuring their preservation and accessibility for generations to come.

Two Research Positions in Data Stream Management Systems & Big Data Management

Two Research Positions in Data Stream Management Systems & Big Data Management

We are pleased to announce the availability of two research positions in data stream management systems and big data management, to be co-supervised by Assistant Professor Odysseas Papapetrou from the Eindhoven University of Technology (TU/e) in the Netherlands and Professor Minos Garofalakis from the Technical University of Crete in Greece.

 
 

The project “ARCHIMEDES Unit: Research in Artificial Intelligence, Data Science and Algorithms” with code OPS 5154714 is implemented by the National Recovery and Resilience Plan “Greece 2.0” and is funded by the European Union – NextGenerationEU.

greece2.0 eu_arch_logo_en

 

Stay connected! Subscribe to our mailing list by emailing sympa@lists.athenarc.gr
with the subject "subscribe archimedes-news Firstname LastName"
(replace with your details)