archimedes-Artificial Intelligence, Data Science, Algorithms-greece

 
Artificial Intelligence
 
Data Science
 
Algorithms

[Archimedes Seminar Series] Are activation functions required for learning in all deep networks?

Dates
2024-06-03 14:30 - 16:30
Venue
Artemidos 1 - Amphitheater

Archimedes Seminar series:Are activation functions required for learning in all deep networks? 

Prof. Grigorios Chrysos

Assistant Professor at University of Wisconsin – Madison

Screen Shot 2024 06 03 at 2.30 PM

 

Abstract:Activation functions play a pivotal role in deep neural networks, enabling them to tackle complex tasks like image recognition. However, activation functions also introduce significant challenges for deep learning theory, network dynamics analysis, and properties such as interpretability and privacy preservation. In this talk, we revisit the necessity of activation functions across various scenarios. Specifically, we explore expressing network outputs through high-order interactions among input elements using multilinear algebra. This approach allows us to attain the necessary expressivity via these high-order interactions. Yet, the question remains: Is this expressivity alone sufficient for effective learning? Our recent research, presented at ICLR’24, unveils meticulously designed networks, which achieve strong performance even in demanding tasks, such as ImageNet image recognition. 

 

BioGrigoriosChrysosis currently an Assistant Professor at University of Wisconsin-Madison, USA. He obtained hismaster’s degree in Electrical, Electronic Engineering and Computer Science from the National Technical University of Athens in 2014. Sequentially, he pursued a PhD degree at Imperial College London. He was a post-doctoral researcher with the Laboratory for Information and Inference Systems at the École PolytechniqueFédéralede Lausanne (EPFL), Switzerland

________________________________________________________________________________

Microsoft TeamsNeed help?

Meeting ID:376 424 170 772

Passcode:SjcJVt


For organizers:Meeting options

________________________________________________________________________________

 
 

Vision

To position Greece as a leading player in AI and Data Science

image
image

Mission

To build an AI Excellence Hub in Greece where the international research community can connect, groundbreaking ideas can thrive, and the next generation of scientists emerges, shaping a brighter future for Greece and the world

 

Welcome to ARCHIMEDES, a vibrant research hub connecting the global AI and Data Science research community fostering groundbreaking research in Greece and beyond. Its dedicated core team, comprising lead researchers, affiliated researchers, Post-Docs, PhDs and interns, is committed to advancing basic and applied research in Artificial Intelligence and its supporting disciplines, including Algorithms, Statistics, Learning Theory, and Game Theory organized around 8 core research areas. By collaborating with Greek and Foreign Universities and Research Institutes, ARCHIMEDES disseminates its research findings fostering knowledge exchange and providing enriching opportunities for students. Leveraging AI to address real-world challenges, ARCHIMEDES promotes innovation within the Greek ecosystem and extends its societal impact. Established in January 2022, as a research unit of the Athena Research Center with support from the Committee Greece 2021, ARCHIMEDES is funded for its first four years by the EU Recovery and Resilience Facility (RRF).

 
 

NEWS

 
Archimedes Talk by Eli Baum on

Archimedes Talk by Eli Baum on "ORQ: Scaling Complex Multiparty Computations to Large Private Datasets"

On Monday 4 May, 2026, from 1:00 pm to 2:30 pm, at the Archimedes Amphitheatre (1 Artemidos Street, 15125, Marousi, Archimedes, Athena Research Center, Greece), Eli Baum, a third-year Ph.D. student at  Boston University, USA, and a member of the BU CASP Systems Lab and the BU Security Group, will deliver an Archimedes talk on "ORQ: Scaling Complex Multiparty Computations to Large Private Datasets."

DialRes-LREC 2026 workshop: “Dialects in NLP: A Resource Perspective”

DialRes-LREC 2026 workshop: “Dialects in NLP: A Resource Perspective”

Researchers from the Archimedes Unit of the Athena Research Center, Greece, together with the Athena Research Center team on Dialectal NLP, affiliated with the Institute for Language and Speech Processing, and in collaboration with researchers from George Mason University, are organizing the first edition of the DialRes-LREC 2026 workshop, “Dialects in NLP: A Resource Perspective”, to be held on 16 May 2026. More information is available here: https://dialres.github.io/dialres/index.html.

Antonis Anastasopoulos' Keynote Speech on

Antonis Anastasopoulos' Keynote Speech on "Machine Translation and Low-Resource NLP" from the Athens NLP 2025 Summer School is Now Available Online

Antonis Athanassopoulos, an Assistant Professor at the Computer Science Department of George Mason University,USA, and a Lead Researcher at Archimedes, Athena Research Center, Greece, was one of the keynote speakers at the Athens NLP 2025 Summer School, held at the National Centre for Scientific Research Demokritos in Greece, from 4 to 10 September 2025.His presentation on "Machine Translation and Low-Resource NLP" is now available online.

Christos Papadimitriou Speaks on “Artificial Intelligence: its History, its Present, and its Uncertain Future”

Christos Papadimitriou Speaks on “Artificial Intelligence: its History, its Present, and its Uncertain Future”

Christos Papadimitriou, Donovan Family Professor of Computer Science at Columbia Engineering at Columbia University, USA, and Principal Scientist at the Archimedes Research Unit of the Athena Research Center, Greece, spoke about “Artificial Intelligence: its History, its Present, and its Uncertain Future” during the ten-year anniversary event of diaNEOsis think tank, which took place on March 11, 2026, at the Stavros Niarchos Foundation Cultural Center (SNFCC).

 
 

The project “ARCHIMEDES Unit: Research in Artificial Intelligence, Data Science and Algorithms” with code OPS 5154714 is implemented by the National Recovery and Resilience Plan “Greece 2.0” and is funded by the European Union – NextGenerationEU.

greece2.0 eu_arch_logo_en

 

Stay connected! Subscribe to our mailing list by emailing sympa@lists.athenarc.gr
with the subject "subscribe archimedes-news Firstname LastName"
(replace with your details)