Happy Women's Day!
8 March 2025
Happy Women's Day to the Invaluable Women of Archimedes.
greece
Algorithms
Data Science
Artificial Intelligence
Archimedes Seminar series:Are activation functions required for learning in all deep networks?
Prof. Grigorios Chrysos
Assistant Professor at University of Wisconsin – Madison
Abstract:Activation functions play a pivotal role in deep neural networks, enabling them to tackle complex tasks like image recognition. However, activation functions also introduce significant challenges for deep learning theory, network dynamics analysis, and properties such as interpretability and privacy preservation. In this talk, we revisit the necessity of activation functions across various scenarios. Specifically, we explore expressing network outputs through high-order interactions among input elements using multilinear algebra. This approach allows us to attain the necessary expressivity via these high-order interactions. Yet, the question remains: Is this expressivity alone sufficient for effective learning? Our recent research, presented at ICLR’24, unveils meticulously designed networks, which achieve strong performance even in demanding tasks, such as ImageNet image recognition.
BioGrigoriosChrysosis currently an Assistant Professor at University of Wisconsin-Madison, USA. He obtained hismaster’s degree in Electrical, Electronic Engineering and Computer Science from the National Technical University of Athens in 2014. Sequentially, he pursued a PhD degree at Imperial College London. He was a post-doctoral researcher with the Laboratory for Information and Inference Systems at the École PolytechniqueFédéralede Lausanne (EPFL), Switzerland
To position Greece as a leading player in AI and Data Science
To build an AI Excellence Hub in Greece where the international research community can connect, groundbreaking ideas can thrive, and the next generation of scientists emerges, shaping a brighter future for Greece and the world
Welcome to ARCHIMEDES, a vibrant research hub connecting the global AI and Data Science research community fostering groundbreaking research in Greece and beyond. Its dedicated core team, comprising lead researchers, affiliated researchers, Post-Docs, PhDs and interns, is committed to advancing basic and applied research in Artificial Intelligence and its supporting disciplines, including Algorithms, Statistics, Learning Theory, and Game Theory organized around 8 core research areas. By collaborating with Greek and Foreign Universities and Research Institutes, ARCHIMEDES disseminates its research findings fostering knowledge exchange and providing enriching opportunities for students. Leveraging AI to address real-world challenges, ARCHIMEDES promotes innovation within the Greek ecosystem and extends its societal impact. Established in January 2022, as a research unit of the Athena Research Center with support from the Committee Greece 2021, ARCHIMEDES is funded for its first four years by the EU Recovery and Resilience Facility (RRF).
The project “ARCHIMEDES Unit: Research in Artificial Intelligence, Data Science and Algorithms” with code OPS 5154714 is implemented by the National Recovery and Resilience Plan “Greece 2.0” and is funded by the European Union – NextGenerationEU.
Stay connected! Subscribe to our mailing list by emailing sympa@lists.athenarc.gr
with the subject "subscribe archimedes-news Firstname LastName"
(replace with your details)