archimedes-Artificial Intelligence, Data Science, Algorithms-greece

 
Artificial Intelligence
 
Data Science
 
Algorithms

[Archimedes Talks Series] Cognitively motivated deep neural representations and architectures

Dates
2024-10-15 12:00 - 14:00
Venue
Artemidos 1 - Amphitheater
Title: Cognitively motivated deep neural representations and architectures 

Speaker: Assoc. Prof. Alexandros Potamianos  (NTUA, USC)


Abstract: Despite tremendous progress in artificial intelligence we continue to lag behind human capabilities in crucial areas such as generalization, robustness and efficiency - hallmarks of human cognition. This talk proposes a paradigm shift towards cognitively-motivated representations that explicitly incorporate macroscopic cognitive principles such as low-dimensionality, hierarchy, abstraction, neural feedback and sparsity. First, we argue that traditional metric spaces and linear tools are poorly suited for efficient information storage and processing, contrasting sharply with the brain's more effective organizational strategies. We show that a top-down hierarchical manifold representation of low-dimensional, sparse subspaces can achieve human-like performance in both decoding and induction tasks, particularly in lexical semantics. Next we explore the role of feedback mechanisms in the brain, especially feedback-driven deactivation of cortical columns, and present our work on MMLatch, a bottom-up top-down fusion model applied to multimodal sentiment analysis. This research highlights the importance of bidirectional information flow in neural architectures. Finally, we discuss a novel neural network architecture inspired by synaptic pruning during brain development. This approach utilizes long connections instead of traditional short residual connections, naturally pushing information to the first few layers of the network and resulting in sparsity. These networks exhibit behaviors reminiscent of biological brain networks, including enhanced robustness to noise, good performance  in low-data settings, and longer training times. Overall, our work demonstrates that by embracing cognitively-motivated principles in AI architectural design, we can create more efficient, robust, and human-like AI systems capable of improved generalization and induction. 

Bio: Alexandros Potamianos received the Diploma in electrical and computer engineering from the National Technical University of Athens, Greece, in 1990, and the M.S. and Ph.D. degrees in engineering sciences from Harvard University, Cambridge, MA, in 1991 and 1995, respectively. From 1995 to 1999, he was a Senior Technical Staff Member with AT&T Shannon Labs, Florham Park, NJ. From 1999 to 2002, he was a Technical Staff Member and Technical Supervisor with Bell Labs, Lucent Technologies, Murray Hill, NJ. From 2003 to 2013, he served as an associate professor at the Department of ECE, Technical University of Crete, Chania, Greece. Since 2013, he serves as an associate professor at the School of ECE, National Technical University of Athens, Greece. He is also a visiting professor at the Viterbi School of Engineering, University of Southern California, CA and an Amazon Scholar. He is the co-founder of Behavioral Signals, an emotion AI deep tech startup.  He has authored or coauthored over 200 papers in professional journals and conferences, and holds five patents. His current research interests include foundation models. speech processing, dialog and multimodal systems, natural language understanding, machine learning and multimodal child-computer interaction. Prof. Potamianos has served multiple terms at the IEEE Speech and Language Technical Committee and at the IEEE Multimedia Technical Committee. He received a 2005 IEEE Signal Processing Society Best Paper Award. He is an IEEE fellow, an International Speech Communication Association (ISCA) fellow and a fellow of the Asia-Pacific Artificial Intelligence Association (AAIA). 

________________________________________________________________________________
Microsoft Teams Need help?
Meeting ID: 338 882 842 320
Passcode: Vsw5aV

For organizers: Meeting options
________________________________________________________________________________
 
 

Vision

To position Greece as a leading player in AI and Data Science

image
image

Mission

To build an AI Excellence Hub in Greece where the international research community can connect, groundbreaking ideas can thrive, and the next generation of scientists emerges, shaping a brighter future for Greece and the world

 

ARCHIMEDES IMPACT

Highlights will be added soon.

 

NEWS

 
Efstathios Karypidis Awarded a Google PhD Fellowship

Efstathios Karypidis Awarded a Google PhD Fellowship

Archimedes congratulates PhD student Efstathios Karypidis (Archimedes Research Unit, Athena Research Center; National Technical University of Athens) on being awarded a Google PhD Fellowship. Stathis, supervised by Nikos Komodakis, develops world models that predict how scenes evolve in the semantic feature space of vision foundation models.

Τεχνητή Νοημοσύνη, Ηθική και Βιοηθική — Αρχιμανδρίτης Αρίσταρχος-Βασίλειος Γκρέκας

Τεχνητή Νοημοσύνη, Ηθική και Βιοηθική — Αρχιμανδρίτης Αρίσταρχος-Βασίλειος Γκρέκας

Τεχνητή Νοημοσύνη, Ηθική και Βιοηθική Ανθρωποκεντρική προσέγγιση, ασφάλεια και ανθρώπινη ευθύνη Αρχιμανδρίτης Αρίσταρχος-Βασίλειος Γκρέκας Αναπληρωτής Καθηγητής Θεολογίας και Εκκλησιαστικής Γραμματολογίας, Εθνικό και Καποδιστριακό Πανεπιστήμιο Αθηνών. Ημερομηνία και ώρα: Τετάρτη, 2 Δεκεμβρίου 2026, στις 11:00 (ώρα Αθήνας).Χώρος: Αρτέμιδος 6 και Επιδαύρου, Κεντρικό Αμφιθέατρο.Διαδικτυακή παρακολούθηση: Σύνδεση μέσω Microsoft Teams.

Διαδικτυακά Μαθήματα ΠΔΤΝ 2026–2027 (GR/EN)

Διαδικτυακά Μαθήματα ΠΔΤΝ 2026–2027 (GR/EN)

Τα Διαδικτυακά Μαθήματα του Πανελλήνιου Διαγωνισμού Τεχνητής Νοημοσύνης (ΠΔΤΝ) για το 2026–2027 ξεκινούν την Πέμπτη 12 Νοεμβρίου 2026, στις 15:00 (ώρα Αθήνας). Γνωρίστε τα Νευρωνικά Δίκτυα, την Επεξεργασία Φυσικής Γλώσσας και την Όραση Υπολογιστών μέσα από δωρεάν μαθήματα μέσω Zoom. Το κείμενο είναι διαθέσιμο στα ελληνικά και στα αγγλικά (English version below).

Ο ΠΔΤΝ ως μαθησιακή διαδρομή: ομιλία στο 18ο Διεθνές Συνέδριο «Η Πληροφορική στην Εκπαίδευση» (CIE 2026) (GR/EN)

Ο ΠΔΤΝ ως μαθησιακή διαδρομή: ομιλία στο 18ο Διεθνές Συνέδριο «Η Πληροφορική στην Εκπαίδευση» (CIE 2026) (GR/EN)

Η Ερευνητική Μονάδα «Αρχιμήδης» του ΕΚ «Αθηνά» συμμετείχε στο 18ο Διεθνές Συνέδριο «Η Πληροφορική στην Εκπαίδευση» (CIE 2026), με ομιλία για τον Πανελλήνιο Διαγωνισμό Τεχνητής Νοημοσύνης (ΠΔΤΝ). Το κείμενο είναι διαθέσιμο στα ελληνικά και στα αγγλικά (English version below).

 
 

The project “ARCHIMEDES Unit: Research in Artificial Intelligence, Data Science and Algorithms” with code OPS 5154714 is implemented by the National Recovery and Resilience Plan “Greece 2.0” and is funded by the European Union – NextGenerationEU.

Greece 2.0 – Funded by the European Union – NextGenerationEU