archimedes-Artificial Intelligence, Data Science, Algorithms-greece

 
Artificial Intelligence
 
Data Science
 
Algorithms

Athena ILSP/Archimedes NLP Theme Talk: Jais and Jais-chat

Dates
2024-03-07 16:00 - 18:00
Venue
Zampolli

 

ILSP & Archimedes NLP Theme Talk, Thursday 7 March, 16:00 (Greek time)
Speaker: Preslav Nakov
(https://mbzuai.ac.ae/study/faculty/preslav-nakov/)
Title: "Jais and Jais-chat: Building the World's Best Open Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language Models"

Room: Zampolli, Athena Main Building (6 Artemidos str., Marousi, ground floor)
and virtually via MS Teams:

https://teams.microsoft.com/l/meetup-join/19%3ameeting_NDgzMjM1MTQtYWFiMS00ZDk4LTlhYmItOTg1NDlhYWRjNTg3%40thread.v2/0?context=%7b%22Tid%22%3a%226ae07702-c5f7-4f38-9b87-acad62a75d93%22%2c%22Oid%22%3a%22735f6987-4242-47ec-98d6-f1eb55fb371f%22%7d

  • Meeting ID: 364 885 596 720
  • Passcode: jbYNHY

Abstract:

I will discuss Jais and Jais-chat, two state-of-the-art Arabic-centric foundation and instruction-tuned open generative large language models (LLMs). The models are based on the GPT-3 decoder-only architecture and are pretrained on a mixture of Arabic and English texts, including source code in various programming languages. The models demonstrate better knowledge and reasoning capabilities in Arabic than previous open Arabic and multilingual models by a sizable margin, based on extensive evaluation. Moreover, they are competitive in English compared to English-centric open models of similar size, despite being trained on much less English data. I will discuss the training, the tuning, the safety alignment, and the evaluation, as well as the lessons we learned.

Speaker Bio:

Preslav Nakov is Professor and Department Chair for NLP at the Mohamed bin Zayed University of Artificial Intelligence. Previously, he was Principal Scientist at the Qatar Computing Research Institute, HBKU, where he led the Tanbih mega-project, developed in collaboration with MIT, which aims to limit the impact of "fake news", propaganda and media bias by making users aware of what they are reading, thus promoting media literacy and critical thinking. He received his PhD degree in Computer Science from the University of California at Berkeley, supported by a Fulbright grant. He is Chair-Elect of the European Chapter of the Association for Computational Linguistics (EACL), Secretary of ACL SIGSLAV, and Secretary of the Truth and Trust Online board of trustees. Formerly, he was PC chair of ACL 2022, and President of ACL SIGLEX. He is also member of the editorial board of several journals including Computational Linguistics, TACL, ACM TOIS, IEEE TASL, IEEE TAC, CS&L, NLE, AI Communications, and Frontiers in AI. He authored a Morgan & Claypool book on Semantic Relations between Nominals, two books on computer algorithms, and 250+ research papers. He received a Best Paper Award at ACM WebSci'2022, a Best Long Paper Award at CIKM'2020, a Best Demo Paper Award (Honorable Mention) at ACL'2020, a Best Task Paper Award (Honorable Mention) at SemEval'2020, a Best Poster Award at SocInfo'2019, and the Young Researcher Award at RANLP’2011. He was also the first to receive the Bulgarian President's John Atanasoff award, named after the inventor of the first automatic electronic digital computer. His research was featured by over 100 news outlets, including Reuters, Forbes, Financial Times, CNN, Boston Globe, Aljazeera, DefenseOne, Business Insider, MIT Technology Review, Science Daily, Popular Science, Fast Company, The Register, WIRED, and Engadget, among others.

Stay tuned for future events:

For ways to receive news about the Archimedes Unit and its meetings, check https://archimedesai.gr/en/. To subscribe to the mailing list of Archimedes, send a message with title "subscribe archimedes-news  Firstname LastName” (where Firstname   and LastName  are your First and Last Name respectively) to This email address is being protected from spambots. You need JavaScript enabled to view it.. The body of the message may be blank

If you are an AI researcher or practitioner, please consider becoming a member of the Hellenic Artificial Intelligence Society (EETN, http://www.eetn.gr/en/).

 

________________________________________________________________________________

Microsoft Teams meeting

Join on your computer, mobile app or room device

Click here to join the meeting

Meeting ID: 364 885 596 720
Passcode: jbYNHY

________________________________________________________________________________

 

 
 

Vision

To position Greece as a leading player in AI and Data Science

image
image

Mission

To build an AI Excellence Hub in Greece where the international research community can connect, groundbreaking ideas can thrive, and the next generation of scientists emerges, shaping a brighter future for Greece and the world

 

Welcome to ARCHIMEDES, a vibrant research hub connecting the global AI and Data Science research community fostering groundbreaking research in Greece and beyond. Its dedicated core team, comprising lead researchers, affiliated researchers, Post-Docs, PhDs and interns, is committed to advancing basic and applied research in Artificial Intelligence and its supporting disciplines, including Algorithms, Statistics, Learning Theory, and Game Theory organized around 8 core research areas. By collaborating with Greek and Foreign Universities and Research Institutes, ARCHIMEDES disseminates its research findings fostering knowledge exchange and providing enriching opportunities for students. Leveraging AI to address real-world challenges, ARCHIMEDES promotes innovation within the Greek ecosystem and extends its societal impact. Established in January 2022, as a research unit of the Athena Research Center with support from the Committee Greece 2021, ARCHIMEDES is funded for its first four years by the EU Recovery and Resilience Facility (RRF).

 
 

NEWS

 
New Publication by Archimedes Lead Researcher John Pavlopoulos

New Publication by Archimedes Lead Researcher John Pavlopoulos

A new paper co-authored by John Pavlopoulos from Archimedes Research Unit at the Athena Research Center, Kanella K. Pouliand Maria Gavriilidou from the Institute for Language and Speech Processing (ILSP) at the Athena Research Center, and Juli Bakagianni from the Department of Informatics of the Athens University of Economics & Business (AUEB) has been accepted for publication at Patterns journal.

Archimedes Workshop on Dialect NLP

Archimedes Workshop on Dialect NLP

Upcoming workshop on Dialect NLP on “Standardization and Variation for Dialect Varieties with Universal Dependencies as an Application Framework” coming up. We are excited to announce that the Dialect NLP team at Archimedes, Athena Research Center, Greece, is organizing a workshop in collaboration with the MaiNLP Research Lab at Ludwig Maximilian University (LMU) of Munich.

 
 

The project “ARCHIMEDES Unit: Research in Artificial Intelligence, Data Science and Algorithms” with code OPS 5154714 is implemented by the National Recovery and Resilience Plan “Greece 2.0” and is funded by the European Union – NextGenerationEU.

greece2.0 eu_arch_logo_en

 

Stay connected! Subscribe to our mailing list by emailing sympa@lists.athenarc.gr
with the subject "subscribe archimedes-news Firstname LastName"
(replace with your details)