Workshops "Understanding and Evaluating Complex Automation Systems for Journals"

"Understanding and Evaluating Complex Automation Systems for Journals" This new series of workshop-discussions is a response to the concerns and needs raised during the workshop series held in the winter of 2025. We aim to give partner journal teams the opportunity to gain a deeper understanding of AI systems and to equip themselves with practical tools for the qualitative (and quantitative) evaluation of the tools and algorithms that are transforming your professional practices. Each session is built around a 30-minute presentation on a theme illustrated by cases directly relevant to the role of journals (e.g., understanding complex AI architectures like RAG and agentic AI, evaluating the automatic generation of abstracts, and debunking myths about AI).

Duration: 1h15, with 30min presentation and 45min discussion

Day and time

Thursday : 9h-10h15 (Montréal) / 15h-16h15 (Paris)

Agenda:

Feb 12th: Introduction to complex AI systems - Alexia Schneider

March 19th: Evaluation of a LLM for abstract generation (subject to changes) - Gauransh Kumar Thursday 9h-10h15 (Montréal) / 14h-15h15 (Paris)

April 16th: Debunking myth surrounding automation and AI, the example of HTR (subject to changes) - Alix Chagué