Preface to the Evalita 2018 Proceedings
p. 1
Texte intégral
1Welcome to EVALITA 2018! EVALITA is the evaluation campaign of Natural Language Processing and Speech Tools for the Italian language. This year we celebrate 10 years of EVALITA and shared tasks covering the analysis of both written and spoken language with the aim of enhancing the development and dissemination of resources and technologies for Italian. EVALITA is an initiative of the Italian Association for Computational Linguistics (AILC, http://www.ai-lc.it/). It is supported by the Italian Association for Artificial Intelligence (AI*IA, http://www.aixia.it/) and by the Italian Association of Speech Science (AISV, http://www.aisv.it/).
2This volume collects the reports of the tasks organisers and of the participants to all of the EVALITA 2018 tasks. This year we helped to organize 10 tasks structured in four tracks: i.) Affect, Creativity and Style: Aspect-based Sentiment Analysis (ABSITA), Italian Emoji Prediction (ITAMoji), Irony Detection in Twitter (IronITA), Cross-Genre Gender Prediction (GxG); ii.) Dialogue Systems: itaLIan Speech acT labEliNg (iLISTEN), Italian DIALogue systems evaluation (IDIAL); iii.) Hate Speech: Automatic Misogyny Identification (AMI); Hate Speech Detection (HaSpeeDe); iv.) Semantics4AI: Solving language games (NLP4FUN), Spoken Utterances Guiding Chefs Assistant Robots (SUGAR).
3The volume opens with an overview to the campaign, in which we describe the tasks in more detail, provide figures on the participants, and, especially, highlight the innovations introduced in this year’s edition. The abstract of Saif M. Mohammad’s keynote with title “The Search for Emotions, Creativity, and Fairness in Language" is also included in this introductory part of the volume.
4The final workshop was held in Turin on the 12th and 13th of December 2018 as a co-located event of the Fifth Italian Conference on Computational Linguistics (CLiC-it 2018, http://clic2018.di.unito.it/en/home-2/). The workshop has been an occasion for organizers and participants, from both academic institutions and companies, to disseminate their work and results and to share ideas through oral and poster presentations. This year the program also includes a panel on “The Future of Shared Tasks: data, evaluation, and technology transfer” as a moment of reflection after 10 years of EVALITA, also in light of the new regulations on privacy (i.e., the EU General Data Protection Regulation (GDPR)). A major innovation of this year is the best system award across all tasks. This wants to be a further incentive to involve students (both, undergraduates and Ph.D. students) and to push the boundaries of the state of the art further by “daring to experiment” rather than just winning.
5We thank all the people and institutions involved in the organisation of the tasks, and all the participants, who contributed to the success of the event. A special thank is due to AILC. Thanks are also due to AI*IA and AISV for endorsing EVALITA, to FBK and Manuela Speranza for making the web platform available once more for this edition (http://www.evalita.it), to our sponsors: CELI (https://www.celi.it/), Google Research, ELRA (http://elra.info/en/), and to Agenzia per l’Italia Digitale (AGID, https://www.agid.gov.it) for its endorsement. Last but not least, we heartily thank our invited speaker, Saif M. Mohammad from National Research Council Canada, for agreeing to share his expertise on key topics of EVALITA 2018 and to participate in our panel discussion, and all the other panelists: Franco Cutugno, (Università degli Studi di Napoli Federico II), Caterina Flick (Lawyer and coordinator of the Web & Media Committee of the Fédération Internationale des Femmes des Carrières Juridiques) and Malvina Nissim (Rijksuniversiteit Groningen).
6November 2018
Auteurs
Rijksuniveristeit Groningen, The Netherlands
Università degli Studi di Bari “A. Moro”, Italy
Università degli Studi di Torino, Italy
PRHLT Research Center, Universitat Politcnica de Valncia, Spain
Le texte seul est utilisable sous licence Creative Commons - Attribution - Pas d'Utilisation Commerciale - Pas de Modification 4.0 International - CC BY-NC-ND 4.0. Les autres éléments (illustrations, fichiers annexes importés) sont « Tous droits réservés », sauf mention contraire.
Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015
3-4 December 2015, Trento
Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)
2015
Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016
5-6 December 2016, Napoli
Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)
2016
EVALITA. Evaluation of NLP and Speech Tools for Italian
Proceedings of the Final Workshop 7 December 2016, Naples
Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)
2016
Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017
11-12 December 2017, Rome
Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)
2017
Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018
10-12 December 2018, Torino
Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)
2018
EVALITA Evaluation of NLP and Speech Tools for Italian
Proceedings of the Final Workshop 12-13 December 2018, Naples
Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)
2018
EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020
Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop
Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)
2020
Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020
Bologna, Italy, March 1-3, 2021
Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)
2020
Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021
Milan, Italy, 26-28 January, 2022
Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)
2022