EVALITA Evaluation of NLP and Speech Tools for Italian
Proceedings of the Final Workshop 12-13 December 2018, Naples
Collana dell'Associazione Italiana di Linguistica ComputazionaleÉditeur : Accademia University Press
Lieu d’édition : Torino
Publication sur OpenEdition Books : 5 juin 2019
Collection : Collana dell'Associazione Italiana di Linguistica Computazionale
Année d’édition : 2018
Nombre de pages : 281
Présentation
EVALITA is a periodic evaluation campaign of Natural Language Processing (NLP) and speech tools for the Italian language.
The general objective of EVALITA is to promote the development of language and speech technologies for the Italian language, providing a shared framework where different systems and approaches can be evaluated in a consistent manner.
The diffusion of shared tasks and shared evaluation practices is a crucial step towards the development of resources and tools for NLP and speech sciences. The good response obtained by EVALITA, both in the number of participants and in the quality of results, showed that it is worth pursuing such goals for the Italian language.
As a side effect of the evaluation campaign, both training and test data are available to the scientific community as benchmarks for future improvements.
EVALITA is an initiative of the Italian Association for Computational Linguistics (AILC) and it is endorsed by the Italian Association for Artificial Intelligence (AI*IA) and the Italian Association for Speech Sciences (AISV).
Sommaire
Tommaso Caselli, Nicole Novielli, Viviana Patti et al.
Preface to the Evalita 2018 ProceedingsPart I. Introduction to Evalita 2018 and task overviews
Tommaso Caselli, Viviana Patti, Nicole Novielli et al.
Evalita 2018: Overview on the 6th Evaluation Campaign of Natural Language Processing and Speech Tools for ItalianSaif M. Mohammad
The Search for Emotions, Creativity, and Fairness in LanguagePierpaolo Basile, Danilo Croce, Valerio Basile et al.
Overview of the EVALITA 2018 Aspect-based Sentiment Analysis task (ABSITA)Francesco Ronzano, Francesco Barbieri, Endang Wahyu Pamungkas et al.
Overview of the EVALITA 2018 Italian Emoji Prediction (ITAMoji) TaskAlessandra Teresa Cignarella, Simona Frenda, Valerio Basile et al.
Overview of the EVALITA 2018 Task on Irony Detection in Italian Tweets (IronITA)Felice Dell’Orletta et Malvina Nissim
Overview of the EVALITA 2018 Cross-Genre Gender Prediction (GxG) TaskPierpaolo Basile et Nicole Novielli
Overview of the Evalita 2018 – itaLIan Speech acT labEliNg (iLISTEN) TaskFrancesco Cutugno, Maria Di Maro, Sara Falcone et al.
Overview of the EVALITA 2018 Evaluation of Italian DIALogue systems (IDIAL) TaskElisabetta Fersini, Debora Nozza et Paolo Rosso
Overview of the Evalita 2018 Task on Automatic Misogyny Identification (AMI)Cristina Bosco, Felice Dell’Orletta, Fabio Poletto et al.
Overview of the EVALITA 2018 Hate Speech Detection TaskPierpaolo Basile, Marco de Gemmis, Lucia Siciliani et al.
Overview of the EVALITA 2018 Solving language games (NLP4FUN) TaskMaria Di Maro, Antonio Origlia et Francesco Cutugno
Overview of the EVALITA 2018 Spoken Utterances Guiding Chef’s Assistant Robots (SUGAR) TaskPart II. Participant reports
Andrea Cimino, Lorenzo De Mattei et Felice Dell’Orletta
Multi-task Learning in Deep Neural Networks at EVALITA 2018Rodolfo Delmonte
ItVENSES - A Symbolic System for Aspect-Based Sentiment AnalysisEmanuele Di Rosa et Alberto Durante
Aspect-based Sentiment Analysis: X2Check at ABSITA 2018Mauro Bennici et Xileny Seijas Portocarrero
Ensemble of LSTMs for EVALITA 2018 Aspect-based Sentiment Analysis task (ABSITA)Jacob Anderson
Fully Convolutional Networks for Text ClassificationDaniele Di Sarli, Claudio Gallicchio et Alessio Micheli
ITAmoji 2018: Emoji Prediction via Tree Echo State NetworksLucia Siciliani et Daniela Girardi
The UNIBA System at the EVALITA 2018 Italian Emoji Prediction TaskAndrei Catalin Coman, Yaroslav Nechaev et Giacomo Zara
Predicting Emoji Exploiting Multimodal Data: FBK Participation in ITAmoji TaskMauro Bennici et Xileny Seijas Portocarrero
The validity of word vectors over the time for the EVALITA 2018 Emoji prediction task (ITAmoji)Andrea Santilli, Danilo Croce et Roberto Basili
A Kernel-based Approach for Irony and Sarcasm Detection in ItalianPierpaolo Basile et Giovanni Semeraro
UNIBA - Integrating distributional semantics features in a supervised approach for detecting irony in Italian tweetsEmanuele Di Rosa et Alberto Durante
Irony detection in tweets: X2Check at Ironita 2018Valentino Giudice
Aspie96 at IronITA (EVALITA 2018): Irony Detection in Italian Tweets with Character-Level Convolutional RNNReynier Ortega-Bueno et José E. Medina Pagola
UO_IRO: Linguistic informed deep-learning model for irony detectionAngelo Basile, Gareth Dwyer et Chiara Rubagotti
CapetownMilanoTirana for GxG at Evalita2018. Simple n-gram based models perform well for gender prediction. Sometimes.Danilo Croce et Roberto Basili
A Markovian Kernel-based Approach for itaLIan Speech acT labEliNgElena Shushkevich et John Cardiff
Misogyny Detection and Classification in English Tweets: The Experience of the ITT TeamSimona Frenda, Bilal Ghanem, Estefanía Guzmán-Falcón et al.
Automatic Expansion of Lexicons for Multilingual Misogyny DetectionResham Ahluwalia, Himani Soni, Edward Callow et al.
Detecting Hate Speech Against Women in English TweetsEndang Wahyu Pamungkas, Alessandra Teresa Cignarella, Valerio Basile et al.
Automatic Identification of Misogyny in English and Italian Tweets at EVALITA 2018 with a Multilingual Hate LexiconAngelo Basile et Chiara Rubagotti
CrotoneMilano for AMI at Evalita2018. A performant, cross-lingual misogyny detection system.Davide Buscaldi
Tweetaneuse @ AMI EVALITA2018: Character-based Models for the Automatic Misogyny Identification TaskPaula Fortuna, Ilaria Bonavita et Sérgio Nunes
Merging datasets for hate speech classification in ItalianMarco Polignano et Pierpaolo Basile
HanSEL: Italian Hate Speech detection through Ensemble Learning and Deep Neural NetworksMichele Corazza, Stefano Menini, Pinar Arslan et al.
Comparing Different Supervised Approaches to Hate Speech DetectionGretel Liz De la Peña Sarracén, Reynaldo Gil Pons, Carlos Enrique Muñiz Cuza et al.
Hate Speech Detection using Attention-based LSTMValentino Santucci, Stefania Spina, Alfredo Milani et al.
Detecting Hate Speech for Italian Language in Social MediaXiaoyu Bai, Flavio Merenda, Claudia Zaghi et al.
RuG @ EVALITA 2018: Hate Speech Detection In Italian Social MediaGiulio Bianchini, Lorenzo Ferri et Tommaso Giorni
Text analysis for hate speech detection in Italian messages on Twitter and FacebookFederico Sangati, Antonio Pascucci et Johanna Monti
Exploiting Multiword Expressions to solve “La Ghigliottina”Luca Squadrone
Computer challenges guillotine: how an artificial player can solve a complex language TV game with web data analysisSimone Magnolini, Vevake Balaraman, Marco Guerini et al.
The Perfect Recipe: Add SUGAR, Add Data
Le texte seul est utilisable sous licence Creative Commons - Attribution - Pas d'Utilisation Commerciale - Pas de Modification 4.0 International - CC BY-NC-ND 4.0. Les autres éléments (illustrations, fichiers annexes importés) sont « Tous droits réservés », sauf mention contraire.
