Table des matières
Tommaso Caselli, Nicole Novielli, Viviana Patti et al.
Preface to the Evalita 2018 ProceedingsPart I. Introduction to Evalita 2018 and task overviews
Tommaso Caselli, Viviana Patti, Nicole Novielli et al.
Evalita 2018: Overview on the 6th Evaluation Campaign of Natural Language Processing and Speech Tools for ItalianSaif M. Mohammad
The Search for Emotions, Creativity, and Fairness in LanguagePierpaolo Basile, Danilo Croce, Valerio Basile et al.
Overview of the EVALITA 2018 Aspect-based Sentiment Analysis task (ABSITA)Francesco Ronzano, Francesco Barbieri, Endang Wahyu Pamungkas et al.
Overview of the EVALITA 2018 Italian Emoji Prediction (ITAMoji) Task- 1 Introduction
- 2 Emojis and Italian
- 3 Task Description
- 4 Task Data
- 5 Evaluation
- 5.1 Metrics
- 5.2 Baseline
- 5.3 Participating Systems and Results
- 5.4 Analysis
- 5.5 Emoji prediction by humans
- 5.5.1 Figure 8 human annotation
- 5.5.2 Twitter human annotation
- 5.5.3 Comparing human and automated emoji predictions
- 6 Conclusion
Alessandra Teresa Cignarella, Simona Frenda, Valerio Basile et al.
Overview of the EVALITA 2018 Task on Irony Detection in Italian Tweets (IronITA)- 1 Introduction
- 2 Task Description
- 3 Training and Test Data
- 3.1 Composition of the datasets
- 3.2 Annotation of the datasets
- 3.3 Data Release
- 4 Evaluation Measures
- 5 Participants and Results
- 5.1 Task A: Irony Detection
- 5.2 Task B: Different types of irony
- 6 Discussion
- 7 Concluding remarks
- Acknowledgments
Felice Dell’Orletta et Malvina Nissim
Overview of the EVALITA 2018 Cross-Genre Gender Prediction (GxG) TaskPierpaolo Basile et Nicole Novielli
Overview of the Evalita 2018 – itaLIan Speech acT labEliNg (iLISTEN) TaskFrancesco Cutugno, Maria Di Maro, Sara Falcone et al.
Overview of the EVALITA 2018 Evaluation of Italian DIALogue systems (IDIAL) Task- 1 Task Motivations
- 2 IDIAL Evaluation Protocol
- 2.1 Evaluation Method
- 2.2 Evaluation Procedure
- 2.3 Submission Requirements
- 3 Participant Systems
- 3.1 CH1 Conversational System for Diabetics
- 3.2 Interactive Media Call-Steering System
- 3.3 Cedat 85: Speech Technologies in Action
- 4 Application of the IDIAL Evaluation protocol
- 4.1 User Experience
- 4.2 Linguistic Stress Tests
- 5 Qualitative Analysis and Discussion
- 6 Post-Evaluation Questionnaire
- 7 Conclusion
Elisabetta Fersini, Debora Nozza et Paolo Rosso
Overview of the Evalita 2018 Task on Automatic Misogyny Identification (AMI)Cristina Bosco, Felice Dell’Orletta, Fabio Poletto et al.
Overview of the EVALITA 2018 Hate Speech Detection Task- 1 Introduction and Motivations
- 2 Task Organization
- 3 Datasets and Format
- 3.1 Facebook Dataset
- 3.2 Twitter Dataset
- 3.3 Format and Data in HaSpeeDe
- 4 Evaluation
- 5 Overview of the Task: Participation and Results
- 5.1 Task Participants and Submissions
- 5.2 Systems
- 5.3 Results and Discussion
- 6 Closing Remarks
- Acknowledgments
Pierpaolo Basile, Marco de Gemmis, Lucia Siciliani et al.
Overview of the EVALITA 2018 Solving language games (NLP4FUN) TaskMaria Di Maro, Antonio Origlia et Francesco Cutugno
Overview of the EVALITA 2018 Spoken Utterances Guiding Chef’s Assistant Robots (SUGAR) TaskPart II. Participant reports
Andrea Cimino, Lorenzo De Mattei et Felice Dell’Orletta
Multi-task Learning in Deep Neural Networks at EVALITA 2018- 1 Description of the System
- 1.1 Lexical Resources
- 1.1.1 Automatically Generated Sentiment Polarity Lexicons for Social Media
- 1.1.2 Automatically translated Sentiment Polarity Lexicons
- 1.1.3 Word Embedding Lexicons
- 1.2 The Classifier
- 1.2.1 The SVM classifier
- 1.2.2 The Deep Neural Network classifier
- 2 Results and Discussion
- 2.1 ABSITA
- 2.2 GxG
- 2.3 HaSpeeDe
- 2.4 IronITA
- 3 Conclusions
- Acknowledgments
Rodolfo Delmonte
ItVENSES - A Symbolic System for Aspect-Based Sentiment AnalysisEmanuele Di Rosa et Alberto Durante
Aspect-based Sentiment Analysis: X2Check at ABSITA 2018Mauro Bennici et Xileny Seijas Portocarrero
Ensemble of LSTMs for EVALITA 2018 Aspect-based Sentiment Analysis task (ABSITA)Jacob Anderson
Fully Convolutional Networks for Text Classification- 1 Introduction
- 2 Model Description
- 2.1 Hardware Limitations
- 2.2 Residual Block
- 2.3 Dilated Convolution
- 2.4 Residual Dilated Convolution
- 2.5 Skip Connections
- 2.6 Attention and Self-Attention
- 2.7 Simplified and Local Attention
- 2.8 Multi-Head Attention
- 2.9 Model Modifications for Attention
- 2.10 Global Max Pooling
- 3 Experiment and Results
- 3.1 ITAmoji Task
- 3.2 Results
- 4 Discussion
- 4.1 Loss of Information While Pooling
- 4.2 Potential Uses of Simplified and Local Attention
- 5 Conclusion
Daniele Di Sarli, Claudio Gallicchio et Alessio Micheli
ITAmoji 2018: Emoji Prediction via Tree Echo State NetworksLucia Siciliani et Daniela Girardi
The UNIBA System at the EVALITA 2018 Italian Emoji Prediction TaskAndrei Catalin Coman, Yaroslav Nechaev et Giacomo Zara
Predicting Emoji Exploiting Multimodal Data: FBK Participation in ITAmoji TaskMauro Bennici et Xileny Seijas Portocarrero
The validity of word vectors over the time for the EVALITA 2018 Emoji prediction task (ITAmoji)Andrea Santilli, Danilo Croce et Roberto Basili
A Kernel-based Approach for Irony and Sarcasm Detection in ItalianPierpaolo Basile et Giovanni Semeraro
UNIBA - Integrating distributional semantics features in a supervised approach for detecting irony in Italian tweetsEmanuele Di Rosa et Alberto Durante
Irony detection in tweets: X2Check at Ironita 2018Valentino Giudice
Aspie96 at IronITA (EVALITA 2018): Irony Detection in Italian Tweets with Character-Level Convolutional RNNReynier Ortega-Bueno et José E. Medina Pagola
UO_IRO: Linguistic informed deep-learning model for irony detectionAngelo Basile, Gareth Dwyer et Chiara Rubagotti
CapetownMilanoTirana for GxG at Evalita2018. Simple n-gram based models perform well for gender prediction. Sometimes.Danilo Croce et Roberto Basili
A Markovian Kernel-based Approach for itaLIan Speech acT labEliNgElena Shushkevich et John Cardiff
Misogyny Detection and Classification in English Tweets: The Experience of the ITT TeamSimona Frenda, Bilal Ghanem, Estefanía Guzmán-Falcón et al.
Automatic Expansion of Lexicons for Multilingual Misogyny DetectionResham Ahluwalia, Himani Soni, Edward Callow et al.
Detecting Hate Speech Against Women in English TweetsEndang Wahyu Pamungkas, Alessandra Teresa Cignarella, Valerio Basile et al.
Automatic Identification of Misogyny in English and Italian Tweets at EVALITA 2018 with a Multilingual Hate LexiconAngelo Basile et Chiara Rubagotti
CrotoneMilano for AMI at Evalita2018. A performant, cross-lingual misogyny detection system.Davide Buscaldi
Tweetaneuse @ AMI EVALITA2018: Character-based Models for the Automatic Misogyny Identification TaskPaula Fortuna, Ilaria Bonavita et Sérgio Nunes
Merging datasets for hate speech classification in Italian- 1 Introduction
- 2 Related Work
- 3 Methodology
- 3.1 Data
- 3.2 Text pre-processing
- 3.3 Feature extraction and classification
- 3.3.1 Word embedding
- 3.3.2 Deep Learning
- 4 Tasks and runs description
- 5 Results and Discussion
- 5.1 Results for Tuning and Validation
- 5.2 Contest Results
- 6 Conclusion
- Acknowledgments
Marco Polignano et Pierpaolo Basile
HanSEL: Italian Hate Speech detection through Ensemble Learning and Deep Neural NetworksMichele Corazza, Stefano Menini, Pinar Arslan et al.
Comparing Different Supervised Approaches to Hate Speech Detection- 1 Introduction
- 2 System Description
- 2.1 Preprocessing
- 2.2 Feature Description
- 2.3 Recurrent Neural Network Model
- 2.4 Ngram-based Neural Networks
- 2.5 Linear SVC System
- 3 Submitted Runs and Results
- 3.1 Task 1: HaSpeeDe-FB
- 3.2 Task 2: HaSpeeDe-TW
- 3.3 Task 3.1: Cross-HaSpeeDe_FB
- 3.4 Task 3.2: Cross-HaSpeeDe_TW
- 4 Error Analysis and Discussion
- 5 Conclusions
- Acknowledgments
Gretel Liz De la Peña Sarracén, Reynaldo Gil Pons, Carlos Enrique Muñiz Cuza et al.
Hate Speech Detection using Attention-based LSTMValentino Santucci, Stefania Spina, Alfredo Milani et al.
Detecting Hate Speech for Italian Language in Social MediaXiaoyu Bai, Flavio Merenda, Claudia Zaghi et al.
RuG @ EVALITA 2018: Hate Speech Detection In Italian Social MediaGiulio Bianchini, Lorenzo Ferri et Tommaso Giorni
Text analysis for hate speech detection in Italian messages on Twitter and FacebookFederico Sangati, Antonio Pascucci et Johanna Monti
Exploiting Multiword Expressions to solve “La Ghigliottina”Luca Squadrone
Computer challenges guillotine: how an artificial player can solve a complex language TV game with web data analysisSimone Magnolini, Vevake Balaraman, Marco Guerini et al.
The Perfect Recipe: Add SUGAR, Add Data