Jet Hoek


2024

pdf bib
Subjectivity Theory vs. Speaker Intuitions: Explaining the Results of a Subjectivity Regressor Trained on Native Speaker Judgements
Elena Savinova | Jet Hoek
Proceedings of the 14th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis

In this paper, we address the issue of explainability in a transformer-based subjectivity regressor trained on native English speakers’ judgements. The main goal of this work is to test how the regressor’s predictions, and therefore native speakers’ intuitions, relate to theoretical accounts of subjectivity. We approach this goal using two methods: a top-down manual selection of theoretically defined subjectivity features and a bottom-up extraction of top subjective and objective features using the LIME explanation method. The explainability of the subjectivity regressor is evaluated on a British news dataset containing sentences taken from social media news posts and from articles on the websites of the same news outlets. Both methods provide converging evidence that theoretically defined subjectivity features, such as emoji, evaluative adjectives, exclamations, questions, intensifiers, and first person pronouns, are prominent predictors of subjectivity scores. Thus, our findings show that the predictions of the regressor, and therefore native speakers’ perceptions of subjectivity, align with subjectivity theory. However, an additional comparison of the effects of different subjectivity features in author text and the text of cited sources reveals that the distinction between author and source subjectivity might not be as salient for naïve speakers as it is in the theory.

2021

pdf bib
Is there less annotator agreement when the discourse relation is underspecified?
Jet Hoek | Merel C.J. Scholman | Ted J.M. Sanders
Proceedings of the First Workshop on Integrating Perspectives on Discourse Annotation

pdf bib
Combined discourse representations: Coherence relations and questions under Discussion
Arndt Riester | Amalia Canes Nápoles | Jet Hoek
Proceedings of the First Workshop on Integrating Perspectives on Discourse Annotation

2019

pdf bib
Proceedings of the 13th Linguistic Annotation Workshop
Annemarie Friedrich | Deniz Zeyrek | Jet Hoek
Proceedings of the 13th Linguistic Annotation Workshop

2017

pdf bib
Evaluating discourse annotation: Some recent insights and new approaches
Jet Hoek | Merel Scholman
Proceedings of the 13th Joint ISO-ACL Workshop on Interoperable Semantic Annotation (ISA-13)

2015

pdf bib
Factors Influencing the Implicitation of Discourse Relations across Languages
Jet Hoek | Sandrine Zufferey
Proceedings of the 11th Joint ACL-ISO Workshop on Interoperable Semantic Annotation (ISA-11)

pdf bib
The Role of Expectedness in the Implicitation and Explicitation of Discourse Relations
Jet Hoek | Jacqueline Evers-Vermeul | Ted J.M. Sanders
Proceedings of the Second Workshop on Discourse in Machine Translation