We are happy to announce a new shared task on Understanding Figurative Language as part of the Figurative Language Workshop (FigLang 2022) at EMNLP 2022
. In recent years, there have been several benchmarks dedicated to figurative language understanding, which generally frame "understanding" as a recognizing textual entailment task -- deciding whether one sentence (premise) entails/contradicts another (hypothesis)(Chakrabarty et al 2021
, Stowe et al 2022
). We introduce a new shared task for figurative language understanding around this textual entailment paradigm, where the hypothesis is a sentence containing the figurative language expression (e.g., metaphor, sarcasm, idiom, simile) and the premise is a literal sentence containing the literal meaning. There are two important aspects of this task and the associated dataset: 1) the task requires not only to generate the label (entail/contradict) but also to generate a plausible explanation for the prediction; 2) the entail/contradict label and the exploration are related to the meaning of the figurative language expression.
For instance given a Premise:
He utterly decimated
his tribe's most deeply held beliefs. Hypothesis:
the knowledge or beliefs of his tribe.
we need an output that consists of a
= Absorbed typically means to take in or take up something, while "utterly decimated" means to destroy completely.