The Seventeenth Joint ACL - ISO Workshop on Interoperable Semantic Annotation

On-line workshop @ IWCS 2021 | Groningen, Netherlands | 16 June, 13:00 - 16:00 (local time) and 17 June, 12:00 - 15:00

Previous ISA Workshops

ISA-16 (@LREC 2020)

ISA-15 (Gothenburg, 2019)

ISA-14 (Santa Fe (NM), 2018)

ISA-13 (Montpellier, 2017)

ISA-12 (Portoroz, 2016)

ISA-11 (London, 2015)

ISA-10 (Reykjavik, 2014)

ISA-9 (Potsdam, 2013)

ISA-8 (Pisa, 2012)

ISA-7 (Istanbul, 2012)

ISA-6 (Oxford, 2011)

ISA-5 (Hong Kong, 2010)

ISA-4 (Tilburg, 2009)

ISA-3 (Marina del Rey, 2008)

ISA-2 (Tilburg, 2007)

ISA-1 (Tilburg, 2005)


Welcome to ISA-17, the Seventeenth Workshop on Interoperable Semantic Annotation. This is the 2021 edition of a series of joint workshops of the ACL Special Interest Group on Computational Semantics (SIGSEM) and ISO TC 37/SC 4 (Language Resources) WG 2: Semantic annotation.

These workshops bring together experts in the annotation of semantic information as expressed in text, speech, gestures, graphics, video, images, and in multiple modalities combined. Examples of semantic annotation include the markup of events, time, space, motion, dialogue acts, discourse relations, semantic roles, coreference, and quantification phenomena, for which the ISO organization pursues the establishment of standardised annotation methods and representation schemes, to support the creation of interoperable semantic resources.

Accepted Papers

The accepted papers will be published in the ISA-17 proceedings, which will be included in the ACL Anthology.

Giuseppe Abrami, Alexander Henlein, Andy Lücking, Attila Kett, Pascal Adeberg and Alexander Mehler Unleashing annotations with TextAnnotator: Multimedia, multi-perspective document views for ubiquitous annotation
Harry Bunt The ISA-17 Quantification Challenge: Background and introduction
Rodolfo Delmonte, Serena Trolvi and Francesco Stiffoni Converting Multilayer Glosses into Semantic and Pragmatic forms with GENLIS
Tillmann Dönicke, Luisa Gödeke and Hanna Varachkina Annotating Quantified Phenomena in Complex Sentence Structures Using the Example of Generalising Statements in Literary Texts
Volha Petukhova and Hafiza Erum Manzoor Towards an ISO 24617-2-compliant Typology of Metacognitive Events
Maria da Purificação, Silvano, António Leal, Fátima Silva, Inês Cantante, Fatima Oliveira and Alípio Mario Jorge Developing a multilayer semantic annotation scheme based on ISO standards for the visualization of a newswire corpus
Ekaterina Saveleva, Volha Petukhova, Marius Mosbach and Dietrich Klakow Discourse-based Argument Segmentation and Annotation
Johan Bos Quantification Annotation in Discourse Representation Theory
(Note for special track on quantification annotation)
Mark Klement, Alexander Henlein, and Alexander Mehler VoxML Annotation Tool Re iew and Suggestions for Improvement
(Note for special track on visual informcation annotation)
Harry Bunt Observations on the use of QuantML
(Note for special track on quantification annotation)
Manolito Octaviano VoxML Standardization
(Note for special track on visual informcation annotation)
Maxime Amblard, Karen Fort, Bruno Guillaume, Philippe de Groote, Chuyuan Li, Pierre Ludmann, Michel Musiol, Siyana Pavlova, Guy Perrier, and Sylvain Pogodalla The Annotators Did Not Agree on Some of the Guidelines Examples
(Note for special track on quantification annotation)

Call For Papers

Besides a main track, ISA-17 features two specialised tracks, focused on:

  1. the annotation of quantification (and quantified modification) in natural language, and
  2. the design and representation of data structures for generating visualisations of linguistically represented objects, properties, and events.

These topics are inspired by a recently started project on developing an ISO standard for the annotation of quantification (ISO/WD 24617-12, 'QuantML'), and a proposal for developing an ISO standard for the representation of visual information ('VoxML').

Both specialised tracks consist of a pre-conference on-line portion and an on-site portion during the IWCS 2021 conference in Groningen. For the pre-conference on-line portion participants are invited to take part in a shared task, submitting their commented annotations and observations for a batch of example items that are provided with documentation and guidelines of the envisaged annotation and representation schemes.

For both tracks, annotators should attempt to follow the guidelines and stay within the provided vocabulary where possible, but are permitted to go outside if required. In this case, we ask that they summarily justify their additions and alternatives in their project note. The track organisers will provide feedback on submitted annotations, observations and analyses during the on-site portion of the workshop. This will be followed by a discussion of the entire annotation effort, lessons learned (problems, gaps, suitability of results for ML, automated generations, etc.), and the adequacy and expressiveness of the representation language.

Topics by Track

Submission information

Submission Link The ISA-17 submission site
Submission Format PDF formatted with the IWCS LaTeX style files

Types of Submission

The following types of submission are invited:
  • Research papers, describing original research in the area of semantic annotation; these can be either:
    • long (6-8 pages, with additional pages for references references), or
    • short (3-5 pages, plus references)
  • Project notes:
    • describing recent, ongoing or planned projects involving semantic annotation (2-4 pages including references);
    • discussing observations and analyses relating to the participation in the shared task of one of the specialised tracks (up to 4 pages), with accompanying annotations.


The ISA-17 workshop is hosted by the IWCS 2021 conference in Groningen.

Important Dates

5 April Submission of papers and project notes for the main track
18 April Notification of Acceptance
1 May Submissions to Quantification and Visualization tracks
7 May Submission of camera-ready material
16 June, 13:00 - 16:00 and 17 June, 12:00 - 15:00 On-line ISA-17 Workshop

For any questions contact the workshop chair, at the address

Organizing Committee

  • Harry Bunt (Chair)
  • Nancy Ide
  • Kiyong Lee
  • Volha Petukhova
  • James Pustejovsky
  • Laurent Romary
  • Ielka van der Sluis

Program Committee

  • Jan Alexandersson
  • Johan Bos
  • Harry Bunt (chair)
  • Nicoletta Calzolari
  • Jae-Woong Choe
  • Robin Cooper
  • Ludivine Crible
  • David DeVault
  • Simon Dobnik
  • Jens Edlund
  • Alex Fang
  • Robert Gaizauskas
  • Koiti Hasida
  • Nancy Ide
  • Elisabetta Jezek
  • Nikhil Krishnaswamy
  • Kiyong Lee
  • Paul Mc Kevitt
  • Adam Meyers
  • Philippe Muller
  • Rainer Osswald
  • Volha Petukhova
  • Massimo Poesio
  • Andrei Popescu-Belis
  • Laurent Prevot
  • James Pustejovsky
  • Laurent Romary
  • Ielka van der Sluis
  • Manfred Stede
  • Matthew Stone
  • Thorsten Trippel
  • Carl Vogel
  • Menno van Zaanen
  • Annie Zaenen
  • Heike Zinsmeister