The Seventeenth Joint ACL - ISO Workshop on Interoperable Semantic Annotation

On-line workshop @ IWCS 2021 | Groningen, Netherlands | 16 June, 13:00 - 16:00 (local time) and 17 June, 12:00 - 15:00

Workshop proceedings available here.

Previous ISA Workshops

ISA-16 (@LREC 2020)

ISA-15 (Gothenburg, 2019)

ISA-14 (Santa Fe (NM), 2018)

ISA-13 (Montpellier, 2017)

ISA-12 (Portoroz, 2016)

ISA-11 (London, 2015)

ISA-10 (Reykjavik, 2014)

ISA-9 (Potsdam, 2013)

ISA-8 (Pisa, 2012)

ISA-7 (Istanbul, 2012)

ISA-6 (Oxford, 2011)

ISA-5 (Hong Kong, 2010)

ISA-4 (Tilburg, 2009)

ISA-3 (Marina del Rey, 2008)

ISA-2 (Tilburg, 2007)

ISA-1 (Tilburg, 2005)


Welcome to ISA-17, the Seventeenth Workshop on Interoperable Semantic Annotation. This is the 2021 edition of a series of joint workshops of the ACL Special Interest Group on Computational Semantics (SIGSEM) and ISO TC 37/SC 4 (Language Resources) WG 2: Semantic annotation.

These workshops bring together experts in the annotation of semantic information as expressed in text, speech, gestures, graphics, video, images, and in multiple modalities combined. Examples of semantic annotation include the markup of events, time, space, motion, dialogue acts, discourse relations, semantic roles, coreference, and quantification phenomena, for which the ISO organization pursues the establishment of standardised annotation methods and representation schemes, to support the creation of interoperable semantic resources.


Wednesday, June 16

13:00 Opening
Session 1: Paper presentations (1)
13:05 Purificação Silvano, António Leal, Fátima Silva, Inês Cantante, Fatima Oliveira and Alípio Mario Jorge Developing a multilayer semantic annotation scheme based on ISO standards for the visualization of a newswire corpus
13:35 Volha Petukhova and Hafiza Erum Manzoor Towards an ISO 24617-2-compliant typology of metacognitive events, presentation slides here.
14:05 Tillmann Dönicke, Luisa Gödeke and Hanna Varachkina Annotating Quantified Phenomena in Complex Sentence Structures Using the Example of Generalising Statements in Literary Texts, presentation slides here.
14:30 Session 2: Quantification Track
Harry Bunt The ISA-17 Quantification Challenge: Background and introduction, presentation slides here.
14:40 - 16:00 flash presentations and discussion
Maxime Amblard, Karen Fort, Bruno Guillaume, Philippe de Groote, Chuyuan Li, Pierre Ludmann, Michel Musiol, Siyana Pavlova, Guy Perrier, and Sylvain Pogodalla The Annotators Did Not Agree on Some of the Guidelines Examples, with accompanying annotations and specification of their authors.
Johan Bos Quantification Annotation in Discourse Representation Theory (annotations included)
Harry Bunt Observations on the use of QuantML, with accompanying annotations, presentation slides here.

Thursday, June 17

12:00 Session 3: Paper presentations (2)
12:00 Rodolfo Delmonte, Serena Trolvi and Francesco Stiffoni Converting Multilayer Glosses into Semantic and Pragmatic forms with GENLIS, presentation slides here.
12:30 Ekaterina Saveleva, Volha Petukhova, Marius Mosbach and Dietrich Klakow Discourse-based Argument Segmentation and Annotation, presentation slides here.
13:00 Giuseppe Abrami, Alexander Henlein, Andy Lücking, Attila Kett, Pascal Adeberg and Alexander Mehler Unleashing annotations with TextAnnotator: Multimedia, multi-perspective document views for ubiquitous annotation
13:30 Session 4: Visual Representation Track
James Pustejovsky and Nikhil Krishnaswamy VoxML-based shared task: Background and introduction
13:40 - 15:00 flash presentations and discussion
Mark Klement, Alexander Henlein, and Alexander Mehler VoxML Annotation Tool Review and Suggestions for Improvement
Manolito Octaviano VoxML Standardization

Call For Papers

Besides a main track, ISA-17 features two specialised tracks, focused on:

  1. the annotation of quantification (and quantified modification) in natural language, and
  2. the design and representation of data structures for generating visualisations of linguistically represented objects, properties, and events.

These topics are inspired by a recently started project on developing an ISO standard for the annotation of quantification (ISO/WD 24617-12, 'QuantML'), and a proposal for developing an ISO standard for the representation of visual information ('VoxML').

Both specialised tracks consist of a pre-conference on-line portion and an on-site portion during the IWCS 2021 conference in Groningen. For the pre-conference on-line portion participants are invited to take part in a shared task, submitting their commented annotations and observations for a batch of example items that are provided with documentation and guidelines of the envisaged annotation and representation schemes.

For both tracks, annotators should attempt to follow the guidelines and stay within the provided vocabulary where possible, but are permitted to go outside if required. In this case, we ask that they summarily justify their additions and alternatives in their project note. The track organisers will provide feedback on submitted annotations, observations and analyses during the on-site portion of the workshop. This will be followed by a discussion of the entire annotation effort, lessons learned (problems, gaps, suitability of results for ML, automated generations, etc.), and the adequacy and expressiveness of the representation language.

Topics by Track

Submission information

Submission Link The ISA-17 submission site
Submission Format PDF formatted with the IWCS LaTeX style files

Types of Submission

The following types of submission are invited:
  • Research papers, describing original research in the area of semantic annotation; these can be either:
    • long (6-8 pages, with additional pages for references references), or
    • short (3-5 pages, plus references)
  • Project notes:
    • describing recent, ongoing or planned projects involving semantic annotation (2-4 pages including references);
    • discussing observations and analyses relating to the participation in the shared task of one of the specialised tracks (up to 4 pages), with accompanying annotations.


The ISA-17 workshop is hosted by the IWCS 2021 conference in Groningen.

Important Dates

5 April Submission of papers and project notes for the main track
18 April Notification of Acceptance
1 May Submissions to Quantification and Visualization tracks
7 May Submission of camera-ready material
16 June, 13:00 - 16:00 and 17 June, 12:00 - 15:00 On-line ISA-17 Workshop

For any questions contact the workshop chair, at the address

Organizing Committee

  • Harry Bunt (Chair)
  • Nancy Ide
  • Kiyong Lee
  • Volha Petukhova
  • James Pustejovsky
  • Laurent Romary
  • Ielka van der Sluis

Program Committee

  • Jan Alexandersson
  • Johan Bos
  • Harry Bunt (chair)
  • Nicoletta Calzolari
  • Jae-Woong Choe
  • Robin Cooper
  • Ludivine Crible
  • David DeVault
  • Simon Dobnik
  • Jens Edlund
  • Alex Fang
  • Robert Gaizauskas
  • Koiti Hasida
  • Nancy Ide
  • Elisabetta Jezek
  • Nikhil Krishnaswamy
  • Kiyong Lee
  • Paul Mc Kevitt
  • Adam Meyers
  • Philippe Muller
  • Rainer Osswald
  • Volha Petukhova
  • Massimo Poesio
  • Andrei Popescu-Belis
  • Laurent Prevot
  • James Pustejovsky
  • Laurent Romary
  • Ielka van der Sluis
  • Manfred Stede
  • Matthew Stone
  • Thorsten Trippel
  • Carl Vogel
  • Menno van Zaanen
  • Annie Zaenen
  • Heike Zinsmeister