ISA-16 (@LREC 2020)
ISA-15 (Gothenburg, 2019)
ISA-14 (Santa Fe (NM), 2018)
ISA-13 (Montpellier, 2017)
ISA-12 (Portoroz, 2016)
ISA-11 (London, 2015)
ISA-10 (Reykjavik, 2014)
ISA-9 (Potsdam, 2013)
ISA-8 (Pisa, 2012)
ISA-7 (Istanbul, 2012)
ISA-6 (Oxford, 2011)
ISA-5 (Hong Kong, 2010)
ISA-4 (Tilburg, 2009)
ISA-3 (Marina del Rey, 2008)
ISA-2 (Tilburg, 2007)
ISA-1 (Tilburg, 2005)
Welcome to ISA-16, the Sixteenth Workshop on Interoperable Semantic Annotation, is the most recent edition of a series of joint workshops of the ACL Special Interest Group on Computational Semantics (SIGSEM) and ISO TC 37/SC 4 (Language Resources) WG 2: Semantic annotation.
These workshops bring together experts in the annotation of semantic information as expressed in text, speech, gestures, graphics, video, images, and in multiple modalities combined. Examples of semantic annotation include the markup of events, time, space, dialogue acts, discourse relations, semantic roles, reference relations, and quantification for which the ISO organization pursues the establishment of annotation standards, in order to support the creation of interoperable semantic resources.
|Harry Bunt||Annotation of Quantification: The Current State of ISO 24617-12|
|Pranav Goel, Suhan Prabhu, Alok Debnath, Priyank Modi and Manish Shrivastava||Hindi TimeBank: An ISO-TimeML Annotated Reference Corpus|
|Lars Hellan||Interoperable Semantic Annotation|
|Alexander Henlein, Giuseppe Abrami, Attila Kett and Alexander Mehler||Transfer of ISOSpace into a 3D Environment for Annotations and Applications|
|Kiyong Lee||Annotation-based Semantics|
|Constanza Marini and Elisabetta Jezek||Annotating Croatian Semantic Type Coercions in CROATPAS|
|Johanna Melly, Gabriel Luthier and Andrei Popescu-Belis||A Consolidated Dataset for Knowledge-based Question Generation using Predicate Mapping of Linked Data|
|Massimo Moneglia and Rossella Varvara||The Annotation of Thematic Structure and Alternations face to the Semantic Variation of Action Verbs, Current Trends in the IMAGACT Ontology|
|Volha Petukhova and Harry Bunt||Adapting the ISO 24617-2 Dialogue Act Annotation Scheme for Modelling Medical Consultations|
|Suhan Prabhu, Ujwal Narayan, Alok Debnath, Sumukh S and Manish Shrivastava||Detection and Annotation of Events in Kannada|
|John Roberto and Brian Davies||Towards the Ontologization of the Outsider Art Domain: Position Paper|
|Svetlana Sheremetyeva||Towards Creating Interoperable Resources for Conceptual Annotation of Multilingual Domain Corpora|
Besides a main track, ISA-16 features two specialised tracks, focused on:
These topics relate to a recently started project on developing an ISO annotation standard for quantification (ISO/WD 24617-12, 'QuantML'), and a proposal for developing an ISO standard for the representation of visual information ('VoxML'), respectively.
Both specialised tracks consist of a pre-conference on-line portion and an on-site portion during the ISA-16 workshop on Tuesday, May 12. For the pre-conference on-line portion participants are invited to submit their commented annotations and representations for a batch of example items that are provided with documentation and guidelines of the envisaged annotation and representation schemes.
Due to the cancellation (or possibly, postponement) of the ISA-16 workshop as a physical meeting, the two specialised tracks have remained dormant. They will be kissed alive in the next installment of the ISA workshop series, expected in 2021.
The general topics of the two tracks (quantification and vizualization) are also topics for submissions to the main track of the workshop, which furthermore include, but are not limited to:
Issues in the annotation of aspects and forms of quantification in natural language are t be discussed, with the aim to establish a good basis for developing an interoperable annotation scheme that would ideally fit into the ISO Semantic Annotation Framework (ISO 24617). The document Semantic Annotation of Quantification in Natural Language (TiCC Technical Report 2020-2) describes the current state of developing such an annotation scheme, including the markup language QuantML. Previous publications from preliminary studies are:
In the pre-conference, on-line part, track participants are invited to test, comment on, ciriticise, praise, compare, improve, the annotations that can be made with the current version of the QuantML scheme, making use of the short list of test sentences made available here, and consider how to annotate them. The aim is to identify strenghts and weaknesses of the current scheme, to signal problematic issues, and to make comparisons to recent representations of quantification and scope. Note any specific issues that emerge in the annotation process and in comparisons, that would be good to be discussed in the on-site part of the workshop. Questions to consider include at least the following:
Please send your commented annotations and observations and any other relevant considerations that occur to you (in any readable form) to the track coordinator Harry Bunt (email@example.com) please before March 20. We will take it interactively from there in preparation of the on-site part of the workshop.
For the pre-conference on-line work, we supply a batch of images of objects and people participating in activities and events follow this link to the homepage for the VoxML/Voxicon simulation and reasoning platform. Here you find a collection of images to be annotated, using a vocabulary of objects, attributes, actions, and relations. Annotators are asked to use these to create an annotation of the image, as exhaustively as possible. Accompanying the collection of images you also find guidelines for how annotation should be performed, using an annotation template, and submitted. For any questions please contact the track coordinator James Pustejovsky (firstname.lastname@example.org).
Background document: the LREC 2016 paper VoxML: A Visualization Modeling Language by James Pustejovsky and Nikhil Krishnaswamy.
For both tracks, annotators should attempt to follow the guidelines and stay within the provided vocabulary where possible, but are permitted to go outside if required. In this case, we ask that they submit a brief summary of and justification for their additions.
We will provide feedback on submitted annotations. Deadline for submissions is March 20. We will select certain annotation submissions for spotlight presentations. These are to be given during the on-site portion of the workshop and will focus on the results of the annotation exercise. This will be followed by a discussion of the entire annotation effort, lessons learned (problems, gaps, suitability of results for ML, automated generation, etc), and the adequacy and expressiveness of the representation language.
|Submission Link||The ISA-16 submission site|
|Submission Format||A PDF formatted based on the LREC Author's Kit|
The ISA-16 workshop is hosted by the LREC 2020 conference and is held at the conference center Le Palais du Pharo in Marseille.
|1st March, 2020||Deadline for submitting papers|
|18th March, 2020||Notification of Acceptance|
|20th March, 2020||Submission of commented annotations for Quantification or Visualization track|
|1st April, 2020||Submission of Camera Ready Papers|
|12th May, 2020|