Shared Tasks in the Digital Humanities

Phase 1: Systematic Analysis of Narrative Texts through Annotation (SANTA)

Blog

  • Phase 1
    16th June 2018

    A first look at the submitted guidelines.

  • Phase 1
    6th June 2018

    This post provides information about the submission of the guidelines.

  • Phase 1
    23rd May 2018

    This article details how we plan to evaluate/compare annotation guidelines during the workshop. The evaluation will be structured along of three dimensions: i) Relation of guidelines and theory, ii) applicability, and iii) usefulness. To guide the workshop discussion(s) and to explicate the dimensions more clearly, we created a brief questionnaire.

  • Phase 1
    23rd May 2018

    Updated: Workshop dates, evaluation procedure. We would like to invite you to participate in the 1st Shared Task on Narrative Level Annotation. It is an adaptation of the shared task-format established in the field of Computational Linguistics and Informatics to the field of Literary Studies. The goal of the first phase of this (two-phased) shared task is the collaborative creation of annotation guidelines, which in turn will serve as a basis for the second phase, an automatisation-oriented shared task.

  • Phase 1
    6th October 2017

    We would like to invite you to participate in the 1st Shared Task on Narrative Level Annotation. It is an adaptation of the shared task-format established in the field of Computational Linguistics and Informatics to the field of Literary Studies. The goal of the first phase of this (two-phased) shared task is the collaborative creation of annotation guidelines, which in turn will serve as a basis for the second phase, an automatisation-oriented shared task.

  • Phase 1
    1st October 2017

    This article describes where to start and how to proceed when developing annotation guidelines. It focuses on the scenario when you’re creating new guidelines for a phenomenon that has been described mostly theoretically.

  • Phase 1
    17th July 2017

    This post details how we envision the first phase of the shared task on systematic analysis of narrative texts through annotation (SANTA) concretely. We hope this gives potential participants a clearer picture of what is expected of them and how long it would take.

  • 15th June 2017

    We have now set up a mailing list. The list serves both as a simple registration tool as well as for communication with the organizers and discussions among the participants. The list is hosted at Stuttgart University.

    Please visit listserv.uni-stuttgart.de/mailman/listinfo/sharedtasksinthedh to register.

  • 31st March 2017

    The lack of systematic annotation for literary concepts is major roadblock for large-scale studies of literature. We propose to conduct a series of workshops inspired by shared tasks in NLP to foster the development of annotation guidelines for certain literary concepts. This in turn enables systematic annotation and development of automatisation options.

  • 1st November 2016

    This text has been accepted for the next Digital Humanities Conference, to be presented as a short talk in Montreal 2017. We have put it online here as a reference point for discussion and information.