Shared Tasks in the Digital Humanities

Phase 1: Systematic Analysis of Narrative Texts through Annotation (SANTA)

Posts about Phase 1 (SANTA)

  • Phase 1
    16th June 2018

    A first look at the submitted guidelines.

  • Phase 1
    6th June 2018

    This post provides information about the submission of the guidelines.

  • Phase 1
    23rd May 2018

    This article details how we plan to evaluate/compare annotation guidelines during the workshop. The evaluation will be structured along of three dimensions: i) Relation of guidelines and theory, ii) applicability, and iii) usefulness. To guide the workshop discussion(s) and to explicate the dimensions more clearly, we created a brief questionnaire.

  • Phase 1
    23rd May 2018

    Updated: Workshop dates, evaluation procedure. We would like to invite you to participate in the 1st Shared Task on Narrative Level Annotation. It is an adaptation of the shared task-format established in the field of Computational Linguistics and Informatics to the field of Literary Studies. The goal of the first phase of this (two-phased) shared task is the collaborative creation of annotation guidelines, which in turn will serve as a basis for the second phase, an automatisation-oriented shared task.

  • Phase 1
    6th October 2017

    We would like to invite you to participate in the 1st Shared Task on Narrative Level Annotation. It is an adaptation of the shared task-format established in the field of Computational Linguistics and Informatics to the field of Literary Studies. The goal of the first phase of this (two-phased) shared task is the collaborative creation of annotation guidelines, which in turn will serve as a basis for the second phase, an automatisation-oriented shared task.

  • Phase 1
    1st October 2017

    This article describes where to start and how to proceed when developing annotation guidelines. It focuses on the scenario when you’re creating new guidelines for a phenomenon that has been described mostly theoretically.

  • Phase 1
    17th July 2017

    This post details how we envision the first phase of the shared task on systematic analysis of narrative texts through annotation (SANTA) concretely. We hope this gives potential participants a clearer picture of what is expected of them and how long it would take.