Drama annotation

Drama annotation is the process of annotating the metadata of a drama. Given a drama expressed in some medium (text, video, audio, etc.), the process of metadata annotation identifies what are the elements that characterize the drama and annotates such elements in some metadata format. For example, in the sentence "Laertes and Polonius warn Ophelia to stay away from Hamlet." from the text Hamlet, the word "Laertes", which refers to a drama element, namely a character, will be annotated as "Char", taken from some set of metadata. This article addresses the drama annotation projects, with the sets of metadata and annotations proposed in the scientific literature, based markup languages and ontologies.

Drama across media and genres

Drama encompasses different media and languages, ranging from Greek tragedy and musical drama to action movies and video games: despite their huge differences, these examples share traits of the cultural construct that we recognise as drama. drama can be considered as a form of intangible cultural heritage, since it is characterised by an evolving nature, with form and function that change in time:[1] for example, consider the difference between the Greek Tragedy Oedipus and the modernist play Six Characters in Search of an Author. The exponential spread of drama in contemporary culture has led Martin Esslin to forge the definition of “dramatic media", i.e. media that display characters performing live actions, such as theatre, cinema and videogames.

The discrete manifestations of drama are documented in different media, including text, score, video, audio, etc. The dramatic content underlying these manifestation, however, does not depend on the specific medium: take, for example, the Arden edition of the written drama of Hamlet [2] and Laurence Olivier's movie Hamlet, two examples of the drama heritage which share the same drama content despite the differences of the media support. The annotation of the content of media that convey dramatic content requires the use of an annotation schema expressed in a formal language, which makes the annotation comparable, and, possibly, machine readable.

The first attempts at attaching content metadata to media concerned text documents and were carried out by using markup languages, such as XML, which allow to embed content tags into the document text. With the advent of the Semantic Web project,[3] descriptive tools have evolved towards the use of ontologies, thanks to the languages and resources provided by the Semantic Web project. In particular, semantic annotation relies on the use of the Resource Description Framework language, specifically designed to described Web contents of any type.

The semantic annotation of drama consists of representing the knowledge about drama in a machine-readable format to serve the task of annotating the dramatic content coherently across different media and languages, abstracting at the same time from the technicalities of signals and text encoding. The annotation of dramatic content across media and genres is a way to preserve, compare and study the nature of drama and of its manifestations. Moreover, the availability of content metadata about drama is a precondition for a range of generative tasks that range from automatising the generation of drama to supporting human creativity in this task.

Story and Drama Annotation through markup languages and linguistic schemata

Story annotation consists of annotating the content of narratives. In most cases, this effort is undertaken with the goal of constructing corpora of annotated narratives, or story corpora, finalised at the study of the relationship between the linguistic expression of the story in the narrative and its content. In the last decade, to a number of research initiatives especially oriented to the description of story and characters. For example, consider the Narrative Knowledge Representation Language (NKRL)[4] and the DramaBank project,[5] specifically oriented to the representation of story content in natural language texts.

The annotation of narrative texts has been prompted and influenced by two main lines of research. On the one side, the tradition of knowledge representation in AI has contributed the conceptual tools for describing the content of stories, with languages that span from scripts[6] [Schank 1975] to frames.[7] The linguistic counterpart of this line of research has resulted in resources situated at the lexical-semantic level (such as FrameNet[8] and at the interface between syntax and semantics (such as PropBank, which offer tools for representing the connection between the expression of the narrative through the text and the narrative content itself). For example, the Story Workbench tool[9] encompasses a layered annotation scheme, which uses these resources for the multi-layer annotation of narratives. On the other side, the annotation of narratives has benefited from the trend, established during the last three decades,[10] of representing the content of documents in a machine-readable form. With the advent of markup languages such as Text Encoding Initiative (TEI) for encoding text in digital form and annotating their structure, the use of markup has soon become the standard in text annotation projects.

In particular, projects such as Narrative Knowledge Representation Language (NKRL)[11] leveraged the use of markup languages for the representation of the narrative content of text, revamping the use of frames into the emerging scenario of media indexing and retrieval. More recently, as part of the more general effort of constructing resources for the automation of language processing and generation, Elson has proposed a template based language for describing the narrative content of text documents, with the goal of creating a corpus of annotated narrative texts, called DramaBank project.[12] In recent years, the annotation of narrative text has evolved towards minimal schemata targeted at grasping the regularities of written and oral narratives at the discourse level.[13] These initiatives, however, rooted in narrative theories, tend to focus on the realization of narratives though a specific medium, i.e., text, leaving behind the universal elements of dramatic narration that go behind the expressive characteristics of each medium.

Story and drama annotation through computational ontologies

Mostly oriented to the indexing and retrieval of media, ontologies and vocabularies have appeared that support the representation of the content of media according to a shared semantics, available across the Web. In particular, semantic resources such as VERL (the Video Event Representation Language[14] and LODE (Linked Open Description of Events)[15] provide structured description of events that can be applied to the description of incidents in stories. In the paradigm of Linked Data, these resources become the infrastructure for content-based applications in the field of media: for example, consider the project EventMedia,[16] where different vocabularies have been aligned with automatic methods to create an illustrated catalog of media representing events.

A media-independent model of story is provided by the OntoMedia ontology, exploited across different projects (such as the Contextus Project[17] to annotate the narrative content of different media objects, ranging from written literature to comics and TV fiction. This project encompasses some concepts, such the notion of character, that are relevant for the description of drama, but, being mainly focused on the representation of events and the order in which they are exposed in media for cross-media comparison, it lacks the capability of representing the core notions of drama. In the field of cultural heritage dissemination, the StorySpace ontology,[18] an ontology of story, supports museum curators in linking the content of artworks through stories, with the ultimate goal of enabling the generation of user tailored content retrieval.[19]

A line of research has tackled the use of logical representations to describe stories, with the goal of creating generative systems that leverage the axiomatization of narrative structures.[20] Finally, some scholars have created representational tools for specific narrative theories, ranging from literary structuralism[21] to scriptwriting practices[22]

Drammar[23] is an ontology of drama, specifically conceived to annotate dramatic media.[24] Drammar aims at extending the use of ontologies to describe the content metadata of dramatic media in a theory-neutral, media-independent way. The use of the ontology format not only allows specifying the conceptual model of drama in a formal, unambiguous way but also makes the knowledge about drama available as a vocabulary for the interchange of annotations across different projects and readily usable for applications that encompass the manipulation of annotations by automatic reasoners and other software types[25]

References

  1. ↑ Lombardo, Vincenzo; Pizzo, Antonio; Damiano, Rossana (1 February 2016). "Safeguarding and Accessing Drama As Intangible Cultural Heritage". J. Comput. Cult. Herit. 9 (1): 5:1–5:26. ISSN 1556-4673. doi:10.1145/2812814.
  2. ↑ Shakespeare, William; edited by Harold Jenkins (1997). Hamlet (Repr. by Nelson. ed.). Walton-on-Thames: Thomas Nelson. ISBN 0174434693.
  3. ↑ Berners-Lee, Tim; Hendler, James; Lassila, Ora (1 January 2001). "The Semantic Web". The Scientific American.
  4. ↑ ZARRI, GIAN PIERO (September 1997). "NKRL, a knowledge representation tool for encoding the ‘meaning’ of complex narrative texts". Natural Language Engineering. 3 (2): 231–253. doi:10.1017/S1351324997001794.
  5. ↑ http://lrec.elra.info/proceedings/lrec2012/pdf/866_Paper.pdf
  6. ↑ Schank, Roger C.; Abelson, Robert P. (1 January 1975). "Scripts, Plans, and Knowledge". Proceedings of the 4th International Joint Conference on Artificial Intelligence - Volume 1. Morgan Kaufmann Publishers Inc.: 151–157.
  7. ↑ Minsky, Marvin (1 January 1975). "Minsky's Frame System Theory". Proceedings of the 1975 Workshop on Theoretical Issues in Natural Language Processing. Association for Computational Linguistics: 104–116. doi:10.3115/980190.980222.
  8. ↑ Baker, Collin F.; Fillmore, Charles J.; Lowe, John B. (1 January 1998). "The Berkeley FrameNet Project". Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics - Volume 1. Association for Computational Linguistics: 86–90. doi:10.3115/980845.980860.
  9. ↑ http://aaai.org/ocs/index.php/AIIDE/AIIDE11WS/paper/view/4091
  10. ↑ Coombs, James H.; Renear, Allen H.; DeRose, Steven J. (1 November 1987). "Markup Systems and the Future of Scholarly Text Processing". Commun. ACM. 30 (11): 933–947. ISSN 0001-0782. doi:10.1145/32206.32209.
  11. ↑ ZARRI, GIAN PIERO (September 1997). "NKRL, a knowledge representation tool for encoding the ‘meaning’ of complex narrative texts". Natural Language Engineering. 3 (2): 231–253. doi:10.1017/S1351324997001794.
  12. ↑ http://lrec.elra.info/proceedings/lrec2012/pdf/866_Paper.pdf
  13. ↑ Rahimtoroghi, Elahe; Corcoran, Thomas; Swanson, Reid; Walker, Marilyn A.; Sagae, Kenji; Gordon, Andrew (23 October 2014). "Minimal Narrative Annotation Schemes and Their Applications".
  14. ↑ Francois, A.R.J.; Nevatia, R.; Hobbs, J.; Bolles, R.C. (October 2005). "VERL: An Ontology Framework for Representing and Annotating Video Events". IEEE Multimedia. 12 (4): 76–86. doi:10.1109/MMUL.2005.87.
  15. ↑ Shaw, Ryan; Troncy, Raphaël; Hardman, Lynda (6 December 2009). "LODE: Linking Open Descriptions of Events". The Semantic Web. Springer Berlin Heidelberg: 153–167. doi:10.1007/978-3-642-10871-6_11.
  16. ↑ Khrouf, Houda; Troncy, Raphael (2016). "EventMedia: a LOD Dataset of Events Illustrated with Media | www.semantic-web-journal.net". Semantic Web Journal. 7 (2).
  17. ↑ http://www.contextus.net
  18. ↑ Wolff, Annika; Mulholland, Paul; Collins, Trevor (1 January 2012). "Storyspace: A Story-driven Approach for Creating Museum Narratives". Proceedings of the 23rd ACM Conference on Hypertext and Social Media. ACM: 89–98. doi:10.1145/2309996.2310012.
  19. ↑ Mulholland, P.; Collins, T. (1 September 2002). "Using digital narratives to support the collaborative learning and exploration of cultural heritage". 13th International Workshop on Database and Expert Systems Applications, 2002. Proceedings: 527–531. doi:10.1109/DEXA.2002.1045951.
  20. ↑ Martens, Chris; Bosser, Anne-Gwenn; Ferreira, João F.; Cavazza, Marc (15 September 2013). "Linear Logic Programming for Narrative Generation". Logic Programming and Nonmonotonic Reasoning. Springer Berlin Heidelberg: 427–432. doi:10.1007/978-3-642-40564-8_42.
  21. ↑ Peinado, Federico; Gervás, Pablo; Díaz-Agudo, Belén (2004). "A description logic ontology for fairy tale generation". LREC Workshop on Language Resources for Linguistic Creativity. 4: 56–61.
  22. ↑ Szilas, Nicolas (11 February 2016). "Modeling and Representing Dramatic Situations as Paradoxical Structures". Digital Scholarship in the Humanities: fqv071. ISSN 2055-7671. doi:10.1093/llc/fqv071.
  23. ↑ https://www.di.unito.it/wikidrammar wiki
  24. ↑ Lombardo, Vincenzo; Pizzo, Antonio (27 June 2014). "Multimedia tool suite for the visualization of drama heritage metadata". Multimedia Tools and Applications. 75 (7): 3901–3932. doi:10.1007/s11042-014-2066-3.
  25. ↑ Lombardo, Vincenzo; Battaglino, Cristina; Pizzo, Antonio; Damiano, Rossana; Lieto, Antonio (2015). "Coupling conceptual modeling and rules for the annotation of dramatic media | www.semantic-web-journal.net". Semantic Web Journal. 6 (5): 503–534.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.