Language Science Studies

Language Science Studies

Persian Discourse Treebank v2

Document Type : Research Paper

Authors
1 Assistant Professor of Linguistics, Allameh Tabatabai University, Tehran, Iran
2 PhD Candidate in Artificial Intelligence at Shahid Beheshti University, Tehran, Iran
Abstract
This research represents the second version of the Persian Discourse Treebank (PerDTB). The first version was based on nearly 30,000 individual sentences and so imposed some restrictions: the NoRel relation type in the Penn Discourse Treebank (PDTB) schema was not defined in this corpus; more than half of the sentences were simple clauses containing minimal discourse information and, more importantly, due to the use of individual sentences, the investigation of intra-sentential relations was not actually possible. So, in the second version, we collected 1,383 documents with more than half a million words, mainly crawled from news articles. They were manually annotated with morphological and syntactic labels, and we then performed discourse analysis based on the PDTB schema. Also, to enrich our data, we added NER and coreference information at the top. In discourse analysis, we explored any semantic or logical relation between sentences (inter-sentential) or between clauses inside a complex sentence (intra-sentential), resulting in the annotation of 24,502 discourse relations along with their senses, arguments, and their attributes, including type, source, scopal polarity, determinacy, and modality. To measure inter-annotator agreement, we double-annotated 229 documents with 107,653 tokens. Inter-annotator agreement was good for sense classification (κ = 0.753) and very good for Implicit, EntRel, and Clause relations (κ = 0.809).
Keywords
Subjects


Articles in Press, Accepted Manuscript
Available Online from 08 November 2026

  • Receive Date 19 August 2026
  • Revise Date 21 September 2026
  • Accept Date 08 November 2026