In addition, you can add separately each of the modules described above (z.B. artifactId dkpro-statistics-agreement). In this article, we present a new Java implementation of several mea-sures of inter-rated agreements that we make available as open source software. In addition to assessing the reliability of coding tasks with S, pi, b, α, etc., we particularly support the compilation of tasks by measuring the limitations of note units identified as compliance. We offer a unique interface and data model for both tasks as well as several diagnostic devices for results analysis. 1 @MISC Meyer_dkproagreement:, author – “Christian M. Meyer and Margot Mieskes and Christian Stab and Iryna Gurevych, title – “DKPro Agreement: An Open-Source Java Library for Measuring Inter-Rater Agreement,” jahr – “Inter-rater agreement dkpro agreement dkpro agreement open-source java library open-source software open-source software multiple diagnostic device data model identified annotation unit multiple inter-rater agreement mea-sures novel java implementation unified interface Please cite our COLING 2014 paper if you use the software in your scientific work. Prior to their deployment as open source software, DKPro Statistics was a research project at the Ubiquitous Knowledge Processing Laboratory (UKP) at the Technical University of Darmstadt. The following people have mainly contributed to this project (in alphabetical order): DKPro Statistics is available in open source under the Apache 2.0 (ASL) license. The software is therefore “as expected” without any guarantee (see the text of the license for more details).
A more detailed description of DKPro Statistics can be found in our scientific articles: Christian M. Meyer, Margot Mieskes, Christian Stab and Iryna Gurevych: DKPro Agreement: An Open-Source Java Library for Measuring Inter-Rater Agreement, in: Proceedings of the 25th International Conference on Computational Linguistics (COLING), p. 105-109, August 2014. Dublin, Ireland. (Download) The latest version of DKPro Statistics is available via Maven Central. If you use Maven as a compilation tool, you can add DKPro statistics as an addiction to your pom.xml file.