Metadata-Version: 2.1
Name: crowdtruth
Version: 2.0a1
Summary: Disagreement based metrics for the processing and evaluation of crowdsourced annotations
Home-page: http://crowdtruth.org
Author: Vrije Universiteit Amsterdam
Author-email: crowdwatson@gmail.com
License: Apache 2.0
Download-URL: https://github.com/CrowdTruth/CrowdTruth-core/archive/v2.0-alpha.1.tar.gz
Keywords: CrowdTruth,crowdsourcing,disagreement,metrics,crowdflower,amazon mechanical turk
Platform: UNKNOWN
Requires-Dist: pymodm (>=0.3.0)
Requires-Dist: pandas

CrowdTruth is an approach to machine-human computing for collecting annotation data on text, images and videos. The approach is focussed specifically on collecting gold standard data for training and evaluation of cognitive computing systems. The original framework was inspired by the IBM Watson project for providing improved (multi-perspective) gold standard (medical) text annotation data for the training and evaluation of various IBM Watson components, such as Medical Relation Extraction, Medical Factor Extraction and Question-Answer passage alignment.


