Changes between Version 19 and Version 20 of BluePrintHumanIntelligenceTasks


Ignore:
Timestamp:
04/06/11 01:16:56 (11 years ago)
Author:
Pat Tressel
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • BluePrintHumanIntelligenceTasks

    v19 v20  
    163163what skills they have. We'll need to add whatever fields we want for performance tracking.
    164164
    165 There are two parts to training:
    166  * Using the HIT system. This will be "our" part of the training.
    167  * Performing the specific task. This will be the responsibility of whoever defines the task.
    168    But we can assist by providing sample training procedures to go with our sample tasks.
     165There are several parts to training:
     166 * Instruction in using the HIT system. This will be "our" part of the training.
     167 * Preliminary instruction in performing the specific task, and online help info for reference
     168   while performing tasks: This will be the responsibility of whoever defines the task.
     169   But we can assist by providing sample training procedures to go with our sample tasks,
     170   a way to direct workers to any external training, and a means of providing help info
     171   via the task form.
     172 * Worker practice on actual tasks: This would be built in to the task queue.
     173
     174(Larger-scale volunteer training is outside the scope of this project.)
    169175
    170176==== Providing feedback ====
     
    175181 * Implement the task queue. This is the "backbone" of the project.
    176182 * Task definition seems like it could be paired naturally not just with the UI for for
    177    setting up tasks, but also with generating the task presentation forms, since they're
     183   setting up tasks, but also with generating the task presentation forms, since those are
    178184   based on the task definition.
    179  * Performance evaluation and feedback might be paired with training, especially if we
    180    use actual tasks as part of training.
     185 * Performance evaluation and feedback could be paired with collating and comparing results
     186   from the multiple workers assigned to each task, plus the expert evaluation of results,
     187   as the result scoring feeds into performance evaluation.
    181188
    182189