Changes between Version 19 and Version 20 of BluePrintHumanIntelligenceTasks

Timestamp:

04/06/11 01:16:56 (14 years ago)

Author:

Pat Tressel

Comment:

--

BluePrintHumanIntelligenceTasks

@@ -163 +163 @@
 what skills they have. We'll need to add whatever fields we want for performance tracking.
 
-There are two parts to training:
- * Using the HIT system. This will be "our" part of the training.
- * Performing the specific task. This will be the responsibility of whoever defines the task.
-   But we can assist by providing sample training procedures to go with our sample tasks.
+There are several parts to training:
+ * Instruction in using the HIT system. This will be "our" part of the training.
+ * Preliminary instruction in performing the specific task, and online help info for reference
+   while performing tasks: This will be the responsibility of whoever defines the task.
+   But we can assist by providing sample training procedures to go with our sample tasks,
+   a way to direct workers to any external training, and a means of providing help info
+   via the task form.
+ * Worker practice on actual tasks: This would be built in to the task queue.
+
+(Larger-scale volunteer training is outside the scope of this project.)
 
 ==== Providing feedback ====
@@ -175 +181 @@
  * Implement the task queue. This is the "backbone" of the project.
  * Task definition seems like it could be paired naturally not just with the UI for for
-   setting up tasks, but also with generating the task presentation forms, since they're
+   setting up tasks, but also with generating the task presentation forms, since those are
    based on the task definition.
- * Performance evaluation and feedback might be paired with training, especially if we
-   use actual tasks as part of training.
+ * Performance evaluation and feedback could be paired with collating and comparing results
+   from the multiple workers assigned to each task, plus the expert evaluation of results,
+   as the result scoring feeds into performance evaluation.