Changes between Version 7 and Version 8 of Deployments/SAMBRO/Evaluation
- Timestamp:
- 06/18/16 09:29:05 (9 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Deployments/SAMBRO/Evaluation
v7 v8 53 53 The two types of users will be subject to scenario driven simulation and tabletop exercises. 54 54 1. Publishers - will be presented with various scenarios and they will act on those scenarios by executing an appropriate alerting cycle (i.e. alert, update, clear). 55 1 ,Subscribers (specifically First-Responders) - will be presented with alert messages, taking them through a complete cycle, to determine their response.55 1. Subscribers (specifically First-Responders) - will be presented with alert messages, taking them through a complete cycle, to determine their response. 56 56 57 57 These exercises '''DO NOT INVOLVE THE PUBLIC'''. … … 61 61 [[br]] 62 62 We will install the CAM Studio screen capture software to record the user Interaction Techniques. The screen capture software will capture the behaviour of the user and the sequence of executing each process. This will also provide the Evaluators with insights of the Usability and the Operational Efficiency of the system. The alert messages saved in SAMBRO will be used to determine the data quality as well as Email and SMS received by the Subscribers will determine the Data Quality. 63 [[br]] 64 Observers, namely members of the project team, will be provided assessment guidelines to evaluate the Publishers and Subscribers during the controlled-exercises. The Observer will report details on the operational usability, timeliness, and any other noteworthy observations. 65 66 ==== Subjective Evaluation ==== 67 The subjective evaluation will be carried out at the end of the controlled-exercises to give the users the opportunity to express their opinion on the adoption of the system. It is follows the Technology Acceptance Model (TAM) and the HCI-based Gulf of Execution / Evaluation methodologies. These insights will evaluate the utility of the system. 68 [[br]] 69 For the TAM evaluation, the users will be given a structured questionnaire which they will provide answers to. The questionnaire is anonymized to allow for the user to provide an unbiased opinion. The users are provided with a section in the TTX guideline to provide feedback on the Gulf of Execution / Evaluation, which would indicate their ability to achieve the goal, intents, and actions using the system. 63 70 === Goal Oriented HCI === 64 71 There are two elements to the Goal Oriented HCI:
