Changes between Version 2 and Version 3 of Deployments/SAMBRO/Evaluation
- Timestamp:
- 06/14/16 00:59:53 (9 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Deployments/SAMBRO/Evaluation
v2 v3 11 11 12 12 We have broken the SAMBRO Early Warning System (EMS) dissemination subsystem activities into two components; namely Publishers and Subscribers. Publishers are essentially authorized alerting organizations who would originate or relay a warning/alert message. Both Publishers and Subscribers will undergo a series of tests to determine their aptitude to: 13 publish effective CAP-enabled messages14 Subscribe to actionable (or inactionable) CAP-enabled alert/warning messages15 operationalize a cross-agency situational-awareness platform13 * publish effective CAP-enabled messages 14 * Subscribe to actionable (or inactionable) CAP-enabled alert/warning messages 15 * operationalize a cross-agency situational-awareness platform 16 16 17 17 We are applying two Human Computer Interaction (HCI) evaluation methodologies: 18 18 Technology Acceptance Model (TAM) 19 Goal Oriented HCI20 Technology Acceptance Model (TAM)19 * Goal Oriented HCI 20 * Technology Acceptance Model (TAM) 21 21 TAM provides insights on the ease of use and usability of the technology presented to the users. This applies to both Publishers and Subscribers. This is a subjective analysis of the intervention. 22 Goal Oriented HCI 22 23 === Goal Oriented HCI === 23 24 There are two elements to the Goal Oriented HCI: 24 Objectively analyze the functional transition25 Subjectively analyze the functional transition25 * Objectively analyze the functional transition 26 * Subjectively analyze the functional transition 26 27 27 Screen Capture 28 === Screen Capture === 28 29 We will install a screen capture software. The screen capture software will capture the behaviour of the user and the sequence of executing each process. This will provide the evaluators with insights of the ease of use and usability of the system. It may relate to the level or training and expectation of the user’s aptitude. 29 30 Focus Group Discussion 31 32 == Tools == 33 Several survey instruments and evaluation guidelines 34 35 === For Observers === 36 1. [Observe Alerting Authorities publishing CAP messages 37 38 === For Publishers === 39 1. 40 41 === for Subscribers === 42 1. [https://docs.google.com/document/d/138u2Ci3VwKbCwc1KvmGwNlu6fgOSpAMfM1eBOxDOc0o/edit?usp=sharing Perception of SAMBRO using TAM] 43 1. [ 30 44 == References == 31 45 * [https://www.mindtools.com/pages/article/kirkpatrick.htm Kirk Patrick's Four Level Training Evaluation]