Changes between Version 39 and Version 40 of BluePrintDecisionMaking

09/23/09 18:37:13 (15 years ago)
Connie White



  • BluePrintDecisionMaking

    v39 v40  
    1 Decision Making Module
     4<h1 style="text-align: center; color: black">The Delphi Decision Maker - Version 1.0</h1>
    38 * [wiki:BluePrintDecisionMakingFunctional Functional Requirements]
    8 ----                       
    9 {{{
    10 #!html
    11 <h1 style="text-align: center; color: black">The Delphi Decision Maker - Version 1.0</h1>
    12 <h2 style="text-align: center; color: black"> Functional Specification </h2>
    13 }}}
    14 ----
    15 = Overview =
    16 The Delphi Decision Maker module helps groups create a ranked list.
    18 More specifically, it is designed to support the decision making of large groups of Crisis Management Experts.  It guides experts to generate, debate and explore alternative solutions producing an real time ranked list of alternative solutions that reflects the group's opinion at any point in time quickly. This system accounts for uncertainty.
    20 = Summary =
    21 Increasingly, extreme events demand large groups of experts distributed in both location and time to communicate, plan, and coordinate actions. When responding to extreme events, very often there are both alternative actions that might be considered and far more requests for actions than can be executed immediately. The relative desirability of each option for action could be a collaborative expression of a significant number of emergency managers and experts trying to manage the most desirable alternatives at any given time, in real time. This same decision process could be used for a number of tasks but will be designed for distributed dynamic decision making during time critical phases of extreme events. This is because our proposed system is specially designed to save time, remove ambiguities, and decrease uncertainty, major challenges described in the literature on time critical decision making during the volatile time critical phases of emergency.
    23 = Scenarios =
    25 '''Scenario 1:  Transport Canadian Project''' (real case)
    28 The problem the group wanted to address was finding a method for: Identifying and Ranking Sustainable Transport Practices in Urban Regions.  Making Decisions about Identifying, Adopting, or Implementing Sustainable Transport Practices. Below is the two page description of what the system can do and how the users can use it for their needs. 
    31 The Delphi Decision Maker is an online decision support system available to
    32 users anywhere there is WEB connectivity. It is designed to support large groups
    33 of professionals engaged in urgent, distributed, dynamic decision and option
    34 analysis activities.
    36 This process is designed to handle real-world problems, and can be used where
    37 distributed subgroups and individuals are determining the options and analyzing
    38 them to solve a complex problem or emergency. And as a further important
    39 feature of the dynamic Delphi approach, by virtue of being dynamic it provides a
    40 real-time mechanism to support continuous planning operations, whereby many
    41 individuals add intelligence and new input to the updating of plans, or deal with
    42 new products, cost overruns, and other events.
    44 The central idea behind a Delphi process is that the collective opinion of a group
    45 of professionals is more accurate and informed than their separate opinions.
    46 That is, the group approach produces “collective intelligence”, and is a means
    47 for a number of professionals to interact in such a way that: 1) They can offer a
    48 feasible and analyzed list of options from which a decision maker can select the
    49 mix that satisfies the current problem; and, 2) They can better understand why
    50 some options were less satisfactory than those chosen.
    51 A dynamic Delphi process can be used to help a group of professionals identify,
    52 evaluate and select an optimal-ranked list of options.
    54 This particular method uses voting to identify areas of agreement and
    55 disagreement. Exposing areas of disagreement informs the group where they
    56 may need to focus their discussion input. On the other hand, letting a group
    57 know that they agree on an issue informs participants in a timely manner that
    58 consensus has been reached, and directs them to concentrate their effort on the
    59 next item on the agenda. While it is always important to respect the participants’
    60 time, it is even more important to do so in this environment because of the urgent
    61 aspect that could underlie the problem under consideration.
    63 In a Delphi with heterogeneous professionals, they are asked to vote only on
    64 what they feel confident about, or wait until more information on uncertainties is
    65 provided by other experts in a field. Participants are informed of how many
    66 participants have voted on a given item, as well as the degree to which more
    67 votes are expected in the future and how that could affect the results.
    69 This Delphi process is dynamic because of the following reasons:[[BR]]
    71  * An expert can participate in any phase of the decision-making process at any time, that is,
    72      1) problem identification,
    73      2) information gathering,
    74      3) solution generation,
    75      4) evaluation.[[BR]]
    77     * This feature allows individuals to have discussions in forums where they can present information and debate issues as replies to specific options. Because the dialogue is text-based, others can read and benefit from the content.[[BR]]
    79  * An expert can participate online at any time during the day or night, given an Internet connection and web browser.[[BR]]
    81     * This feature helps professionals dedicate thoughts and ideas to the discourse as they arise after having time to think about a problem. This means they can choose a time to participate that is convenient for them. However, when some issues call for face-to-face meetings, the Dynamic Delphi approach can be used in preparation for, during, and/or after the group meeting as the meeting agenda or summary instrument.[[BR]]
    83  * There is real-time feedback of both the professionals’ individual opinions and of the group’s opinion.[[BR]]
    85  * Experts can vote, change their votes or withhold their votes for some reason.[[BR]]
    87     * The merits of the situation can change, or new information can sway opinions. Either way, the vote mimics the real-time opinion of the expert and, hence, the group.[[BR]]
    89  * Not all members of the group have to interact in order for a decision process to continue.[[BR]]
    91     * There may be cases where some of the participants cannot be present, or they may feel they do not have the expertise to engage in a specific option.[[BR]]
    93  * Uncertainty as to the status of the current vote (How final are the votes?) is calculated, and produced as feedback to the participants.[[BR]]
    95  * The system requests individual comparisons of options for preferences, and converts this rank-order information to an interval scale where distance represents the degree of preference between options.[[BR]]
    97 This method has been modified to handle incomplete data with respect to participation in voting.
    99 As an example for this Transport Canada project, a mission to examine options
    100 for implementing sustainable transport practices could entail the need for
    101 professionals in 20 to 30 different professional fields, including expertise
    102 regarding insurance and liability matters which restrict or prohibit using privatelyowned
    103 vehicles for collective uses such as car-pooling, ride-sharing, etc.
    105 When it comes to taking options and discussing them on arelative basis in order to havethe information to choose which options should go
    106 forward to implementation, the dynamic Delphi will be the most useful way to
    107 involve a large, heterogeneous group necessary to uncover all the potential
    108 bottlenecks and concerns that must be addressed and reconciled.
    110 = Non Goals =
    112 This version 1.0 will not support the following features:
    114  * users to create and pose problems.[[BR]]
    116  * users outside the voting group to pose solutions- [[BR]]
    117     * i.e. various permissions to handle all the roles of the users.
    119  * This version will not be integrated with Sahana, this will be accomplished in version 2.0.   
    121 = Definitions =
    123  Version 1.0 :: will be used to refer to the first build of the system.  This is testing how all of the functionality play together and tests to see if, together this improves group decision making ability in an online asynchronous environment. This is what's due in October.
    125  Subject :: will be used synonymously with Users and Experts.  This system is created for Experts who are Users of the system.  Users will be Subjects in the study that will be conducted on Version 1.0.
    127  List :: a list is a problem that is created by someone with this permission.  This is not required for Phase I due Oct.  Only one discussion will be going on and this is presented to a User group who will all have the same permissions.
    129  Item :: an item is a solution offered to a problem (List).  Users need to be able to add an Item to the List in Phase I.
    131 = User Stories =
    133 '''Pilot Problem on Version 1.0''' -- Faculty, staff and students are going to conduct a threat assessment for their campus.  These users can interact anytime and from anywhere there is an Internet connection and a browser.  The user can:
    136 1.Propose a new option to consider that is added to a List.[[BR]]
    138 2.Comment on any option proposed in a discussion forum - plain text, Linear-Blog, comments should be editable (for 30 minutes after creation or something like that) [[BR]]
    140 3.Vote on a relative comparison of any two options, all options should be available from which to choose on one screen.  will provide screenshot idea of interface solution. Once subgroup is selected, then each item needs to be compared with the other items as paired comparisons.  (can force Usersto complete all available pairs so that the calculation is easier)[[BR]]
    142 4.View the votes to find both disagreements and agreements using the scale[[BR]]
    144 5.Change their votes. no need to maintain individual old vote.  but a 'quality control check' needs to be run to test for any cyclic triad where A is selected over B, B is selected over C, and C is selected over A. error message to User asking them to correct. [[BR]]
    146 6.View a linear interval scale for the options based upon current votes as calculated from the Unit Normal Table.[[BR]]
    148 7.View a modified interval scale based upon the missing votes for any options showing the degree of uncertainty in the relative position of an item in the scale resulting from those that have already voted.One scale showing worst case scenario (lower boundary) and another scale showing best case (upper boundary).  [[BR]]
    150 So, three scales are required for Phase I: [[BR]]
    151  1) present calculation based on those who have voted[[BR]]
    152  2) scale of best case scenario (calculation in technical requirements)[[BR]]
    153  3) scale of vote giving worst case scenario of non-voting members
    156  * Calculation for vote/revote (their first initial vote is kept, present vote, then a new vote (which is compared to the present vote and updated))
    158  * Each item is voted upon with paired comparisons which produces a frequency count which is turned into a percentage number which is matched up with the corresponding number on a Unit Normal Table which finally produces a rank.
    159  * A calculation for uncertainty is done: everyone who can vote - those who did
    161 So there are three scales:
    162  * one from the calculation from Thurstone (of which code is available for the unit normal conversion table)which takes many individual votes and calculates one group opinion.
    163  * one with this, but including uncertainty (those who didn't vote) showing the best case outcome (if all votes go in favor of that item).
    164  * and then the third shows the opposing side (uncertainty) where the items will stand on a vote given they receive no more votes.
    166 = Delphi Decision Maker Flowchart =
    168 I will put this in once the internal problem is fixed. trac will not allow me to do anymore attachments.
    170 = Screen by Screen Specification =
    172 '''Design'''[[BR]]
    174 ----
    175 The following diagram shows how it's important for functionalities to be available with as few 'clicks' as possible. this saves time and gets experts to the information they need as quickly as possible. This shows the 5 primary functionalities required of the system [[BR]][[BR]]
    176 [[BR]]
    178 [[Image(dm3.jpg)]]
    179 ----
    181 '''The Primary Interface Design mimics that of Web2Py ''' - this design can be better seen on the original Research Proposal. link provided under 'background documentation below.  Figure 10.6 Screenshot of Integrated Functionality.  [[BR]]
    182 -/(+) means that each list below can be expanded or contracted.[[BR]]
    184 This layout corresponds with the design above.
    185 ----
    189 [[Image(homeUI.jpg)]]
    191 ----
    192 '''Item Selection for Users Interface Idea'''[[BR]]
    193 [[Image(ItemSelectionUI.jpg)]]
    198 '''This next screen shows how paired comparisons can be presented to the user. This can be checkboxes or just something that indicates that one of the pairs has been selected over the other.'''
    200 -------------------------------------------------------------------------------------------------------------------------
    201    '''The Decision Making System'''                     
    202 [[Image(pairCompUI.jpg)]]
    204 --------------------------------------------------------------------------------------------------------------
    206 '''Scales Visualized for Feedback'''
    208 This is the way I'd like to see the scales for feedback (3) - This is how Thurstone presented them. However, the lines drawn out to the right which bring out other dimensions is NOT required.  This is just to demonstrate that other dimensions can be brought out from the results which could provide further insight. This is for a human to do though.
    210 [[Image(dm5.jpg)]]
    212 = Background Reading =
    214 A Dynamic Delphi Process Utilizing a Modified Thurstone Scaling Method: Collaborative Judgment in Emergency Response
    215  *
    217 The Formal Research Proposal
    218  *
    220 Need to request access:
    221  *
    223 ----
    224 BluePrints