= !BluePrint: CAP Broker = [[TOC]] [[Image(http://eden.sahanafoundation.org/raw-attachment/wiki/BluePrint/CAPBroker/CAPsymbol.png)]][[BR]] [wiki:Deployments/SAMBRO Sahana Alerting and Messaging Broker] (SAMBRO) uses the the CAP Broker.[[BR]] [wiki:UserGuidelines/SAMBRO User Guide (SAMBRO Manual)][[BR]] [wiki:BluePrint/CAPBroker/Alerthub Alerthub blueprint] a one-stop-shop for your trusted and classified alerts == Introduction == [http://en.wikipedia.org/wiki/Common_Alerting_Protocol Common Alerting Protocol] defines a data format for sharing alerts (and re-relaying) over various media channels. This project aims to implement core CAP features into Eden and provide usable UI elements for managing CAP alerts.The module will facilitate the publishing and relaying of alerts and warning as well as offer subscribers means to receive warnings and alerts of their choice. Moreover, the module will provide a common operating picture of the published alerts for improving situational-awareness (e.g. [http://gdacs.org/alerts/ GDACS common operating picture with message filtering]). The tools are mainly for National Disaster Management Organizations for managing [http://lirneasia.net/2012/05/masas-iscram-2012/ Multi-agency Situational-awareness] with capabilities for all-hazard all-media warning/alerting.[[BR]].[[BR]] The self-contained product, coming out of the developments, will be coined as the CAP-enabled Sahana Alerting and Messaging Broker (abbreviated as "SAMBRO"). One aspect of SAMBRO is give implementers the option to subscribe to available CAP feeds such as the [http://wcatwc.arh.noaa.gov/ National Oceanic and Atmospheric Administration's National Tsunami Warning Centre] CAPXML feeds [https://inatews.bmkg.go.id/rss/capatomlast40event.xml International Tsunami Warning System in Indonesia] with their CAP-Atom feeds, or the [http://gdacs.org/resources.aspx?eventid=122640&episodeid=122656&eventtype=EQ Global Disaster Alert and Coordination System] (GDACS) individual alert CAP files. Thereby, serving in capacity of an aggregator to present those CAP messages in the common operating picture based on spatial and temporal dimensions. Authorized SAMBRO user can choose to amend those CAP messages, received through the feeds, to relay them to the subscribers registered in the SAMBRO. [[BR]].[[BR]] SAMBRO subscribers could be human or other systems (e.g [http://alert-hub.appspot.com Google's Alerthub] or [http://preparecenter.org/activities/universal-app-program IFRC's hazard app]). SAMRBO message publishers would be provided with functionality to manage reusable CAP message template and issue CAP messages over multiple channels such as HTTP posts, RSS/Atom feeds, SMS, Email, Twitter, Facebook, so on and so forth. The CAP standard also requires that implementers define a CAP-Profile. These are typically considered as CAP Country Profiles. Therefore, the module will feature those components for managing those implementation specific profiles. == Description == === User stories:=== ==== Filtered Alert Hub ==== Making use of the Global CAP Data feeds to find trends and other probabilistic events of interest in the data streams for informing climate change and disaster planning. a. [https://sites.google.com/sahanafoundation.org/sambro Wireframe fore Homepage] ==== CAP Profile ==== A Country develops their Country '''CAP Profile''' and intend to implement the profile along with the rules a. Authorized super-user (or implementer) starts to edit the profile a. define the format of the message "identifier" a. define the hazard event specific areaDescription template and geographic boundaries a. define the mandatory set of languages that all messages should be in a. define the hazard and areaDescription template specific roles and permissions ==== CAP Message Template ==== A warning agency authorized to issue alerts for a specific hazard event wants to '''create CAP message templates''' a. Authorized user will create a new template a. The CAP Profile will determine the rules for validating the template such as forcing the implementer to generate a "info" segment for each language a. Implementer can choose to either allow the message issuer to change the template value for a certain attribute or lock that field with a fixed value a. Implementer would provide the required text with placeholders set for message issuers to complete with actual event specific values a. The template is saved and assigned permissions, for which only authorized users with those permissions can select the specific template when issuing a message ==== Issue CAP message ==== A warning agency learns of an imminent hazard event (e.g. cyclone) and wants to '''issue a CAP message''' to warn the targeted public at risk: a. Authorized user chooses to create a new message a. If presented to select a template (e.g. Cyclone template) a. Completes the missing information specific to the event such as event, headline, onset, description, instructions, effective, areaDesc, etc a. Repeat the "info" segment of the message for each language, as specified by the profile a. Attach a "resource" file a. Saves the message as an "actual" alert with a scope set to "Public" a. Chooses to broadcast the message through the cellular networks, share with all TV/Radio stations ==== Approve and Reject CAP Alert ==== a. Authenticated User creates the CAP Alert a. This CAP Alert needs approval from people assigned with alert_approval role a. The alert_approval people are emailed and SMS about the approval with the link a. alert_approval people open the link, login and are presented with "Approve Alert" and "Reject Alert" button at the top (rheader) along with the data that needs to be approved a. CAP Alert are approved or rejected via approve/reject method a. The approval alert provides the audit of who approved the message and when it was approved, while the reject deletes the CAP Alert a. If approve/reject has not been performed within the required time, then the email/SMS should go out again, repeating until it is resolved ==== SOP Check List ==== First-responders (special group of subscribers or message recipients) entrusted with carrying our various Standard Operating Procedures (SOPs) would have a guide in the form of a check-list. The SOP check-list is for the Central Authority to receive feedback from the ground troops (first-responders) on the status of the alert/warning instigated activities a. The implementers would generate an Event Type specific SOP check-lists and save then in the database a. Those check-lists are then assigned to various administrator generated subscriber groups a. When a message is issued and the subscriber group is selected, the URL to the check-list is sent as a to the recipients a. The recipients, then execute their SOPs and frequently update the status of the check-list a. The Central Authority would generate reports that would monitor the progress of the check-list ==== Turn on Siren Towers ==== A warning agency learns of a tsunami warning and wants to '''activate a system with a CAP message''' (e.g. siren towers) a. Similar to the previous instance, the authorized user would create a message a. Set the "parameter" values to trigger the sirens a. Select the areaDescription to determine the targeted siren towers a. Choose the delivery method as "siren system" and send the message ==== View common operating picture ==== A emergency management agency wants to view the current situation or get an overall picture of all the current alerts for '''situational-awareness''' a. Authorized user enters SAMBRO a. Typically, upon entry, they are presented with the "common operating picture" or they navigate to it a. The user may choose to filter the map of alerts by various CAP elements such as "category", "priority", or "areaDescription" a. The user may choose to filter the map of alert for a specific time interval a. The user would click on a alert icon on the map to view the short description with essential information such as the "headline" and "priority" a. The user may choose to further investigate the alert message by clicking more to view the full message a. Authorized user may choose to update that message and save it with the most current information ==== Area descriptions ==== There are three ways a use may define the alerting or warning area a. Free text areaDesc only - the user simply writes the a description for an area (e.g. Cox's Bazar Coastal area Bangladesh), which is not precise and contains a level of ambiguity as to how far from the sea, is it 30m, 50m, or 100m but gives a general sense. a. Predefined areaDesc text only - we may create a database for country with names of all administrative jurisdictions, like towns, cities, villages, districts, provinces, states, etc. These names would also be related to an administrative category (e.g. District={Colombo, Kalutara, Kandy}, City = {Colombo 01, Colombo 02, Kandy, Kalutara}, ...). We would first give the option for the user to filter the categories; e.g. they may chose District. Thereafter, they are presented with an autofill ajax type text box to start typing the name of the District, as in this example, and to select the name from the suggested list. Multiple names are separated by a comma. a. Polygon or Circe only - the user may chose to either define a polygon or a circle. In either case they would provide lat/lon pairs to define the shape. a. areaDesc and Polygon/Circle - the user may decide to provide an are description as in (a) and a series of lat/lon pairs to define the geographical shape of the area mentioned in the areaDesc a. Predefined areaDesc - Similar to (b) but combining with (c), a feature introduced for the ease-of-use. Based on a risk assessment exercise, the users will develop predefined alert area polygons. These polygons will be categorized by the eventType, Incident, Administrative jurisdictions and associated with an area description. During the time of creating a message, when a user defines the eventType, that would trigger for filtering the relevant list of predefine polygons. Additionally, the user may continue to filter by selecting the District and a provide a District name to further filter the predefined polygons. Thereafter, they would select the relevant areaDesc from the present list. Upon selection the polygon or circle shape lat/lon pairs would be automatically populated. Sahana Agasti has a CAP broker implementation but is currently deprecated == Requirements == '''TODO - redo this subsystem diagram in tune with Eden'''[[br]] [[Image(http://eden.sahanafoundation.org/raw-attachment/wiki/BluePrint/CAPBroker/alert%20subsystems.jpeg)]] ==== Functional: ==== * CAP Profiles and CAP Templates: Data model and user interface assisting easy and correct implementation of CAP profiles and create/edit of CAP templates * CAP Editing: Data model and user interface for creation of CAP alerts compliant with the EDXL-CAP 1.2 standard.([http://eden.sahanafoundation.org/ticket/1423 see this ticket on templates]) * CAP subscriber: data model and GUIs to manage intended users and groups when disseminating alerts via the available delivery methods * SMS - Short Message Service - restricted to 140 characters per page; possibly restrict it to 1 SMS page with link to the full CAP message (e.g. URL); using s3msg module * Email ; using s3msg module * Cell-broadcast * TV * Radio (audio) * FTP - File Transfer Protocol - to transfer CAP files or text extracted from a CAP file to a specified/authorized FTP site and folder * [http://waidyanatha.blogspot.com/2009/10/sahana-hf-data-platform-for-alert-and.html HF radio data platform]: uses Pactor modems and HF radios for exchanging data and images ==== Interoperability: ==== * CAP Broadcasting: Use XSL and XSLT to generate text suitable for distribution. Generate broadcast events, broadcast media can be added by hooking up to these events generated in the system: tap in to s3msg module * CAP Reception: Expose a PuSH end point and allow Eden instances to subscribe to each other. Handling cancellation and update alerts gracefully. * Import and Export facility for CAP and CAP Profiles: Enable importing of CAP Alerts from XML files with CAP Alert elements. Allow Exporting. Use the Survey module as a reference here. Also these should be implemented inside the s3export module. ==== Visualization ==== * Basic requirement is displaying CAP messages on a Map * The effective area of the CAP message is typically bounded and shaded by a polygon * Offer search and filter functions to drill in to the maps * time-series widgets for viewing time-series activities in a given time window * map zoom and filter widgets for animating activities over time * Built in parser to strip a CAP message to unbundle the elements * Preferred CAP RSS/Atom feeds for receiving he CAP XML file == Use-Cases == '''We have summarized the use case in this section and provided an [http://eden.sahanafoundation.org/wiki/BluePrint/CAPBroker#Publisher-Subscriber abstract level diagram]. Developers are encourage to follow the links given in the column: Use-case in the table below to find a more detailed use-case discussion.''' === Actors and Use-case === ||=Actor =||= Use-case ||= Description =|| ||CAP profile implementer || Implement CAP profile || CAP Profile defines a class of CAP alerts which may provide a structure to the CAP alert and speed up the creation of CAP Alerts and templates, for example a Profile may specify a region, a set of languages and generic templates in each language. This can be used during CAP alert creation for centering the map for example and for fast creation of alert messages || ||CAP template implementer || Implements CAP templates || CAP templates are Abstract CAP alerts with blanks that need to can be filled really fast in case of an imminent disaster to produce a CAP alert, for example a Tsunami CAP template might be of help in a coastal area, hence an implementer will create the same || ||CAP message editor || Send a CAP alert || a message editor can pick a CAP template and fill the blanks in it to send out a CAP alert (user story in description) || ||CAP alert subscriber || Subscribes to CAP Alerts || when a CAP alert is created and the subscriber is in the audience, a notification will be issued via modes prescribed by the subscriber || || || [http://eden.sahanafoundation.org/wiki/BluePrint/CAPBroker/UseCases#AcknowledgeMessage Acknowledge message receipt] || A subset of the subscribers known as administrator generated subscriber list comprises first-responder groups. They are required to acknowledge the receipt of a alert message || || || [http://eden.sahanafoundation.org/wiki/BluePrint/CAPBroker/UseCases#ReportSOPStatus Report SOP Status] || The same set of first-responders might be required to follow a SOP and report to the central authority of the outcomes || [[br]][[br]] === Roles === SAMBRO module would have the following roles: || ||'''Actor'''|| || ||'''Role'''||'''Implementer'''||'''Author & Issuer'''||'''Authorizer'''||'''Subscriber'''||'''Description'''|| ||Anonymous || || || || ||Can view only scope=public Alert|| ||Authenticated || X || || || X ||Authenticated user who can subscribe to RSS/SMS/Email|| ||Map Admin|| X || || || ||Allowed access to edit the Map Service Catalogue|| ||Alert Editor||X|| X || || ||Can create CAP Message and disseminate the Message after authorization from CAP Authorizer|| ||Alert Approver || X || X || X || ||Besides Authorizing Message to disseminate, they can also act as CAP Editor|| ||Admin|| X || || || ||CAP module Admin and Key role for implementing. Implementing includes Administering Organizations, Setting Incident/ Event lookup values, defining Warning Priorities, Generating Message Templates, Editing the Register of Alerting Authorities, Manage users both Authors and Subscribers, test the system from a alerting/warning/situational-awareness context|| === Publisher-Subscriber === [[Image(http://eden.sahanafoundation.org/raw-attachment/wiki/BluePrint/CAPBroker/use_case_pub_sub_alert.png)]] == Design == * The Models: The table definitions go are in modules/s3db/cap.py. Place some functions which will help in the creation, sending and receiving of CAP XML files in s3msg module where it might best fit. * A detailed description of the data model is here: https://docs.google.com/spreadsheet/ccc?key=0AiLVG3CYfknsdGljMXNQejNWSURnVHZYYnMySERzdHc * The Eden modules and their dependencies are explained here: ['''Tharindu - insert URL to doc'''] * [wiki:BluePrint/CAPBroker/GUIDesign The GUI design page][[BR]] * index: A map and a table of alerts sortable by the various fields of an alert. Clicking on a row on the table centers the map to the associated with the alert. * profiles: * index: View a listing of templates (We should ship some country-specific profiles by default in Eden since this is recommended) * edit & create: Editing / creating a profile. This should allow for specification of constraints for each field of the cap message. * templates: * index: View a listing of all templates grouped by their pertinent profiles. * edit & create: Allow users to create templates: This will allow for creating multiple elements with placeholders for canned inputs such as [AREA] [SEVERITY] etc.which will then be substituted to produce text consumable via various media like SMS and IVR * create alert: A map with ability for easy input of polygons and circles, A drop-down for picking profiles and templates to use. A way to specify recipients for restricted alerts. * Reference and mockups: http://eden.sahanafoundation.org/ticket/1026 * Security Requirements: * Registration * Disable self registration; only authorized administrator should create an account and grant permissions to access. * Registration request form should be made available and the request should be emailed to the administrator upon submission. === Process Flow === [[Image(http://eden.sahanafoundation.org/raw-attachment/wiki/BluePrint/CAPBroker/issue_alert_process_flow_diagram.png)]] [[br]] ||= Process/Entity ||= Description || || Alert publisher || authorized to author alerts || || Create or Edit alert || || === Eden Modules === ==== SAMBRO SCHEMA ==== [[Image(https://imgur.com/RH8RGJg.png)]] ==== MANDATORY MODULE ==== || '''Module Name''' || '''Module Key''' || '''Description''' || || Home || default || Root page with the index.html that is initially called by the application and display the home page to the user with login controls (more) || || Administrator || admin || When login as administrator the home page presents all administrative functions for the administrator to carry out the respective functions (more) || || || appAdmin || Similar to the Admin module but provides additional features relevant to the specific application such as with handling database related administrative functions (more) || || Ticket viewer || errors || required during development cycle; errors are shown only when login as administrator (more) || || Translation Functionality || translate || core module for application localization (more) || || Synchronization || sync || To manage the synchronization of multiple users working on the same features (more) || || Support || support || Help page, can be disabled but essential for providing help features (more) || || Map || gis || definitely required for spatially presenting information (more) || || Person Registry || pr || mainly used for managing users with privileges and roles with respect to accessing and operating CAP functions (more) || || Organization || org || required for managing all organizations/institutions (more) || ==== SAMRBO SPECIFIC MODULES ==== || '''Module Name''' || '''Module Key''' || '''Description (more)''' || || CAP || cap || essential for enabling CAP-enabled messaging (more) || || Messaging || msg || to send and receive SMS, Email, Twitter related CAP messages (more) || || Events || event || required for defining CAP events; (more) || '''INSERT DATA MODEL IMAGE''' == Implementations == * [GSoC 2012 project wiki:Event/2012/GSoC/CAPBroker] * [http://eden.sahanafoundation.org/wiki/Deployments/SAMBRO SAMBRO deployments]: * [http://eden.sahanafoundation.org/wiki/BluePrint/CAPBroker/Maldives Maldives Blueprint] * [http://eden.sahanafoundation.org/wiki/BluePrint/CAPBroker/Myanmar Myanmar Blueprint] * [http://eden.sahanafoundation.org/wiki/BluePrint/CAPBroker/Philippines Philippines Blueprint] * [http://eden.sahanafoundation.org/wiki/BluePrint/CAPBroker/Nepal Nepal Blueprint] == References == '''CAP'''[[br]] 1. [http://eden.sahanafoundation.org/wiki/BluePrint/CAPMobileApp SAMBRO CAP-enabled Mobile App Blueprint][[BR]] 1. [http://docs.oasis-open.org/emergency/cap/v1.2/CAP-v1.2-os.html CAP 1.2 Specification][[BR]] 1. [http://docs.oasis-open.org/emergency-adopt/cap-feeds/v1.0/cap-feeds-v1.0.html Example Practices: CAP Feeds Version 1.0] [[BR]] 1. [http://alert-hub.appspot.com/ Google Alerthub] [[BR]] 1. [http://eden.sahanafoundation.org/wiki/UserGuidelines/Alerts SAMBRO User Guidelines] [[BR]] 1. [http://www.pdc.org/ Pacific Disaster Center] a. [http://www.pdc.org/news-n-media/pdc-updates/InAWARE-System-Boosts-Disaster-Risk-Reduction-in-Indonesia/ Inaware for DRR] project in Indonesia 1. [http://eden.sahanafoundation.org/raw-attachment/wiki/BluePrint/CAPBroker/UniversalApp_Dissemination_Specs.pdf UniversalApp dissemination specification logic] developed for the IFRC Preparecenter. 1. [https://whatnow.preparecenter.org/ Red Cross Preparecenter - WhatNow App] 1. [http://wcatwc.arh.noaa.gov/?page=cap NOAA Tsunami Warning Center] [[BR]] '''GIS'''[[br]] 1. GIS data manipulation [https://docs.google.com/presentation/d/1fp_HTiOEkbJB0vwku6Q1nITpNyk9EC-SsjOOeCJgWjw/edit#slide=id.p14 Doc 1] and [https://docs.google.com/presentation/d/1OJ65Sz4sHh5k4cs0PVmpM00SkMeSBqoVJQpz7bGHgA8/edit?usp=drive_web Doc 2][[BR]] '''Eden'''[[br]] 1. [http://eden.sahanafoundation.org/wiki/S3/Notifications S3 Subscriptions and Notifications][[BR]] 1. [http://eden.sahanafoundation.org/wiki/S3/Notifications#MessageTemplates Message Template][[BR]] '''Other'''[[br]] 1. [http://www.dutchwatersector.com/solutions/products/10-floodreadyq-smartphone-app.html Flood warning and mapping mobile app] - FloodReadyQ Smartphone App Prototype Development for Community Dissemination of Flood Warning and Flood Mapping Information[[BR]] == Notes == Common Alerting Protocol: ''Originating CAP alerts is one need, receiving them and using them to actuate alerting systems, be they SMS drivers or sirens or whatever is another. Another is a message broker that can interoperate with the commercial boxes. Authentication systems are also a factor, especially where cross-jurisdictional reciprocity is required'' ''Ideally the CAP XML should be signed end-to-end, especially in a federated system where there's more than one authority running servers/aggregators. Our current implementations sign the alerts at the originating server, so they're at least traceable to the source server but not necessarily the individual operator. Current servers check integrity when they get a message from another server, but there isn't a regional PKI.'' * http://docs.oasis-open.org/emergency/cap/v1.2/CAP-v1.2.html * Use an XSLT * Subset of EDXL-DE: http://docs.oasis-open.org/emergency/edxl-de/v1.0/EDXL-DE_Spec_v1.0.pdf * Use another XSLT * http://code.google.com/p/pyedxl/source/browse/trunk/edxl/edxl.py * http://edxlsharp.codeplex.com * SQL schema: http://wiki.sahanafoundation.org/doku.php/wiki:user:edxl_discussion#proposed_sahana_edxl-de_database_implementation * http://talksahana.com/2009/03/04/firefox-browser-cap-alerting-plugin-sahana-idea-for-gsoc2009/ * Sahana CAP/EDXL Broker specification - http://lirneasia.net/wp-content/uploads/2009/05/Sahana-CAP-Msg-Mod-v0.2.pdf ==== Wireframe (ported to eden) ==== * The wireframe built using Python and Eden frameworks.[[https://github.com/flavour/eden | The code is here]]. Anyone can use this as the basis to continue the CAP Broker developments. * [[http://eden.sahanafoundation.org/ticket/1026 | This ticket]] contains some of the screen shots and initial GUI layouts with some descriptions. ---- -[http://eden.sahanafoundation.org/wiki/BluePrint/CAPBroker/GUIDesign CAP Broker GUI Design][[BR]] == Current Status == [https://docs.google.com/spreadsheets/d/1N9xUqZQhignq7QM_7CtrV4zv86sq4lMdJj81IQuch3Y/edit?usp=sharing Fit-Gap analysis spreadsheet] ==== Available features: ==== 1. built on the Emergency Data Exchange Language (EDXL) Common Alerting Protocol (CAP) version 1.2 '''[1]''' 1. manage templates, manage messages [[BR]] 1. manage CAP cutomizations (multiple languages, identifier format, etc) in ../cap/000_config.py file 1. support multiple language CAP message publication 1. receive CAP feeds '''[2]''' to serve as an aggregator and a pubhub 1. approve or reject a CAP message prior to dissemination 1. delivery options: HTTP, RSS/Atom, SMS, Email, FTP (dynamic labels) 1. visualize CAP feeds on a map ("common operating picture") 1. Use GIS-based risk assessment techniques to develop predefined (hazard, event, and severity specific) CAP alert area templates\1. delivery options: HTTP, RSS/Atom, SMS, Email, Voice-text (audio) 1. subscription management (who, what, when, and where) serve as a subhub 1. Mobile application to server as a publisher and a subscriber ==== Missing features: ==== 1. Feed in to Google Alerthub '''[3]''' and [http://preparecenter.org/activities/universal-app-program IFRC Universal Hazard App] 1. digitally sign the messages 1. [http://eden.sahanafoundation.org/wiki/BluePrint/Pictographs Pictographs for Alerting] 1. Event specific SOP check list 1. Tagging alerts of interest - authorized users could bookmark or tag alerts of interest. The UI (desktop or mobile app) should prioritize such information in the presentation layers.