Message Parsing

Personal Details

Name: Ashwyn Sharma

Email: ​ashwyn1092@gmail.com

Freenode IRC Nickname: ashwyn

Skype: ashwyn sharma

Age: 19

Education: Currently pursuing B.E.(Bachelor in Engineering) from N.S.I.T, New Delhi.

Country: India

Timezone: GMT +0530

Github Branch: ​https://github.com/ashwyn/eden

Project Abstract

The essential requirement for this project is to parse inbound messages, with an initial focus to SMS. The project is specifically aimed at the CERT usecase where they wish to process responses to deployment notifications. Or in other words, to handle replies to deployment requests. Currently the message parsing is done in the core code i.e. modules/s3/s3msg.py, to be particular, in the parse_message() method. The parsing rules will be defined in private/templates/default/parser.py which allows for hosting of multiple profile options in the main code. This also enforces the on-going work in the development of the Profile Layer, in which deployment-specific files are separated from core code.The parsing module utilizes a data model "msg_workflow” to link the source and the workflow to schedule tasks. Processing of OpenGeoSMS encoded messages is also an important area to work on especially for the existing Android Client, for which it will be of real use. Also to provide robustness and extend the existing code, the pyparsing Parser module can be incorporated or any other parsing generator; which will be subjective to the parsing needs.

==Timeline == First Trimester:

Due Date	SMART Goal	Measure	Status
(24th April - 7th May)	1.Design of the workflow handling mechanism. 2.process_log() method is defined. 3.Tweaks in msg_log datamodel.	1.Community bonding period. 2.Decision to outline the template.	Completed
(8th May – 21st May)	1.The msg_workflow data model is developed. 2.S3ParsingModel starts to take shape.	Code committed locally.	Completed
28th May -*(won’t be available due to university exams )
4th June	1.Parsing Rules moved to private/templates/default/parser.py. 2.Scheduler logic for parsing workflows is developed.	SMS response processing starts to take shape.	Completed
11th June	1.API designed to link source-->workflow 2.Bug fixing in fetch_inbound_email() 3.parse_import() replaces process_log()	1.Code committed locally. 2.Tested on local system.	Completed
17th June	1.Scheduler logic moved to s3msg.py form zzz_1st_run.py. 2.deployment_setting.parser.parser_enabled defined.	Code committed to trunk.	Completed
2nd July	1.Message Parsing UI designed. 2.UI for Email settings. 3.deployment_setting.parser.template defined and parser_enabled removed. 4.Data model msg_workflow redefined.	Code committed to trunk.	Completed
8th July	1.Integration of the IRS module for incident reporting through SMS.	1.Commits so far tested thoroughly. 2.Bug fixing. 3.Code committed to trunk.[Mid-Term evaluations :-) ]	In Progress
15th July	1.Integration with templates folders. 2.Development of post-install UI (CRUD interface admin panel).	Code committed locally.
22nd July	1.Routing mechanism to resources. 2.Save search and subscription implemented for msg_log.	Code committed to trunk.
29th July	1.OpenGeoSMS (process_opengeosms() ) routine is tweaked and linked with the respective parsing methods. 2.The existing functionality in the Android Client is tested .	Code committed to trunk.
5th August	1.Clickatell functionality is developed for eden. 2.Clickatell allows for a more robust testing mechanism. 2.The functionality is extended to other modules (if needed). 3.Feedback from mentors.	Code committed locally.
13th August	1.System testing & Bug fixing. 2.Final changes to the code are applied.	1.Project reaches final stage. 2.Bug fixes 3.Final Code committed to trunk.
20th August	PENCILS DOWN	Project Completed. :-)

Weekly Meeting

Fridays 13:00 UTC