wiki:BluePrint/Internationalisation

Version 52 (modified by nownikhil, 9 years ago) ( diff )

--

Internationalisation Blueprint

This page looks at ways we can extend the Internationalisation options within Sahana Eden.

Production Options are defined within DeveloperGuidelines/Internationalisation

User perspective is: UserGuidelines/Localisation

ToDo

Below are some tasks that can help in improving the existing translation functionality.

s3translate

  • Pootle integration
  • Add ability to enable/disable menu options (make this a DB table rather than a deployment_setting?)
  • Think about how uploaded files can not conflict with updates from Version Control (currently uploaded updates will be wiped during upgrades)
  • Exclude all templates other than current one by default (option to include all templates, defaulting to off)
  • Default list of modules to the ones which are active in the running template
  • List of modules shouldn't come from list of controllers (e.g. misses translate itself!)
  • Exclude Unit Tests folder
  • Exclude all full paths (2nd occurrence+ is giving full path)
  • Include certain prepop CSV columns (for T(record.field))
  • Don't include vars - e.g. T(r.name) shouldn't add "r.name" to the translation file
  • Rewrite admin.py translate() so that only opt3 is a REST controller for translate_language (no need for an opt)
    • All other opts should be separate controllers
  • Online help to explain that the local languages/code.py will be updated & that uploaded files will be merged
  • Online help to explain 'core files'
  • Copy code from TranslateToolkit internally to avoid having external dependencies & launching a shell

Other

  • JavaScript
  • Extend web2py2po/po2web2py to support translator comments
    def translate(self, message, symbols):
        """
           user ## to add a comment into a translation string
           the comment can be useful do discriminate different possible
           translations for the same string (for example different locations)
    
           T(' hello world ') -> ' hello world '
           T(' hello world ## token') -> 'hello world'
           T('hello ## world ## token') -> 'hello ## world'
        """
    

Inroduction

This blueprint presents the development of Translation Functionality of Sahana-Eden. The current translation functionality has a lot of features to ease the translation process during disasters. However, there are various issues with some of the features and it can be improved further. The purpose of this blueprint is to address those issues and propose some solutions for the same so that Eden can have a more robust and efficient translation system.

Problem

  • There is no integration with Pootle
  • Size of .py files will grow
  • All strings are selected when only a few of them corresponding to the modules in the active template will be required.
  • Conflict in strings due to pull requests.
  • System calls in the current version. (External Dependencies)
  • Prepop CSV files are not included

Benefit to Sahana

  • There can be a scenario where the translated strings received through pull request conflict with what’s already in the repository. The project aims to prevent this merge conflict.
  • There are external dependencies in the current code as it makes system calls, and these will be avoided in the new version.
  • Certain strings get deprecated with time, as the source code is changed and new ones are added. These deprecated strings will be removed and new ones will be added from time to time.
  • Many strings are selected for translation even though certain of them would not be required for that particular deployment. So it is important to select only those strings that are present in the active modules. Currently, the translator doesn’t know which modules are active in the current template. The plan is to check these modules by default so as to save time and energy.
  • Pootle integration is missing. As some translators prefer using pootle this will allow better options for translators.

User Stories

As a translator :

I would not want to translate Deprecated Strings

As a system admin I would want to:

Keep the size of .py files small

Allow integration with pootle

Provide strings only from Active Templates to save time of translators. Avoid conflicts when updating.

Current Implementation

The current translation functionality in Sahana-Eden does the following ( Most of these are in s3translate.py file) :-

a) Provide a menu to select a list of modules from which strings are to be translated ( doesn’t default modules corresponding to active template)

b) Extract strings from the selected modules using parse tree approach. Also extracts strings of deployment.settings variables (but not database variables)

c) Strings can be exported in xls and po formats

d) Merges uploaded translations ( in csv) with the existing .py language file ( doesn’t overwrite)

e) Pootle translations are not synced currently.

f) Doesn’t account for conflicts due to pulls and pomerge. g) External dependencies due to calls to methods in Translate Toolkit

Different Sources of translated strings

There are mainly three sources of translated strings :-

1) Uploading CSV/PO file : In this case, the existing ".py" language file is merged with the translations from the uploaded files. Currently only upload of csv files is supported.

2) Through pull request : Translated strings are received through pull request.( One issue with the pull is that the Version control wipes out the uploaded updates.)

3) Through Pootle : This is in connection with the Pootle Integration of Sahana Eden. We need to be able to keep the Pootle and web2py language files in sync with respect to the strings. Hence, when merging with Pootle, there mustn't be any conflicts.

Other options

Notes

Discussions


BluePrints TranslatedPages TranslatedPages

Attachments (1)

Download all attachments as: .zip

Note: See TracWiki for help on using the wiki.