|Version 63 (modified by 13 years ago) ( diff ),|
"A bug is a test case you haven't written yet"
"Unit Tests allow merciless refactoring"
Test-Driven Development is a programming styles which says that you 1st write your test cases (from the specs) & then proceed to make them pass.
Behaviour-Driven Development takes this further to focus on the Specification rather than the Verification using something like pyspec or PyFITto provide testable specs:
There are a huge number of Testing Tools available to cover the various parts of the Testing process:
A community available for assistance:
Testing that Developers should be doing:
Unit Tests (must do)
Building the Code Right
- DocTest - inline with code: Agile Documentation
- Web2Py supports running doctests on Controllers from the admin UI, e.g.: http://127.0.0.1:8000/admin/default/test/sahana/default.py
- DocTests for HTML apps (good since in-process hence can capture errors): http://agiletesting.blogspot.com/2006/04/in-process-web-app-testing-with-twill.html
- Uses wsgi_intercept: http://code.google.com/p/wsgi-intercept/
- dutest - DocTest UnitTest integration (includes HTML-aware output checkers such as lxml.doctestcompare.LHTMLOutputChecker)
- UnitTest (formerly PyUnit)
- Nose - a discovery-based unittest extension
- Webunit - adds supports for HTTP GET/POST testing to unittest
- WebTest - CherryPy's extensions to unittest
Whenever a commit is made it should be checked to see that it doesn't break anything
Alternate options which could be investigated:
Fired by dev after certain number of changes or whenever they like.
As well as writing DocStrings in all functions, we can generate an overall API using:
If writing a separate manual then we can use:
Testing that Testers should be doing as part of Acceptance:
Boundary Testing (should do)
Building the Right Code
Checks functionality of modules against specs
This sees the application as a black box & so the same tests could be run here against both the Python & PHP versions, for instance.
Sahana is a Web-based application, so testing should be from browser perspective:
Functional tests can be written using:
- This is currently being integrated into SahanaPy, based on this discussion: http://groups.google.com/group/web2py/msg/d8c9fd6008029f6b
- Selenium & Twisted: http://agiletesting.blogspot.com/2005/03/web-app-testing-with-python-part-2.html
- A lot of Selenium-related articles: http://vallista.idyll.org/~grig/articles/
- Mechanize - library for programming website browsing
- MaxQ: http://agiletesting.blogspot.com/2005/02/web-app-testing-with-python-part-1.html
- TestMonkey - not ready for primetime but worth keeping an eye on
Integration Testing (good thing)
We depend on various 3rd-party components so we need to ensure that as these components are upgraded this doesn't break any of our functionality:
- UI Guidelines - comments on UI issues in Sahana2
- Are we XHTML 1.0 compliant?
Whilst the Web2Py framework is fast, we should check that we're not doing anything stupid to slow it down:
How many simultaneous users can the system support?
If extreme load is applied to the application, does it recover gracefully?
- Tools above but using more extreme parameters parameters
Whilst the Web2Py framework is secure by design, we should validate this:
Things developers can do to reduce risks:
- Regression tests.pdf (482.2 KB ) - added by 12 years ago.
) - added by 12 years ago.
Source for the PDF
) - added by 11 years ago.
) - added by 11 years ago.
Interactive Wrapper for Selenium
Download all attachments as: .zip