Archive for the ‘general’ Category

0.8.14 much more flexible management of data table design inside built-in database

Wednesday, December 9th, 2009

The latest release not only has the usual bug fixes and usability enhancements, it has a few new pieces of functionality.

  • Can modify the design of tables in the built-in SOFA database (variable names, types, order, table names).
  • Able to insert and delete rows when editing value labels.
  • Can delete tables in the built-in database.
  • The sofa id field is now read-only when designing tables and the user gets useful messages if they try to delete it or insert a new field before it.

The bug fixes were:

  • CSV importer copes with inconsistent new line characters anywhere they are encountered.
  • Fixed bug when a key is deleted in a value list and then OK is hit.
  • Removed bug where focus would move erratically when entering long lists of value labels.
  • Changing database or table when making table reports resets the column buttons as it should.
  • Numbers like 1000000000000.2 are now displayed as simple numbers instead of as 1e+12 etc.
  • Newly-created tables appear in the table dropdown list immediately.

IMPORTANT FOR ALL UPGRADING USERS – you must delete the /username/sofa folder first (after storing anything you wish to save). And inside project files, change conn_dets to con_dets.

Funding open source to benefit education, health etc

Tuesday, December 1st, 2009

Government investment in open source makes sense as a way of reducing the cost of government service delivery.

The model is this – a government agency invests a sum of money to benefit a government sector e.g. education, health, social service delivery etc. As long as the software is open source, the government sector gets a multiplier effect – any further development of the software in other countries will further benefit education, health, social service delivery etc in the original country.

“This has certainly been New Zealand’s experience with Moodle, a GPL licenced online learning management system. A few years ago Moodle was a nice platform, had a good development community and a few hundred sites. A New Zealand TEC fund was used to add a number of features, not least amongst these were some very solid enterprise and performance capabilities.

Moodle is now used in over 13,000 sites and must be the world’s most popular LMS. Investment from institutions such as the UK’s Open University has now well exceeded NZ’s initial investment. Yet because of the GPL New Zealand still gets to benefit from other peoples’ significant work.” (New Zealand Open Source Society 2007)

Now imagine if there was a hypothetical open source program 😉 that could be used throughout the education sector (senior secondary, polytechs, universities), across a myriad of smaller organisations that supply social services on behalf of government, and across the private sector as well. It enables everything from the teaching of statistics through to routine management reporting. A bit of assistance in its further development could have a large spin-off. Makes you think.

0.8.13 better support for inconsistent data and missing values

Tuesday, December 1st, 2009

Removing rough edges and handling less perfect incoming data have been the recent focus of attention. The main changes in 0.8.13 are:

  • Better support for inconsistent data and missing values.
  • The user is informed what happens to files being imported.
  • The user has the option of halting a large raw data table report.
  • CSV importing now asks user if file has header and offers to clean up files with mixed line separators.
  • New projects have the default SOFA database preconfigured ready to save tables to.
  • Program now returns useful message if SQLite table with median or std dev fails because of non-numeric values (in purportedly numeric field).
  • Attempts to make new tables without a connection to the default database now receive a useful message.
  • Users are given the opportunity to pull out of opening a large data table.

Also importantly, there have been a myriad of bug fixes:

  • Fixed bug when using SQLite database other than the SOFA default one.
  • Report tables now handle non-numeric values in numeric fields (SQLite).
  • Fixed simple but fatal bugs affecting raw and summary tables.
  • Fixed bug when user path includes international characters.
  • Fixed bug using MS SQL for making report tables.

0.8.12 – more flexible installation on Windows and better international support

Saturday, November 21st, 2009

Another release with an emphasis on quality rather than new features. More new features will be coming soon once the wxWebKit and RaphaelJS technologies are mature enough. In the meantime:

  • More flexible installation options on Windows e.g. installing to D:\Program Files rather than C:\Program Files.
  • Better support for international text and unicode – e.g. René, Identität, François etc – in project, variable details, html report files, and css files.
  • Better interface behaviour when configuring a project.
  • Better feedback when errors with missing or malformed files.
  • For Galician speakers, a version of SOFA Statistics in their own language now works on Windows.
  • Fixed bug allowing new rows to be added to read-only tables if using Tab/Return key on last cell and then repeatedly hitting Tab keys.

0.8.11 provides internationalisation support and a major fix for Vista/Windows 7

Monday, November 9th, 2009

The latest version of SOFA Statistics has some important improvements.

  • Fixed major bug preventing interaction with data on Vista/Windows 7. It was caused by the “\U” combination inside project configuration files (e.g. C:\Users\…). The backslash U combination was treated as the start of a unicode string (international text etc) but as an invalid one. Windows testing using XP didn’t pick this up because the venerable “Documents and Settings” folder in XP has been replaced with the “Users” folder in Vista and Windows 7.
  • Better support for international text and unicode e.g. René, Identität, François etc.
  • Better responses to errors saving data to database tables. For example, if a user tries to save to database a word with characters in it not supported by the underlying database table (such as a unicode
    letter not found in the Latin character set).
  • For Galician speakers, a version of SOFA Statistics in their own language (currently only working in Ubuntu).

There is also a new version of wxWebKit etc available for Karmic (9.10) users thanks to Christoph Willing. NB this will also help some users of Jaunty (9.04) who have updated packages which conflict with those in SOFA Statistics. More details can be found at http://www.sofastatistics.com/predeb.php.

Making beautiful output using SVG and JavaScript

Saturday, October 24th, 2009

The charting functionality of SOFA Statistics is not available yet but the technology required is coming together. At the current time the intention is to use the gRaphaelJS library (http://g.raphaeljs.com/) to create the charts and wxWebKit (wxWebKit progress) to display it. The goal is to have beautiful output without using a proprietary technology such as Flash (which also has printing problems). The gRaphaelJS library is still only version 0.2 but progress has been rapid. DmitryBaranovskiy is doing a great job (http://github.com/DmitryBaranovskiy/g.raphael/).

0.8.10 more netbook-friendly and users can view table designs

Tuesday, October 20th, 2009

A small release before major work on internationalisation begins.  The main changes are:

  • Users can now view the design of tables in the default SOFA database.
  • More netbook-friendly design of projects form.
  • Misc improvements to interface esp when selecting data.

Major maintenance release in 0.8.9

Wednesday, October 14th, 2009

Version 0.8.9 of SOFA Statistics is a significant maintenance release.

Important bug fixes:

  • The process of creating new tables directly into SOFA Statistics has been significantly improved.
  • Numerous interface bugs affecting settings tables have been fixed.

Under the surface, the code underlying the database tables and the setting tables (e.g. configuring data table design, modifying variable labels, adding project settings etc) has been aligned considerably.  In the process, numerous bugs were removed, especially for Windows users.  Setting tables now have cell as well as row validation.  The text browser control in the grid (a text box and a browse button when you click on a cell to edit it) is now laid out much better.  Setting table validation refers to the faulty column by name rather than number.  Focus is not lost in Windows when in the settings subtable in the project configuration form.  Hitting Enter when editing a combo box in a settings table no longer loses focus to the OK button (thus closing the table prematurely!).  Plus misc minor fixes and extra polish.

One of the next tasks is to enable users to modify the configuration of existing SOFA Statistics tables e.g. rename fields, add/insert fields, delete fields etc.  The groundwork laid down in this release should make that much easier to add.

0.8.8 able to add data directly to SOFA Statistics

Saturday, October 3rd, 2009

Users are now able to add data directly to SOFA Statistics by configuring new tables in the default SQLite database and adding data directly to them.

There has also been an important bug fix for PostgreSQL when making report tables.  Interestingly, SUM(boolean) functions differently from the other SQL databases used.

The Windows installer should work better for many users esp on Vista or XP Professional.

A quirk has been noticed in the Windows version with the Enter key when configuring a new table and entering data into it.  Using tab or the mouse works in the meantime.  A fix is expected in the next release.

0.8.6 supports PostgreSQL and has better output formatting

Monday, August 24th, 2009

New features:

  • Added support for PostgreSQL databases.
  • Each item of output now has a preceding display line and a description of its data source (database and table) and when it was created.
  • Improved layout of exported scripts.
  • Added unit tests for main statistical algorithms used.
  • Better handling of timestamp and autonumber fields in data entry/editing.

Bug fixes:

  • Fixed script export bug.

Additionally, the Windows package now installs a menu shortcut for uninstallation. It always should have, of course, but the latter is still an example of a little thing which makes newer versions of SOFA Statistics nicer to use. The idea is that, collectively, thousands of details like that will create a sense of polish. The Ubuntu 100 papercuts project is one inspiration.