Archive for the ‘general’ Category

Version 1.1.0 brings it together

Saturday, August 20th, 2011

Version 1.1.0 finally brings it together adding some of the last features to round out the original vision for the application. The main change is much easier access to data – users can now open data tables from anywhere the table can be selected e.g. charts, report tables, statistical analyses.

Open your data from anywhere

Another change makes it easier to import from spreadsheets – SOFA now gives a preview of the first few rows of data to make it easier to determine whether there is a header row or not:

Spreadsheet sample

The two extra changes are: Importing from Google Doc spreadsheets now automatically starts import process if downloading was successful; Windows users can install into any folder now, not just one with sofastats in the name.

There are also a couple of bug fixes: Fixed bug when trying to display feedback on resizing operation on data table from dialogs other than data select; and fixed regression when running data list report tables.

Here are all the major feature changes since version 1.0 was released:

  • Single line charts now have option of a trend line and data smoothing (weighted rolling average).

    New options for line charts

  • Averages can be displayed for most chart types e.g. a line chart of average income by month.

    Chart Averages

  • Attractive and dynamic Box and Whisker plots added.

    Box and Whisker Plot button

    Box and Whisker Plot

  • Much easier access to data – can now open data table from anywhere the table can be selected e.g. charts, report tables, stats analyses.
  • Numerous usability improvements and bug fixes.

I hope you really like it.

1.0.7 Much easier data entry; better support for non-English text

Thursday, July 28th, 2011

It is now a lot easier and more pleasant to enter data directly into SOFA. Check it out and see if you agree. It is also easier to get CSV data in if there are lots of fields. Overall this is an incremental step forwards rather than the introduction of lots of new features. Here is the full list of improvements:

  • Much easier and quicker data entry. Return key now functions like Tab in data entry tables. Deleting a cell automatically inserts the appropriate value.
  • Much faster importing of csv files with lots of fields. Now has option of quickly checking field names collectively (in batches under the surface) rather than individually.
  • Improved feedback to user if problem in early stages starting SOFA. Program now makes an error text file on the user desktop as well.
  • All field or table name checks in SQLite now return the SQLite error text as well.
  • Better message to user if installation of wx backend for matplotlib missing.
  • If cancel process of changing file used to define variable config, report table display no longer reverts to random demo.

and bug fixes:

  • Fixed bug in chi square when no labels set for numerical variables. Needed to convert value to unicode before using as label.
  • Fixed bug when importing datetimes with ‘T’ as the separator between date and time.
  • Fixed bug caused by SQLite queries sometimes returning strings instead of floats when extracting REAL (numeric) data. Fixed it where it affected Row Stats medians and std devs; and statistical tests.
  • Fixed bug when uwhisker and lwhisker not set. Also copes better when no boxes are displayed in boxplot.
  • Handling Python 2.6 unicode keyword bug.
  • Replaced pprint.pformat where it messes up unicode e.g. user paths with non-ascii characters. Misc other changes to fix internal issues.
  • Fixed bug allowing None to be displayed in Val A and Val B drop-downs under Group by e.g. ANOVA.
  • Config dialog in Report Tables widened slightly when needed to display title.
  • Fixed bug when decimal entered into value label list for an integer field.
  • Fixed CSV import bug when trying to guess whether a header or not.

Thanks to all the users who helped identify and resolve problems.

50,000 downloads – another milestone

Monday, June 6th, 2011

SOFA Statistics had its 50,000th download today, and last month had over 4,600 downloads – a new record.

Download milestone

Box and Whisker Plots in version 1.0.6

Saturday, June 4th, 2011

Box and Whisker plots have been added.

Box and Whisker Plot button

In keeping with the SOFA ethos these have been made as attractive as possible:

Box and Whisker Plot

As with all SOFA output, the Box and Whisker Plots are themed and, like other charts, the content is dynamic and interactive. A minor feature added to this version is a warning about the need to include the “sofa_report_extras” subfolder to see charts.

The following bug fixes have been made:

  • Fixed bug preventing comma being used as decimal separator when importing data.
  • Fixed bug when making line charts with averages – shows smoothed data line and trend line appropriately. Also only enables or disables checkboxes for smoothed data line and trend line where appropriate.
  • Better handling of comtype errors.
  • Fixed bug in histogram code when no default limits supplied.

Easier to “Get Started” and to give feedback

Wednesday, April 13th, 2011

It is easier than ever to get started with SOFA Statistics. A new “Get Started” button has been added to the main form and other buttons have been shifted to better emphasise the most important:

New "Get Started" button

Clicking on the “Get Started” button open a web page with screen shots and step-by-step examples.

It is now easy for first-time users to give their feedback. Was it as useful as they hoped? Is there anything which can be done to improve SOFA? There is a link on the main start form, plus a pop-up option on first exit from SOFA.

Feedback via simple Google Docs survey

The goal is to make SOFA more useful by finding out what worked, and didn’t for users – especially first-time users.

There were two other changes:

  • When importing csv files, SOFA now sets the default for ‘Has header row?’ according to a review of the sample contents.
  • And an Exit control has been added to all forms where appropriate.

Once again, there have been a number of bug fixes:

  • Fixed postgresql quoting error by using single quote values.
  • SOFA now uses the default database when making an initial connection. If connecting to a project fails, SOFA reverts to previous project. Postgresql projects insist on default database if user is not ‘postgres’. Gives useful error if an old project has this problem.
  • Fixed minor bug in Mann-Whitney output exposed whenever labels with %s in them were used.
  • Improved error trapping if error importing wx.lib.iewin.
  • Better font for help text on main form according to platform.
  • CSV importing copes with single-row data.
  • Better font settings for help text on Macs.
  • Fixed display bug in Mac when more than 20 values warning shown (smaller font now).
  • Chart by now filters out data lacking values in chart by variable.

The most important thing for the project is the feedback we will hopefully receive.

40,000 downloads to date

Monday, March 21st, 2011

SOFA Statistics has now become the most downloaded general purpose statistics application on SourceForge, having passed the 40,000 download mark. There are plenty of new features forthcoming, and every effort will be made to add them without compromising the commitment to ease of use, learn as you go, and beautiful output.


Exciting new chart options in 1.0.3

Saturday, March 19th, 2011

For line charts, users can now add trend lines and smoothed lines (using a weighted rolling average).

New options for line charts

And histograms can now be produced with a normal distribution curve overlaid.

Optional normal curve on histograms

Other improvements include:

  • Histograms display better when lots of bins – wider chart and smaller font for x-axis.
  • Simplified layout of project selection form and changed preferences form.
  • Clearer labels when users are selecting a range of groups rather than discrete groups e.g. in ANOVA.
  • Added medians etc to the Wilcoxon Signed Ranks output.//
    Improved output for Wilcoxon Signed Ranks test

    Improved output for Wilcoxon Signed Ranks test

  • An early error message directs the user to the help page on “SOFA Won’t Start”. It also includes connection details in the error message if unable to connect to the default database.
  • Only delays next “What’s up” connection date if it successfully gets through.

There have also been some useful bug fixes:

  • Bug fix when importing from ODS any data which could potentially be a year e.g. 2631.
  • Report quality histograms no longer leave out values falling right on the upper limit.
  • Two-tailed vs one-tailed corrections in output display.
  • Fixed problem with table names (esp safetblname) surviving test for SQLite validity and breaking future tests.

1.0.2 keeps users connected

Wednesday, February 9th, 2011

I suspect that downloading SOFA Statistics is, for most users, the last contact they have with the project or the community. The latest version (1.0.2) addresses this. Approximately 2 weeks after the first use, and every couple of months thereafter, SOFA Statistics pops up a “What’s Happening” web page within the application. This page has links to help, quotes, latest SOFA Statistics news, resources, featured statistics videos etc. I hope it will be of value to users, and help them get the most out of SOFA Statistics and the training etc resources available. This aspect of SOFA is intended to be relatively unobtrusive and it can be closed immediately if so desired with its close button.

What's happening

Other changes include:

  • Added explanation of Mann-Whitney U to output, added degrees of freedom to output wherever possible, added footnotes for p values where lacking, and ensured all p values are to 3 decimal points unless under 0.001 in which case ‘< 0.001' is displayed.
  • Better help messages if early problem with comtypes (Windows only) or library dates.

Bug fixes include:

  • Fixed bug when reporting on datetime fields as rows or columns in report tables in MySQL, PostgreSQL, Access, and SQL Server.
  • Fixed minor bug which meant MySQL importing failed on Macs because it didn’t recognise the platform.

Work will begin soon on the versions leading up to 1.1.

The first general release is out (Version 1.0)

Wednesday, February 2nd, 2011

After 34,000 downloads of early releases, the first general release of SOFA Statistics is out. See it in action here. You can get it for Windows, Mac, Ubuntu, and (other) Linux distributions here.

Version 1.0 launched

SOFA Statistics is 100% free and open source but affordable commercial support is available to those who would like that here. The latest version is the culmination of several years work and we hope you like it!

Installation note if upgrading: if upgrading from 0.9.24 or below, you will need to rename your /home/username/sofa folder to /home/username/sofastats if you wish to work with old data or settings. If you are using Ubuntu, you must also manually uninstall previous versions of SOFA first so that “sofastats” can overwrite the application icon put there originally by “sofa”.

0.9.25 upgrade checking; improved recoding; misc bug fixes

Sunday, January 23rd, 2011

One of the biggest changes this release is behind the scenes – the folders SOFA Statistics is stored in have changed from “sofa” to “sofastats” to make them more distinct (there are other sofa programs ;-)). This was something important to get done before the version 1.0 release. Although this is a good change for the long-term it means users upgrading from 0.9.24 and below will need to rename their /home/username/sofa folder to /home/username/sofastats if they wish to work with old data or settings. For Ubuntu users, it is also important to manually uninstall previous versions of SOFA first so that “sofastats” can overwrite the application icon put there originally by “sofa”.

More noticeable, is the change to version upgrade checking. Auto-checking for any version upgrades is now the default. The goal is to help users stay up-to-date with bug fixes, improvements etc. Users can disable this feature by selecting the “No checking” option, or only auto-check for major upgrades. This feature only reads the contents of a small text file on the domain containing the latest version number.

Other changes include:

  • SOFA suggests names more likely to be valid when user selects a file for importing.
  • Can now import csv files with a txt extension.
  • MySQL and PostgreSQL can now accept blank passwords.
  • Better message for user if comtypes problem.
  • Windows and Mac versions will no longer accept being launched with Python 2.7 and will give useful messages about fixing the problem. For Windows, the importance of installing the site-packages to python26 rather than python27 is explained.
  • Mac version uses new, easier-to-install library to connect to MySQL databases.

The main series of bug fixes relate to recoding data and making new data tables or redesigning them.

  • Fixed numerous recode bugs – mostly to do with application of recoded value labels.
  • Fixed bug when making a new table with an existing name. Now stays open to give user choice as to what to do next e.g. change table name.
  • Fixed misc bugs when deleting/adding/renaming tables while a database other than the default SOFA database is selected.
  • Fixed bug running frequency table using MySQL where the category items are long integers.
  • Fixed bug where Data List report selected and then the database is changed.

Ideally, the next release should be version 1.0.0