veyepar: Reusable R for automation, small area estimation and legacy systems

Author(s):	Rhydwyn
Location	Tasman Hall A
Date	jan Wed 18	Days Raw Files
Start	Jan. 18, 2017, 5:40 p.m.	First Raw Start	Jan. 18, 2017, 5:29 p.m.
Duration	0:45:0	Offset	0:10:39
End	Jan. 18, 2017, 6:25 p.m.	Last Raw End	Jan. 18, 2017, 6:29 p.m.
Chapters	00:00 0:17:54
Total cuts_time	41 min.

http://linux.conf.au/schedule/presentation/44/
raw-playlist raw-mp4-playlist encoded-files-playlist host archive tweet mp4 svg png

assets release.pdf Reusable_R_for_automation_small_area_estimation_and_legacy_systems.json
logs
Admin: episode episode list cut list raw files day marks day marks day image_files

State:

Locked:

clear this to unlock

Locked by:

user/process that locked.

Start:

initially scheduled time from master, adjusted to match reality

Duration:

length in hh:mm:ss

Name:

Video Title (shows in video search results)

Emails:

email(s) of the presenter(s)

Released:

has someone authorised pubication

Normalise:

Channelcopy:

m=mono, 01=copy left to right, 10=right to left, 00=ignore.

Thumbnail:

filename.png

Description:

markdown

In order to safely share open public health data for small areas, health researchers employ complex spatial adjustment models called generalised additive models. We need to run these models hundreds of times, with inbuilt checking and debugging.

Proprietary statistical programs are designed for run-once analyses. They did not meet our needs. We need something better: we need well-engineered R.

We need to make it easy for analysts to use. We wanted to use the tools of software engineering and reusable research to allow statisticians and epidemiologists to be more efficient - but statisticians and epidemiologists are not computer scientists, and a lot of this world is new to them.

Therefore, we had to develop not only for good software practice, but to ensure that others could use our tools - even when the tool comes with a very different focus from what users are used to.

Using the example of batch small area estimation using generalized additive models, I will talk about the project, the tools we used and how to integrate R into a legacy SAS environment with a minimum of pain: allowing for uptake of the strengths of R without exposing new users to its complexity.

This case will show how open source scientists and statisticians can benefit from open source, and how open source and openness in general can make science better.

Comment:

production notes