veyepar: Evaluating fire simulators using Docker, Dask and Jupyter notebooks!

Author(s):	Nathan Faggian
Location	Room 105
Date	aug Sun 14	Days Raw Files
Start	10:30	First Raw Start	error-in-template
Duration	0:40:00	Offset	None
End	11:10	Last Raw End
Chapters
Total cuts_time	None min.

https://2016.pycon-au.org/schedule/168/view_talk
raw-playlist raw-mp4-playlist encoded-files-playlist mp4 svg png

assets release.pdf Evaluating_fire_simulators_using_Docker_Dask_and_Jupyter_notebooks.json
logs
Admin: episode episode list cut list raw files day marks day marks day image_files

State:

Locked:

clear this to unlock

Locked by:

user/process that locked.

Start:

initially scheduled time from master, adjusted to match reality

Duration:

length in hh:mm:ss

Name:

Video Title (shows in video search results)

Emails:

email(s) of the presenter(s)

Released:

has someone authorised pubication

Normalise:

Channelcopy:

m=mono, 01=copy left to right, 10=right to left, 00=ignore.

Thumbnail:

filename.png

Description:

markdown

Bushfires are one of the most destructive forces in our environment. A major responsibility of the Bureau of Meteorology is to provide information on weather conditions that could make bushfires difficult to fight. Fire agencies then use simulators of fire behaviour to inform finer grained warnings to protect the Australian public. Objectively choosing the best performing simulators, or indeed the best versions of the same simulator, with respect to end-user requirements is a difficult task that requires a large amount of computation.

The introduction of new tools like Docker, Dask and Jupyter notebooks make the task of large scale computation much easier! The Bureau of Meteorology is looking at these technologies to help modernise its legacy workflows and processes, one example is our recent work in the area of fire simulators.

This talk will work through the approach developed for a reproducible environment (using Docker) and then how we form workflows (jupyter notebooks) that execute fire simulators on a small compute cluster of both windows and linux hosts (Dask, Distributed).  Finally, we will work through an example of scaling up an experiment and demonstrate a process that is easy to replicate and follow for fellow scientists.

Comment:

production notes