veyepar: Tutorial: The Power of Open Data with ELK

Author(s):	Mark Walkom
Location	D2.211
Date	feb Thu 04	Days Raw Files
Start	10:40	First Raw Start	10:39
Duration	1:40:00	Offset	0:00:48
End	12:20	Last Raw End	12:20
Chapters	00:00
Total cuts_time	98 min.

https://linux.conf.au/schedule/30217/view_talk
raw-playlist raw-mp4-playlist encoded-files-playlist host archive tweet mp4 svg png

assets release.pdf Tutorial_The_Power_of_Open_Data_with_ELK.json
logs
Admin: episode episode list cut list raw files day marks day marks day image_files

State:

Locked:

clear this to unlock

Locked by:

user/process that locked.

Start:

initially scheduled time from master, adjusted to match reality

Duration:

length in hh:mm:ss

Name:

Video Title (shows in video search results)

Emails:

email(s) of the presenter(s)

Released:

has someone authorised pubication

Normalise:

Channelcopy:

m=mono, 01=copy left to right, 10=right to left, 00=ignore.

Thumbnail:

filename.png

Description:

markdown

Through the Declaration of Open Government, Australian citizens have been empowered with access to government data and information at both a local and national scale. This means Australian citizens can openly and freely access both historical and up-to-date information on areas that have a direct impact on themselves and their communities.

Our tutorial session will enable participants to run up an ELK stack to process a dataset from data.gov.au, and leave them with the skills to apply the stack to nearly any dataset. The ELK stack, which is comprised of the open-source software projects Elasticsearch, Logstash and Kibana is a powerful data and analytics platform that makes it easy to take structured and unstructured data and present it in beautiful ways. We’ll take a sample dataset from data.gov.au, feed it through Logstash, store it in Elasticsearch and then create a dashboard of visualisations from the data in Kibana.

At the end of the tutorial, participants will have enough knowledge to be able to adapt the process in the tutorial to other data from data.gov.au and will hopefully be inspired to start analysing the vast amounts of data that are readily available.

Participants should bring a laptop with Java 1.7 or 1.8 installed, it is assumed the attendee has basic Linux experience with shell and editor usage. 
A set of files, including the ELK packages and the dataset, along with instructions will be made available by URL before the talk, and on USB thumbdrive on the day.

Presented by Joshua Rich and Mark Walkom.

Comment:

production notes