veyepar: Agile experiments in Machine Learning

Author(s):	Mathias Brandewinder
Location	Crystal Ballroom
Date	jul Mon 11	Days Raw Files
Start	09:30	First Raw Start	09:30
Duration	00:30.0:00	Offset	0:00:42
End	10:00	Last Raw End	10:30
Chapters	00:00 0:08:51
Total cuts_time	27 min.

http://lanyrd.com/2016/netfringe/sfcxpm/
raw-playlist raw-mp4-playlist encoded-files-playlist host archive mp4 svg png

assets release.pdf Agile_experiments_in_Machine_Learning.json
logs
Admin: episode episode list cut list raw files day marks day marks day image_files

State:

Locked:

clear this to unlock

Locked by:

user/process that locked.

Start:

initially scheduled time from master, adjusted to match reality

Duration:

length in hh:mm:ss

Name:

Video Title (shows in video search results)

Emails:

email(s) of the presenter(s)

Released:

has someone authorised pubication

Normalise:

Channelcopy:

m=mono, 01=copy left to right, 10=right to left, 00=ignore.

Thumbnail:

filename.png

Description:

markdown

Just like traditional applications development, machine learning involves writing code. One aspect where the two differ is the workflow. While software development follows a fairly linear process (design, develop, and deploy a feature), machine learning is a different beast. You work on a single feature, which is never 100% complete. You constantly run experiments, and re-design your model in depth at a rapid pace. Traditional tests are entirely useless. Validating whether you are on the right track takes minutes, if not hours.

In this talk, we will take the example of a Machine Learning competition we recently participated in, the Kaggle Home Depot competition, to illustrate what "doing Machine Learning" looks like. We will explain the challenges we faced, and how we tackled them, setting up a harness in F# to easily create and run experiments, while keeping our sanity. We will also draw comparisons with traditional software development, and highlight how some ideas translate from one context to the other, adapted to different constraints. to come.

Comment:

production notes

2016-07-11/09_30_42.ts Apply: 09:30:42 - 09:44:05 ( 00:13:23 ) S: 09:30:42 - E: 10:00:42 D: 00:30:00 (End: 803.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/09_30_42.ts :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	09:30:42		seconds: 0.0 Wall: 09:30:42
Duration	00:30:00
	10:00:42		seconds: 803.0 Wall: 09:44:05
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/09_30_42.ts Apply: 09:44:05 - 09:46:46 ( 00:02:41 ) S: 09:30:42 - E: 10:00:42 D: 00:30:00 (Start: 803.0) (End: 964.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/09_30_42.ts :start-time=0803.0 --audio-desync=0

	Raw File	Cut List
	09:30:42		seconds: 803.0 Wall: 09:44:05
Duration	00:30:00
	10:00:42		seconds: 964.0 Wall: 09:46:46
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/09_30_42.ts Apply: 09:46:46 - 09:51:22 ( 00:04:36 ) S: 09:30:42 - E: 10:00:42 D: 00:30:00 (Start: 964.0) (End: 1240.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/09_30_42.ts :start-time=0964.0 --audio-desync=0

	Raw File	Cut List
	09:30:42		seconds: 964.0 Wall: 09:46:46
Duration	00:30:00
	10:00:42		seconds: 1240.0 Wall: 09:51:22
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/09_30_42.ts Apply: 09:51:22 - 09:51:46 ( 00:00:24 ) S: 09:30:42 - E: 10:00:42 D: 00:30:00 (Start: 1240.0) (End: 1264.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/09_30_42.ts :start-time=01240.0 --audio-desync=0

	Raw File	Cut List
	09:30:42		seconds: 1240.0 Wall: 09:51:22
Duration	00:30:00
	10:00:42		seconds: 1264.0 Wall: 09:51:46
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/09_30_42.ts Apply: 09:51:46 - 09:51:50 ( 00:00:04 ) S: 09:30:42 - E: 10:00:42 D: 00:30:00 (Start: 1264.0) (End: 1268.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/09_30_42.ts :start-time=01264.0 --audio-desync=0

	Raw File	Cut List
	09:30:42		seconds: 1264.0 Wall: 09:51:46
Duration	00:30:00
	10:00:42		seconds: 1268.0 Wall: 09:51:50
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/09_30_42.ts Apply: 09:51:50 - 09:51:51 ( 00:00:01 ) S: 09:30:42 - E: 10:00:42 D: 00:30:00 (Start: 1268.0) (End: 1269.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/09_30_42.ts :start-time=01268.0 --audio-desync=0

	Raw File	Cut List
	09:30:42		seconds: 1268.0 Wall: 09:51:50
Duration	00:30:00
	10:00:42		seconds: 1269.0 Wall: 09:51:51
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/09_30_42.ts Apply: 09:51:51 - 10:00:42 ( 00:08:51 ) S: 09:30:42 - E: 10:00:42 D: 00:30:00 (Start: 1269.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/09_30_42.ts :start-time=01269.0 --audio-desync=0

	Raw File	Cut List
	09:30:42		seconds: 1269.0 Wall: 09:51:51
Duration	00:30:00
	10:00:42		seconds: 0.0 Wall: 09:30:42
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/10_00_42.ts Apply: 10:00:42 - 10:19:19 ( 00:18:37 ) S: 10:00:42 - E: 10:30:42 D: 00:30:00 (End: 1117.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/10_00_42.ts :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	10:00:42		seconds: 0.0 Wall: 10:00:42
Duration	00:30:00
	10:30:42		seconds: 1117.0 Wall: 10:19:19
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/10_00_42.ts Apply: 10:19:19 - 10:21:36 ( 00:02:17 ) S: 10:00:42 - E: 10:30:42 D: 00:30:00 (Start: 1117.0) (End: 1254.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/10_00_42.ts :start-time=01117.0 --audio-desync=0

	Raw File	Cut List
	10:00:42		seconds: 1117.0 Wall: 10:19:19
Duration	00:30:00
	10:30:42		seconds: 1254.0 Wall: 10:21:36
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/10_00_42.ts Apply: 10:21:36 - 10:21:41 ( 00:00:05 ) S: 10:00:42 - E: 10:30:42 D: 00:30:00 (Start: 1254.0) (End: 1259.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/10_00_42.ts :start-time=01254.0 --audio-desync=0

	Raw File	Cut List
	10:00:42		seconds: 1254.0 Wall: 10:21:36
Duration	00:30:00
	10:30:42		seconds: 1259.0 Wall: 10:21:41
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/10_00_42.ts Apply: 10:21:41 - 10:21:46 ( 00:00:05 ) S: 10:00:42 - E: 10:30:42 D: 00:30:00 (Start: 1259.0) (End: 1264.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/10_00_42.ts :start-time=01259.0 --audio-desync=0

	Raw File	Cut List
	10:00:42		seconds: 1259.0 Wall: 10:21:41
Duration	00:30:00
	10:30:42		seconds: 1264.0 Wall: 10:21:46
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/10_00_42.ts Apply: 10:21:46 - 10:21:55 ( 00:00:09 ) S: 10:00:42 - E: 10:30:42 D: 00:30:00 (Start: 1264.0) (End: 1273.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/10_00_42.ts :start-time=01264.0 --audio-desync=0

	Raw File	Cut List
	10:00:42		seconds: 1264.0 Wall: 10:21:46
Duration	00:30:00
	10:30:42		seconds: 1273.0 Wall: 10:21:55
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/10_00_42.ts Apply: 10:21:55 - 10:22:05 ( 00:00:10 ) S: 10:00:42 - E: 10:30:42 D: 00:30:00 (Start: 1273.0) (End: 1283.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/10_00_42.ts :start-time=01273.0 --audio-desync=0

	Raw File	Cut List
	10:00:42		seconds: 1273.0 Wall: 10:21:55
Duration	00:30:00
	10:30:42		seconds: 1283.0 Wall: 10:22:05
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/10_00_42.ts Apply: 10:22:05 - 10:22:11 ( 00:00:06 ) S: 10:00:42 - E: 10:30:42 D: 00:30:00 (Start: 1283.0) (End: 1289.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/10_00_42.ts :start-time=01283.0 --audio-desync=0

	Raw File	Cut List
	10:00:42		seconds: 1283.0 Wall: 10:22:05
Duration	00:30:00
	10:30:42		seconds: 1289.0 Wall: 10:22:11
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/10_00_42.ts Apply: 10:22:11 - 10:22:19 ( 00:00:08 ) S: 10:00:42 - E: 10:30:42 D: 00:30:00 (Start: 1289.0) (End: 1297.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/10_00_42.ts :start-time=01289.0 --audio-desync=0

	Raw File	Cut List
	10:00:42		seconds: 1289.0 Wall: 10:22:11
Duration	00:30:00
	10:30:42		seconds: 1297.0 Wall: 10:22:19
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/10_00_42.ts Apply: 10:22:19 - 10:22:44 ( 00:00:25 ) S: 10:00:42 - E: 10:30:42 D: 00:30:00 (Start: 1297.0) (End: 1322.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/10_00_42.ts :start-time=01297.0 --audio-desync=0

	Raw File	Cut List
	10:00:42		seconds: 1297.0 Wall: 10:22:19
Duration	00:30:00
	10:30:42		seconds: 1322.0 Wall: 10:22:44
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/10_00_42.ts Apply: 10:22:44 - 10:22:53 ( 00:00:09 ) S: 10:00:42 - E: 10:30:42 D: 00:30:00 (Start: 1322.0) (End: 1331.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/10_00_42.ts :start-time=01322.0 --audio-desync=0

	Raw File	Cut List
	10:00:42		seconds: 1322.0 Wall: 10:22:44
Duration	00:30:00
	10:30:42		seconds: 1331.0 Wall: 10:22:53
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/10_00_42.ts Apply: 10:22:53 - 10:22:56 ( 00:00:03 ) S: 10:00:42 - E: 10:30:42 D: 00:30:00 (Start: 1331.0) (End: 1334.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/10_00_42.ts :start-time=01331.0 --audio-desync=0

	Raw File	Cut List
	10:00:42		seconds: 1331.0 Wall: 10:22:53
Duration	00:30:00
	10:30:42		seconds: 1334.0 Wall: 10:22:56
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2016-07-11/10_00_42.ts Apply: 10:22:56 - 10:30:42 ( 00:07:46 ) S: 10:00:42 - E: 10:30:42 D: 00:30:00 (Start: 1334.0) show more...

vlc ~/Videos/veyepar/troy/dnf2016/dv/crystal_ballroom/2016-07-11/10_00_42.ts :start-time=01334.0 --audio-desync=0

	Raw File	Cut List
	10:00:42		seconds: 1334.0 Wall: 10:22:56
Duration	00:30:00
	10:30:42		seconds: 0.0 Wall: 10:00:42
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete