veyepar: Disco: Not Just MapReduce Any More

State:
Locked:	clear this to unlock
Locked by:	user/process that locked.
Start:	initially scheduled time from master, adjusted to match reality
Duration:	length in hh:mm:ss
Name:	Video Title (shows in video search results)
Emails:	email(s) of the presenter(s)
Released:	has someone authorised pubication
Normalise:
Channelcopy:	m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:	filename.png
Description:	The goal of Disco has been to be a simple and usable implementation of MapReduce. To keep things simple, this MapReduce aspect has been hard-coded into Disco, both in the Erlang job scheduler, as well as in the Python library. To fix various issues in the implementation, we decided to take a cold hard look at the dataflow in Disco's version of MapReduce. We came up with a generalization that should be more flexible and hence also more useful than plain old MapReduce. We call this the Pipeline model, and we hope to use this in the next major release of Disco. This will implement the old MapReduce model in terms of a more general programmable pipeline, and also expose the pipeline to users wishing to take advantage of the optimization opportunities it offers. If time permits, we will also discuss other aspects of the Disco roadmap, and the future of the Disco project. markdown
Comment:	production notes

2013-03-19/11:38:13.dv Apply: 11:38:13 - 13:16:38 ( 01:38:25 ) S: 11:38:13 - E: 13:16:38 D: 01:38:25 show more...

vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/11:38:13.dv :start-time=00.0 --audio-desync=0

2013-03-19/13:16:39.dv Apply: 13:16:39 - 13:48:02 ( 00:31:23 ) S: 13:16:39 - E: 13:48:02 D: 00:31:23 show more...

vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/13:16:39.dv :start-time=00.0 --audio-desync=0

2013-03-19/13:48:02.dv Apply: 13:48:02 - 13:59:07 ( 00:11:05 ) S: 13:48:02 - E: 13:59:07 D: 00:11:05 show more...

vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/13:48:02.dv :start-time=00.0 --audio-desync=0

2013-03-19/13:59:07.dv Apply: 13:59:07 - 14:00:33 ( 00:01:26 ) S: 13:59:07 - E: 14:00:33 D: 00:01:26 show more...

vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/13:59:07.dv :start-time=00.0 --audio-desync=0

2013-03-19/14:07:34.dv Apply: 14:07:34 - 14:08:04 ( 00:00:30 ) S: 14:07:34 - E: 14:08:04 D: 00:00:30 show more...

vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/14:07:34.dv :start-time=00.0 --audio-desync=0

2013-03-19/14:08:42.dv Apply: 14:08:42 - 14:09:26 ( 00:00:44 ) S: 14:08:42 - E: 14:09:26 D: 00:00:44 show more...

vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/14:08:42.dv :start-time=00.0 --audio-desync=0

2013-03-19/14:09:26.dv Apply: 14:09:26 - 14:43:15 ( 00:33:49 ) S: 14:09:26 - E: 14:43:15 D: 00:33:49 show more...

vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/14:09:26.dv :start-time=00.0 --audio-desync=0

Rf filename:	root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:	check and save to add this