Hi
user
Admin Login:
Username:
Password:
Name:
Disco: Not Just MapReduce Any More
--client
continuum
--show
pydata_sv_2013
--room a2 2240 --force
Next: 5 Wise.io a Machine-Learning Platform
show more...
Marks
Author(s):
Prashanth Mundkur
Location
A2
Date
mar Tue 19
Days Raw Files
Start
13:15
First Raw Start
11:38
Duration
00:50:00
Offset
1:36:47
End
14:05
Last Raw End
14:43
Chapters
00:00
0:31:23
Total cuts_time
42 min.
raw-playlist
raw-mp4-playlist
encoded-files-playlist
host
archive
mp4
svg
png
assets
release.pdf
Disco_Not_Just_MapReduce_Any_More.json
logs
Admin:
episode
episode list
cut list
raw files day
marks day
marks day
image_files
State:
---------
borked
edit
encode
push to queue
post
richard
review 1
email
review 2
make public
tweet
to-miror
conf
done
Locked:
clear this to unlock
Locked by:
user/process that locked.
Start:
initially scheduled time from master, adjusted to match reality
Duration:
length in hh:mm:ss
Name:
Video Title (shows in video search results)
Emails:
email(s) of the presenter(s)
Released:
has someone authorised pubication
Unknown
Yes
No
Normalise:
Channelcopy:
m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:
filename.png
Description:
markdown
The goal of Disco has been to be a simple and usable implementation of MapReduce. To keep things simple, this MapReduce aspect has been hard-coded into Disco, both in the Erlang job scheduler, as well as in the Python library. To fix various issues in the implementation, we decided to take a cold hard look at the dataflow in Disco's version of MapReduce. We came up with a generalization that should be more flexible and hence also more useful than plain old MapReduce. We call this the Pipeline model, and we hope to use this in the next major release of Disco. This will implement the old MapReduce model in terms of a more general programmable pipeline, and also expose the pipeline to users wishing to take advantage of the optimization opportunities it offers. If time permits, we will also discuss other aspects of the Disco roadmap, and the future of the Disco project.
Comment:
production notes
2013-03-19/11:38:13.dv
Apply:
11:38:13 - 13:16:38 ( 01:38:25 )
S:
11:38:13 -
E:
13:16:38
D:
01:38:25
show more...
vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/11:38:13.dv :start-time=00.0 --audio-desync=0
Raw File
Cut List
11:38:13
seconds: 0.0
Wall: 11:38:13
Duration
01:38:25
13:16:38
seconds: 0.0
Wall: 11:38:13
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2013-03-19/13:16:39.dv
Apply:
13:16:39 - 13:48:02 ( 00:31:23 )
S:
13:16:39 -
E:
13:48:02
D:
00:31:23
show more...
vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/13:16:39.dv :start-time=00.0 --audio-desync=0
Raw File
Cut List
13:16:39
seconds: 0.0
Wall: 13:16:39
Duration
00:31:23
13:48:02
seconds: 0.0
Wall: 13:16:39
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2013-03-19/13:48:02.dv
Apply:
13:48:02 - 13:59:07 ( 00:11:05 )
S:
13:48:02 -
E:
13:59:07
D:
00:11:05
show more...
vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/13:48:02.dv :start-time=00.0 --audio-desync=0
Raw File
Cut List
13:48:02
seconds: 0.0
Wall: 13:48:02
Duration
00:11:05
13:59:07
seconds: 0.0
Wall: 13:48:02
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2013-03-19/13:59:07.dv
Apply:
13:59:07 - 14:00:33 ( 00:01:26 )
S:
13:59:07 -
E:
14:00:33
D:
00:01:26
show more...
vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/13:59:07.dv :start-time=00.0 --audio-desync=0
Raw File
Cut List
13:59:07
seconds: 0.0
Wall: 13:59:07
Duration
00:01:26
14:00:33
seconds: 0.0
Wall: 13:59:07
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2013-03-19/14:07:34.dv
Apply:
14:07:34 - 14:08:04 ( 00:00:30 )
S:
14:07:34 -
E:
14:08:04
D:
00:00:30
show more...
vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/14:07:34.dv :start-time=00.0 --audio-desync=0
Raw File
Cut List
14:07:34
seconds: 0.0
Wall: 14:07:34
Duration
00:00:30
14:08:04
seconds: 0.0
Wall: 14:07:34
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2013-03-19/14:08:42.dv
Apply:
14:08:42 - 14:09:26 ( 00:00:44 )
S:
14:08:42 -
E:
14:09:26
D:
00:00:44
show more...
vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/14:08:42.dv :start-time=00.0 --audio-desync=0
Raw File
Cut List
14:08:42
seconds: 0.0
Wall: 14:08:42
Duration
00:00:44
14:09:26
seconds: 0.0
Wall: 14:08:42
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2013-03-19/14:09:26.dv
Apply:
14:09:26 - 14:43:15 ( 00:33:49 )
S:
14:09:26 -
E:
14:43:15
D:
00:33:49
show more...
vlc ~/Videos/veyepar/continuum/pydata_sv_2013/dv/a2/2013-03-19/14:09:26.dv :start-time=00.0 --audio-desync=0
Raw File
Cut List
14:09:26
seconds: 0.0
Wall: 14:09:26
Duration
00:33:49
14:43:15
seconds: 0.0
Wall: 14:09:26
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
Rf filename:
root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:
check and save to add this
2013-03-19/11:38:13.dv
2013-03-19/13:16:39.dv
2013-03-19/13:48:02.dv
2013-03-19/13:59:07.dv
2013-03-19/14:07:34.dv
2013-03-19/14:08:42.dv
2013-03-19/14:09:26.dv
Veyepar
Video Eyeball Processor and Review
