Hi
user
Admin Login:
Username:
Password:
Name:
Building a data processing pipeline in Python
--client
big_apple_py
--show
pygotham_2015
--room room704 10011 --force
Next: 11 Why doesn’t anyone use my library?
show more...
Marks
Author(s):
Joe Cabrera
Location
Room 704
Date
aug Sat 15
Days Raw Files
Start
13:15
First Raw Start
13:14
Duration
00:25:00
Offset
0:00:26
End
13:40
Last Raw End
13:46
Chapters
00:00
Total cuts_time
24 min.
https://pygotham.org/2015/talks/202/building-a-data-processing-pipeline-in-python
raw-playlist
raw-mp4-playlist
encoded-files-playlist
host
public
tweet
mp4
svg
png
assets
release.pdf
Building_a_data_processing_pipeline_in_Python.json
logs
Admin:
episode
episode list
cut list
raw files day
marks day
marks day
image_files
State:
---------
borked
edit
encode
push to queue
post
richard
review 1
email
review 2
make public
tweet
to-miror
conf
done
Locked:
clear this to unlock
Locked by:
user/process that locked.
Start:
initially scheduled time from master, adjusted to match reality
Duration:
length in hh:mm:ss
Name:
Video Title (shows in video search results)
Emails:
email(s) of the presenter(s)
Released:
has someone authorised pubication
Unknown
Yes
No
Normalise:
Channelcopy:
m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:
filename.png
Description:
markdown
Recently, the growth of publicly available data has been enormous. Python has a number of libraries and tool to aid you in building your data processing pipeline. These tools include Celery, Requests, BeautifulSoup and SQL-Alchemy. When combined together you can build an efficient and scalable data processing pipeline.
Comment:
production notes
2015-08-14/23_44_34.dv
Apply:
13:14:34 - 13:15:39 ( 00:01:05 )
S:
13:14:34 -
E:
13:15:39
D:
00:01:05
show more...
vlc ~/Videos/veyepar/big_apple_py/pygotham_2015/dv/room704/2015-08-14/23_44_34.dv :start-time=00.0 --audio-desync=0
Raw File
Cut List
13:14:34
seconds: 0.0
Wall: 13:14:34
Duration
00:01:05
13:15:39
seconds: 0.0
Wall: 13:14:34
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2015-08-14/23_45_40.dv
Apply:
13:15:40 - 13:39:47 ( 00:24:07 )
S:
13:15:40 -
E:
13:39:47
D:
00:24:07
show more...
vlc ~/Videos/veyepar/big_apple_py/pygotham_2015/dv/room704/2015-08-14/23_45_40.dv :start-time=00.0 --audio-desync=0
Raw File
Cut List
13:15:40
seconds: 0.0
Wall: 13:15:40
Duration
00:24:07
13:39:47
seconds: 0.0
Wall: 13:15:40
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2015-08-15/00_09_48.dv
Apply:
13:39:48 - 13:46:25 ( 00:06:37 )
S:
13:39:48 -
E:
13:46:25
D:
00:06:37
show more...
vlc ~/Videos/veyepar/big_apple_py/pygotham_2015/dv/room704/2015-08-15/00_09_48.dv :start-time=00.0 --audio-desync=0
Raw File
Cut List
13:39:48
seconds: 0.0
Wall: 13:39:48
Duration
00:06:37
13:46:25
seconds: 0.0
Wall: 13:39:48
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
Rf filename:
root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:
check and save to add this
2015-08-14/23_44_34.dv
2015-08-14/23_45_40.dv
2015-08-15/00_09_48.dv
Veyepar
Video Eyeball Processor and Review