Hi
user
Admin Login:
Username:
Password:
Name:
Go with the Flow: Automating Your Workflows with Airflow
--client
pyohio
--show
pyohio_2018
--room cartoon1 14177 --force
Next: 11 Large-Scale Recommendation System with Python and Spark
show more...
Marks
Author(s):
Leo Guinan
Location
Cartoon 1
Date
jul Sat 28
Days Raw Files
Start
11:15
First Raw Start
10:43
Duration
0:30:0
Offset
0:31:09
End
11:45
Last Raw End
12:13
Chapters
00:00
Total cuts_time
25 min.
https://pyohio.org/2018/schedule/presentation/47/
raw-playlist
raw-mp4-playlist
encoded-files-playlist
host
archive
tweet
mp4
svg
png
assets
release.pdf
Go_with_the_Flow_Automating_Your_Workflows_with_Airflow.json
logs
Admin:
episode
episode list
cut list
raw files day
marks day
marks day
image_files
State:
---------
borked
edit
encode
push to queue
post
richard
review 1
email
review 2
make public
tweet
to-miror
conf
done
Locked:
clear this to unlock
Locked by:
user/process that locked.
Start:
initially scheduled time from master, adjusted to match reality
Duration:
length in hh:mm:ss
Name:
Video Title (shows in video search results)
Emails:
email(s) of the presenter(s)
Released:
has someone authorised pubication
Unknown
Yes
No
Normalise:
Channelcopy:
m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:
filename.png
Description:
markdown
Apache Airflow is an open-source Python project that, in the words of Apache, "is a platform to programmatically author, schedule and monitor workflows.". In this talk, I will focus on the basics of Airflow: what is it, and what can it do for me? In a nutshell, Airflow is a library for workflow management. The most common uses of Airflow revolve around data pipelines and processing, e.g. ETL pipes, but in reality, it can be used for pretty much any workflow that has discrete steps which can be performed independently. In addition, the scheduling capabilities of Airflow provide a high powered replacement for cron tables. I will discuss how to set up workflows, connect to other systems, and leverage the automation power of Airflow. Concepts covered will include DAGs, Operators, and Hooks. Finally, I will share some gotchas that I have come across while setting up my own workflows.
Comment:
production notes
delay=1.0
2018-07-28/10_43_51.ts
Apply:
10:43:51 - 11:01:16 ( 00:17:25 )
S:
10:43:51 -
E:
11:13:51
D:
00:30:00
(
End:
1045.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/cartoon1/2018-07-28/10_43_51.ts :start-time=00.0 --audio-desync=0
Raw File
Cut List
10:43:51
seconds: 0.0
Wall: 10:43:51
Duration
00:30:00
11:13:51
seconds: 1045.0
Wall: 11:01:16
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/10_43_51.ts
Apply:
11:01:16 - 11:02:32 ( 00:01:16 )
S:
10:43:51 -
E:
11:13:51
D:
00:30:00
(
Start:
1045.0) (
End:
1121.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/cartoon1/2018-07-28/10_43_51.ts :start-time=01045.0 --audio-desync=0
Raw File
Cut List
10:43:51
seconds: 1045.0
Wall: 11:01:16
Duration
00:30:00
11:13:51
seconds: 1121.0
Wall: 11:02:32
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/10_43_51.ts
Apply:
11:02:32 - 11:13:51 ( 00:11:19 )
S:
10:43:51 -
E:
11:13:51
D:
00:30:00
(
Start:
1121.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/cartoon1/2018-07-28/10_43_51.ts :start-time=01121.0 --audio-desync=0
Raw File
Cut List
10:43:51
seconds: 1121.0
Wall: 11:02:32
Duration
00:30:00
11:13:51
seconds: 0.0
Wall: 10:43:51
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/11_13_51.ts
Apply:
11:13:51 - 11:14:47 ( 00:00:56 )
S:
11:13:51 -
E:
11:43:51
D:
00:30:00
(
End:
56.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/cartoon1/2018-07-28/11_13_51.ts :start-time=00.0 --audio-desync=0
Raw File
Cut List
11:13:51
seconds: 0.0
Wall: 11:13:51
Duration
00:30:00
11:43:51
seconds: 56.0
Wall: 11:14:47
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/11_13_51.ts
Apply:
11:14:47 - 11:14:50 ( 00:00:03 )
S:
11:13:51 -
E:
11:43:51
D:
00:30:00
(
Start:
56.0) (
End:
59.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/cartoon1/2018-07-28/11_13_51.ts :start-time=056.0 --audio-desync=0
Raw File
Cut List
11:13:51
seconds: 56.0
Wall: 11:14:47
Duration
00:30:00
11:43:51
seconds: 59.0
Wall: 11:14:50
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/11_13_51.ts
Apply:
11:14:50 - 11:40:32 ( 00:25:42 )
S:
11:13:51 -
E:
11:43:51
D:
00:30:00
(
Start:
59.0) (
End:
1601.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/cartoon1/2018-07-28/11_13_51.ts :start-time=059.0 --audio-desync=0
Raw File
Cut List
11:13:51
seconds: 59.0
Wall: 11:14:50
Duration
00:30:00
11:43:51
seconds: 1601.0
Wall: 11:40:32
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/11_13_51.ts
Apply:
11:40:32 - 11:43:51 ( 00:03:19 )
S:
11:13:51 -
E:
11:43:51
D:
00:30:00
(
Start:
1601.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/cartoon1/2018-07-28/11_13_51.ts :start-time=01601.0 --audio-desync=0
Raw File
Cut List
11:13:51
seconds: 1601.0
Wall: 11:40:32
Duration
00:30:00
11:43:51
seconds: 0.0
Wall: 11:13:51
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/11_43_51.ts
Apply:
11:43:51 - 11:59:34 ( 00:15:43 )
S:
11:43:51 -
E:
12:13:50
D:
00:29:59
(
End:
943.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/cartoon1/2018-07-28/11_43_51.ts :start-time=00.0 --audio-desync=0
Raw File
Cut List
11:43:51
seconds: 0.0
Wall: 11:43:51
Duration
00:29:59
12:13:50
seconds: 943.0
Wall: 11:59:34
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/11_43_51.ts
Apply:
11:59:34 - 11:59:38 ( 00:00:04 )
S:
11:43:51 -
E:
12:13:50
D:
00:29:59
(
Start:
943.0) (
End:
947.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/cartoon1/2018-07-28/11_43_51.ts :start-time=0943.0 --audio-desync=0
Raw File
Cut List
11:43:51
seconds: 943.0
Wall: 11:59:34
Duration
00:29:59
12:13:50
seconds: 947.0
Wall: 11:59:38
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/11_43_51.ts
Apply:
11:59:38 - 12:13:50 ( 00:14:12 )
S:
11:43:51 -
E:
12:13:50
D:
00:29:59
(
Start:
947.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/cartoon1/2018-07-28/11_43_51.ts :start-time=0947.0 --audio-desync=0
Raw File
Cut List
11:43:51
seconds: 947.0
Wall: 11:59:38
Duration
00:29:59
12:13:50
seconds: 0.0
Wall: 11:43:51
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
Rf filename:
root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:
check and save to add this
2018-07-28/10_43_51.ts
2018-07-28/11_13_51.ts
2018-07-28/11_43_51.ts
Veyepar
Video Eyeball Processor and Review