Hi
user
Admin Login:
Username:
Password:
Name:
Python Profiling and Performance Tuning in Production
--client
lca
--show
lca2017
--room tasman_bc 12132 --force
Next: 12 GPU Accelerated JPEG Rendering
show more...
Marks
Author(s):
Joe Gordon
Location
Tasman Hall B/C
Date
jan Wed 18
Days Raw Files
Start
21:15
First Raw Start
20:58
Duration
0:45:0
Offset
0:16:21
End
22:00
Last Raw End
22:28
Chapters
00:00
0:13:31
Total cuts_time
34 min.
http://linux.conf.au/schedule/presentation/62/
raw-playlist
raw-mp4-playlist
encoded-files-playlist
host
archive
tweet
mp4
svg
png
assets
release.pdf
Python_Profiling_and_Performance_Tuning_in_Production.json
logs
Admin:
episode
episode list
cut list
raw files day
marks day
marks day
image_files
State:
---------
borked
edit
encode
push to queue
post
richard
review 1
email
review 2
make public
tweet
to-miror
conf
done
Locked:
clear this to unlock
Locked by:
user/process that locked.
Start:
initially scheduled time from master, adjusted to match reality
Duration:
length in hh:mm:ss
Name:
Video Title (shows in video search results)
Emails:
email(s) of the presenter(s)
Released:
has someone authorised pubication
Unknown
Yes
No
Normalise:
Channelcopy:
m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:
filename.png
Description:
markdown
Pinterest decreased latency and shrunk their front-end fleet by over 40% with less than 100 lines of python. This was done by understanding how a significant amount of latency and consumed resources were the result of gevent’s cooperative multitasking. 3 different open source python profilers, were then used together to identify and fix bottlenecks and inefficiencies in the code base. Most profilers are too slow to use in production, so profiling of web servers often occurs in synthetic environments. But to get an accurate picture of what is happening you need production profiling data, so a production ready Linux signal (SIGVTALRM) based python profiler was used. This talk will cover how Pinterest shrunk their front-end fleet, the techniques and tooling used to improve performance and how they can be applied elsewhere.
Comment:
production notes
2017-01-19/13_58_39.ts
Apply:
20:58:39 - 21:06:06 ( 00:07:27 )
S:
20:58:39 -
E:
21:28:39
D:
00:30:00
(
End:
447.0)
show more...
vlc ~/Videos/veyepar/lca/lca2017/dv/tasman_bc/2017-01-19/13_58_39.ts :start-time=00.0 --audio-desync=0
Raw File
Cut List
20:58:39
seconds: 0.0
Wall: 20:58:39
Duration
00:30:00
21:28:39
seconds: 447.0
Wall: 21:06:06
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2017-01-19/13_58_39.ts
Apply:
21:06:06 - 21:12:52 ( 00:06:46 )
S:
20:58:39 -
E:
21:28:39
D:
00:30:00
(
Start:
447.0) (
End:
853.0)
show more...
vlc ~/Videos/veyepar/lca/lca2017/dv/tasman_bc/2017-01-19/13_58_39.ts :start-time=0447.0 --audio-desync=0
Raw File
Cut List
20:58:39
seconds: 447.0
Wall: 21:06:06
Duration
00:30:00
21:28:39
seconds: 853.0
Wall: 21:12:52
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2017-01-19/13_58_39.ts
Apply:
21:12:52 - 21:14:55 ( 00:02:03 )
S:
20:58:39 -
E:
21:28:39
D:
00:30:00
(
Start:
853.0) (
End:
976.0)
show more...
vlc ~/Videos/veyepar/lca/lca2017/dv/tasman_bc/2017-01-19/13_58_39.ts :start-time=0853.0 --audio-desync=0
Raw File
Cut List
20:58:39
seconds: 853.0
Wall: 21:12:52
Duration
00:30:00
21:28:39
seconds: 976.0
Wall: 21:14:55
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2017-01-19/13_58_39.ts
Apply:
21:14:55 - 21:15:08 ( 00:00:13 )
S:
20:58:39 -
E:
21:28:39
D:
00:30:00
(
Start:
976.0) (
End:
989.0)
show more...
vlc ~/Videos/veyepar/lca/lca2017/dv/tasman_bc/2017-01-19/13_58_39.ts :start-time=0976.0 --audio-desync=0
Raw File
Cut List
20:58:39
seconds: 976.0
Wall: 21:14:55
Duration
00:30:00
21:28:39
seconds: 989.0
Wall: 21:15:08
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2017-01-19/13_58_39.ts
Apply:
21:15:08 - 21:28:39 ( 00:13:31 )
S:
20:58:39 -
E:
21:28:39
D:
00:30:00
(
Start:
989.0)
show more...
vlc ~/Videos/veyepar/lca/lca2017/dv/tasman_bc/2017-01-19/13_58_39.ts :start-time=0989.0 --audio-desync=0
Raw File
Cut List
20:58:39
seconds: 989.0
Wall: 21:15:08
Duration
00:30:00
21:28:39
seconds: 0.0
Wall: 20:58:39
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2017-01-19/14_28_39.ts
Apply:
21:28:39 - 21:49:31 ( 00:20:52 )
S:
21:28:39 -
E:
21:58:38
D:
00:29:59
(
End:
1252.0)
show more...
vlc ~/Videos/veyepar/lca/lca2017/dv/tasman_bc/2017-01-19/14_28_39.ts :start-time=00.0 --audio-desync=0
Raw File
Cut List
21:28:39
seconds: 0.0
Wall: 21:28:39
Duration
00:29:59
21:58:38
seconds: 1252.0
Wall: 21:49:31
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2017-01-19/14_28_39.ts
Apply:
21:49:31 - 21:58:38 ( 00:09:07 )
S:
21:28:39 -
E:
21:58:38
D:
00:29:59
(
Start:
1252.0)
show more...
vlc ~/Videos/veyepar/lca/lca2017/dv/tasman_bc/2017-01-19/14_28_39.ts :start-time=01252.0 --audio-desync=0
Raw File
Cut List
21:28:39
seconds: 1252.0
Wall: 21:49:31
Duration
00:29:59
21:58:38
seconds: 0.0
Wall: 21:28:39
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2017-01-19/14_58_39.ts
Apply:
21:58:39 - 22:28:38 ( 00:29:59 )
S:
21:58:39 -
E:
22:28:38
D:
00:29:59
show more...
vlc ~/Videos/veyepar/lca/lca2017/dv/tasman_bc/2017-01-19/14_58_39.ts :start-time=00.0 --audio-desync=0
Raw File
Cut List
21:58:39
seconds: 0.0
Wall: 21:58:39
Duration
00:29:59
22:28:38
seconds: 0.0
Wall: 21:58:39
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
Rf filename:
root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:
check and save to add this
2017-01-19/13_58_39.ts
2017-01-19/14_28_39.ts
2017-01-19/14_58_39.ts
Veyepar
Video Eyeball Processor and Review