veyepar: Handling Big Data with Python

Hi user

Admin Login:

Name: Handling Big Data with Python
--client pyconde --show pyconde2013 --room KOMED_Saal 2781 --force
Prev: 11 MapReduce mit Disco
Next: 11 Was Sie schon immer über „Visualisierung mit Python“ wissen wollten

show more...

Author(s):	Florian Wilhelm
Location	KOMED Saal
Date	oct Thu 17	Days Raw Files
Start	15:30	First Raw Start	15:29
Duration	00:30.0:00	Offset	0:00:23
End	16:00	Last Raw End	16:01
Chapters	00:00 0:20:48 0:20:56
Total cuts_time	28 min.

https://2013.de.pycon.org/schedule/sessions/2/
raw-playlist raw-mp4-playlist encoded-files-playlist host public tweet mp4 svg png

final audio

assets release.pdf Handling_Big_Data_with_Python.json
logs
Admin: episode episode list cut list raw files day marks day marks day image_files

State:
Locked:	clear this to unlock
Locked by:	user/process that locked.
Start:	initially scheduled time from master, adjusted to match reality
Duration:	length in hh:mm:ss
Name:	Video Title (shows in video search results)
Emails:	email(s) of the presenter(s)
Released:	has someone authorised pubication
Normalise:
Channelcopy:	m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:	filename.png
Description:	The talk gives a small introduction of how Blue Yonder applies machine learning and Predictive Analytics in various fields as well as the challenges of Big Data. Using the example of Blue Yonder's machine learning software NeuroBayes, we show the made efforts and hit dead ends in order to provide a flexible and yet easy to use interface for NeuroBayes to Data Scientists. Since NeuroBayes is written in FORTRAN for performance reasons different interface approaches were tried which lead us eventually to a Python interface. In the talk we elaborate on the up- and downsides of the different approaches and the various reasons why Python won the race with an emphasize on the benefits of the Python ecosystem itself. Also, we discuss performance as well as scalability issues with Python and how we address them. In detail, we show the application of Cython to speed up calculations in the Python interface layer as well as distributed computing in a private cloud called Stratosphere. Scalability and efficiency is of utmost importance when data processing is time critical. Our overall goal is to give the audience an overview how Python fits in the software ecosystem of a company handling Big Data. markdown
Comment:	production notes

2013-10-17/15_29_37.dv Apply: 15:29:37 - 15:50:25 ( 00:20:48 ) S: 15:29:37 - E: 15:50:25 D: 00:20:48 show more...

vlc ~/Videos/veyepar/pyconde/pyconde2013/dv/KOMED_Saal/2013-10-17/15_29_37.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	15:29:37		seconds: 0.0 Wall: 15:29:37
Duration	00:20:48
	15:50:25		seconds: 0.0 Wall: 15:29:37
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2013-10-17/15_50_26.dv Apply: 15:50:26 - 15:50:34 ( 00:00:08 ) S: 15:50:26 - E: 15:50:34 D: 00:00:08 show more...

vlc ~/Videos/veyepar/pyconde/pyconde2013/dv/KOMED_Saal/2013-10-17/15_50_26.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	15:50:26		seconds: 0.0 Wall: 15:50:26
Duration	00:00:08
	15:50:34		seconds: 0.0 Wall: 15:50:26
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2013-10-17/15_50_34.dv Apply: 15:50:34 - 15:57:47 ( 00:07:13 ) S: 15:50:34 - E: 15:57:47 D: 00:07:13 show more...

vlc ~/Videos/veyepar/pyconde/pyconde2013/dv/KOMED_Saal/2013-10-17/15_50_34.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	15:50:34		seconds: 0.0 Wall: 15:50:34
Duration	00:07:13
	15:57:47		seconds: 0.0 Wall: 15:50:34
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2013-10-17/15_57_48.dv Apply: 15:57:48 - 16:01:30 ( 00:03:42 ) S: 15:57:48 - E: 16:01:30 D: 00:03:42 show more...

vlc ~/Videos/veyepar/pyconde/pyconde2013/dv/KOMED_Saal/2013-10-17/15_57_48.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	15:57:48		seconds: 0.0 Wall: 15:57:48
Duration	00:03:42
	16:01:30		seconds: 0.0 Wall: 15:57:48
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

Rf filename:	root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:	check and save to add this

2013-10-17/15_29_37.dv
audio viz

audio viz

2013-10-17/15_50_26.dv
audio viz

audio viz

2013-10-17/15_50_34.dv
audio viz

audio viz

2013-10-17/15_57_48.dv
audio viz

audio viz

Veyepar Video Eyeball Processor and Review