veyepar: Python and HDF5 - Fast Storage for Large Data

Hi user

Admin Login:

Name: Python and HDF5 - Fast Storage for Large Data
--client psf --show pycon_2012 --room E2 762 --force
Prev: 6 Hand Coded Applications with SQLAlchemy
Next: 6 Storm: the Hadoop of Realtime Stream Processing

show more...

Author(s):	Mike Müller
Location	Track III (E2)
Date	mar Sat 10	Days Raw Files
Start	13:35	First Raw Start	13:30
Duration	00:40:00	Offset	0:04:29
End	14:15	Last Raw End	14:49
Chapters	00:00
Total cuts_time	26 min.

http://us.pycon.org/2012/schedule/presentation/231/
raw-playlist raw-mp4-playlist encoded-files-playlist host public mp4 svg png

final audio

assets release.pdf Python_and_HDF5_Fast_Storage_for_Large_Data.json
logs
Admin: episode episode list cut list raw files day marks day marks day image_files

State:
Locked:	clear this to unlock
Locked by:	user/process that locked.
Start:	initially scheduled time from master, adjusted to match reality
Duration:	length in hh:mm:ss
Name:	Video Title (shows in video search results)
Emails:	email(s) of the presenter(s)
Released:	has someone authorised pubication
Normalise:
Channelcopy:	m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:	filename.png
Description:	The presentation introduces the possibilities to use HDF5 (Hierarchical Data Format) from Python. HDF5 is one of the fastest ways to store large amounts of numerical data. The talk is for scientist who would like to store their measured or calculated data as well as for programmers who are interested in non-relational data storage. markdown
Comment:	<?xml version='1.0' encoding='UTF-8'?> <ns0:entry xmlns:ns0="http://www.w3.org/2005/Atom" xmlns:ns1="http://schemas.google.com/g/2005" xmlns:ns2="http://search.yahoo.com/mrss/" xmlns:ns3="http://gdata.youtube.com/schemas/2007" xmlns:ns4="http://purl.org/atom/app#"><ns0:category scheme="http://schemas.google.com/g/2005#kind" term="http://gdata.youtube.com/schemas/2007#video" /><ns0:category label="Education" scheme="http://gdata.youtube.com/schemas/2007/categories.cat" term="Education" /><ns0:category scheme="http://gdata.youtube.com/schemas/2007/keywords.cat" term="psf" /><ns0:category scheme="http://gdata.youtube.com/schemas/2007/keywords.cat" term="python pycon pycon2012" /><ns0:category scheme="http://gdata.youtube.com/schemas/2007/keywords.cat" term="pycon_2012" /><ns0:category scheme="http://gdata.youtube.com/schemas/2007/keywords.cat" term="MikeMüller" /><ns0:id>http://gdata.youtube.com/feeds/api/videos/hnhN2_TpY8g</ns0:id><ns0:author><ns0:name>NextDayVideo</ns0:name><ns0:uri>https://gdata.youtube.com/feeds/api/users/NextDayVideo</ns0:uri></ns0:author><ns0:content type="text">Mike Müller The presentation introduces the possibilities to use HDF5 (Hierarchical Data Format) from Python. HDF5 is one of the fastest ways to store large amounts of numerical data. The talk is for scientist who would like to store their measu</ns0:content><ns0:updated>2012-03-12T05:09:16.000Z</ns0:updated><ns0:published>2012-03-12T05:09:16.000Z</ns0:published><ns1:comments><ns1:feedLink countHint="0" href="https://gdata.youtube.com/feeds/api/videos/hnhN2_TpY8g/comments?client=ndv" rel="http://gdata.youtube.com/schemas/2007#comments" /></ns1:comments><ns2:group><ns2:keywords>psf, python pycon pycon2012, pycon_2012, MikeMüller</ns2:keywords><ns2:description type="plain">Mike Müller The presentation introduces the possibilities to use HDF5 (Hierarchical Data Format) from Python. HDF5 is one of the fastest ways to store large amounts of numerical data. The talk is for scientist who would like to store their measu</ns2:description><ns2:title type="plain">Python and HDF5 - Fast Storage for Large Data</ns2:title><ns3:duration seconds="0" /><ns2:content duration="0" expression="full" isDefault="true" medium="video" type="application/x-shockwave-flash" url="https://www.youtube.com/v/hnhN2_TpY8g?version=3&f=user_uploads&c=ndv&d=Aarb2r5skm2_yNTuKEinXdAO88HsQjpE1a8d1GxQnGDm&app=youtube_gdata" ns3:format="5" /><ns2:thumbnail height="360" time="00:00:00" url="http://i.ytimg.com/vi/hnhN2_TpY8g/0.jpg" width="480" /><ns2:thumbnail height="90" time="00:00:00" url="http://i.ytimg.com/vi/hnhN2_TpY8g/1.jpg" width="120" /><ns2:thumbnail height="90" time="00:00:00" url="http://i.ytimg.com/vi/hnhN2_TpY8g/2.jpg" width="120" /><ns2:thumbnail height="90" time="00:00:00" url="http://i.ytimg.com/vi/hnhN2_TpY8g/3.jpg" width="120" /><ns2:category label="Education" scheme="http://gdata.youtube.com/schemas/2007/categories.cat">Education</ns2:category><ns2:category scheme="http://gdata.youtube.com/schemas/2007/developertags.cat">psf</ns2:category><ns2:category scheme="http://gdata.youtube.com/schemas/2007/developertags.cat">python pycon pycon2012</ns2:category><ns2:category scheme="http://gdata.youtube.com/schemas/2007/developertags.cat">pycon_2012</ns2:category><ns2:category scheme="http://gdata.youtube.com/schemas/2007/developertags.cat">MikeMüller</ns2:category><ns2:player url="https://www.youtube.com/watch?v=hnhN2_TpY8g&feature=youtube_gdata_player" /></ns2:group><ns0:title type="text">Python and HDF5 - Fast Storage for Large Data</ns0:title><ns4:control><ns4:draft>yes</ns4:draft><ns3:state name="processing" /></ns4:control><ns0:link href="https://www.youtube.com/watch?v=hnhN2_TpY8g&feature=youtube_gdata" rel="alternate" type="text/html" /><ns0:link href="https://gdata.youtube.com/feeds/api/videos/hnhN2_TpY8g/responses?client=ndv" rel="http://gdata.youtube.com/schemas/2007#video.responses" type="application/atom+xml" /><ns0:link href="https://gdata.youtube.com/feeds/api/videos/hnhN2_TpY8g/ratings?client=ndv" rel="http://gdata.youtube.com/schemas/2007#video.ratings" type="application/atom+xml" /><ns0:link href="https://gdata.youtube.com/feeds/api/videos/hnhN2_TpY8g/complaints?client=ndv" rel="http://gdata.youtube.com/schemas/2007#video.complaints" type="application/atom+xml" /><ns0:link href="https://gdata.youtube.com/feeds/api/videos/hnhN2_TpY8g/related?client=ndv" rel="http://gdata.youtube.com/schemas/2007#video.related" type="application/atom+xml" /><ns0:link href="https://gdata.youtube.com/feeds/api/users/nextdayvideo/uploads/hnhN2_TpY8g?client=ndv" rel="self" type="application/atom+xml" /><ns0:link href="https://gdata.youtube.com/feeds/api/users/nextdayvideo/uploads/hnhN2_TpY8g?client=ndv" rel="edit" type="application/atom+xml" /></ns0:entry> production notes

2012-03-10/13:30:31.dv Apply: 13:30:31 - 13:36:12 ( 00:05:41 ) S: 13:30:31 - E: 13:36:12 D: 00:05:41 show more...

vlc ~/Videos/veyepar/psf/pycon_2012/dv/E2/2012-03-10/13:30:31.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	13:30:31		seconds: 0.0 Wall: 13:30:31
Duration	00:05:41
	13:36:12		seconds: 0.0 Wall: 13:30:31
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2012-03-10/13:36:13.dv Apply: 13:36:13 - 14:02:18 ( 00:26:05 ) S: 13:36:13 - E: 14:02:27 D: 00:26:14 (End: 00:26:05) show more...

vlc ~/Videos/veyepar/psf/pycon_2012/dv/E2/2012-03-10/13:36:13.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	13:36:13		seconds: 0.0 Wall: 13:36:13
Duration	00:26:14
	14:02:27		seconds: 1565.0 Wall: 14:02:18
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2012-03-10/14:02:28.dv Apply: 14:02:28 - 14:02:48 ( 00:00:20 ) S: 14:02:28 - E: 14:02:48 D: 00:00:20 show more...

vlc ~/Videos/veyepar/psf/pycon_2012/dv/E2/2012-03-10/14:02:28.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	14:02:28		seconds: 0.0 Wall: 14:02:28
Duration	00:00:20
	14:02:48		seconds: 0.0 Wall: 14:02:28
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2012-03-10/14:02:49.dv Apply: 14:02:49 - 14:08:59 ( 00:06:10 ) S: 14:02:49 - E: 14:08:59 D: 00:06:10 show more...

vlc ~/Videos/veyepar/psf/pycon_2012/dv/E2/2012-03-10/14:02:49.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	14:02:49		seconds: 0.0 Wall: 14:02:49
Duration	00:06:10
	14:08:59		seconds: 0.0 Wall: 14:02:49
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2012-03-10/14:10:30.dv Apply: 14:10:30 - 14:14:12 ( 00:03:42 ) S: 14:10:30 - E: 14:14:12 D: 00:03:42 show more...

vlc ~/Videos/veyepar/psf/pycon_2012/dv/E2/2012-03-10/14:10:30.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	14:10:30		seconds: 0.0 Wall: 14:10:30
Duration	00:03:42
	14:14:12		seconds: 0.0 Wall: 14:10:30
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2012-03-10/14:14:13.dv Apply: 14:14:13 - 14:14:43 ( 00:00:30 ) S: 14:14:13 - E: 14:14:43 D: 00:00:30 show more...

vlc ~/Videos/veyepar/psf/pycon_2012/dv/E2/2012-03-10/14:14:13.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	14:14:13		seconds: 0.0 Wall: 14:14:13
Duration	00:00:30
	14:14:43		seconds: 0.0 Wall: 14:14:13
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2012-03-10/14:14:44.dv Apply: 14:14:44 - 14:49:03 ( 00:34:19 ) S: 14:14:44 - E: 14:49:03 D: 00:34:19 show more...

vlc ~/Videos/veyepar/psf/pycon_2012/dv/E2/2012-03-10/14:14:44.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	14:14:44		seconds: 0.0 Wall: 14:14:44
Duration	00:34:19
	14:49:03		seconds: 0.0 Wall: 14:14:44
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

Rf filename:	root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:	check and save to add this

2012-03-10/13:30:31.dv
audio viz

audio viz

2012-03-10/13:36:13.dv
audio viz

audio viz

2012-03-10/14:02:28.dv
audio viz

audio viz

2012-03-10/14:02:49.dv
audio viz

audio viz

2012-03-10/14:10:30.dv
audio viz

audio viz

2012-03-10/14:14:13.dv
audio viz

audio viz

2012-03-10/14:14:44.dv
audio viz

audio viz

Veyepar Video Eyeball Processor and Review