veyepar: Python (and Fortran and C) as used in large-scale number crunching and scientific programming

Hi user

Admin Login:

Name: Python (and Fortran and C) as used in large-scale number crunching and scientific programming
--client nbpy --show nbpy17 --room mystic 12685 --force
Prev: 11 Async for the Python 2 Programmer
Next: 11 Stumbling Through Django and How Not To

show more...

Author(s):	Catherine Moroney
Location	Mystic Theatre
Date	dec Sat 02	Days Raw Files
Start	15:00	First Raw Start	14:34
Duration	0:45:0	Offset	0:25:09
End	15:45	Last Raw End	16:04
Chapters	00:00 0:17:29
Total cuts_time	29 min.

https://2017.northbaypython.org/schedule/presentation/24/
raw-playlist raw-mp4-playlist encoded-files-playlist host archive tweet mp4 svg png

final audio

assets release.pdf Python_and_Fortran_and_C_as_used_in_largescale_number_crunching_and_scientific_programming.json
logs
Admin: episode episode list cut list raw files day marks day marks day image_files

State:
Locked:	clear this to unlock
Locked by:	user/process that locked.
Start:	initially scheduled time from master, adjusted to match reality
Duration:	length in hh:mm:ss
Name:	Video Title (shows in video search results)
Emails:	email(s) of the presenter(s)
Released:	has someone authorised pubication
Normalise:
Channelcopy:	m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:	filename.png
Description:	Python is an incredibly powerful and versatile language, but it is not practical for lots of deeply nested loops because it's not compiled, and a lot of the big scientific libraries only have C interfaces. But, if you bring Fortran (via f2py) and C (Cython) into the mix then you can use the best features of all three languages and shrink your development/maintenance time and resulting code size by almost an order of magnitude. My satellite has a lot of legacy code in a Perl/C/Fortran mixture that is incredibly difficult to read and maintain, but our new software is in a Python/C/Fortran mixture (with Python being the bulk of the code) that is a fraction of the size of the old code, much much easier to develop and maintain, yet it has the speed and stability to be used in our production system. I use Python for the upper and middle layers, Fortran for the few places where I need to do lots of looping that cannot be transformed into whole-array operations, and then C to interface with the various 3rd party libraries. I can wrap Fortran and C using f2py and Cython respectively, call them directly from the Python, and pass numpy arrays back and forth seamlessly. I also have layers of scripts: a Python code to run a single orbit's worth of data through a single stage of the processing pipeline, a second Python script to run multiple orbits through a single stage, and then a third script that runs the entire processing chain through many orbits, thereby using Python's numerous scripting capabilities. By using all three languages as described above, I truly get the best of all worlds: dramatically reduced development time, a code base that is a fraction of the size of the old legacy system, yet all the speed and stability I need to process huge amounts of data. markdown
Comment:	production notes

2017-12-02/14_34_51.ts Apply: 14:34:51 - 14:48:39 ( 00:13:48 ) S: 14:34:51 - E: 15:04:51 D: 00:30:00 (End: 828.0) show more...

vlc ~/Videos/veyepar/nbpy/nbpy17/dv/mystic/2017-12-02/14_34_51.ts :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	14:34:51		seconds: 0.0 Wall: 14:34:51
Duration	00:30:00
	15:04:51		seconds: 828.0 Wall: 14:48:39
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2017-12-02/14_34_51.ts Apply: 14:48:39 - 14:53:53 ( 00:05:14 ) S: 14:34:51 - E: 15:04:51 D: 00:30:00 (Start: 828.0) (End: 1142.0) show more...

vlc ~/Videos/veyepar/nbpy/nbpy17/dv/mystic/2017-12-02/14_34_51.ts :start-time=0828.0 --audio-desync=0

	Raw File	Cut List
	14:34:51		seconds: 828.0 Wall: 14:48:39
Duration	00:30:00
	15:04:51		seconds: 1142.0 Wall: 14:53:53
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2017-12-02/14_34_51.ts Apply: 14:53:53 - 15:04:51 ( 00:10:58 ) S: 14:34:51 - E: 15:04:51 D: 00:30:00 (Start: 1142.0) show more...

vlc ~/Videos/veyepar/nbpy/nbpy17/dv/mystic/2017-12-02/14_34_51.ts :start-time=01142.0 --audio-desync=0

	Raw File	Cut List
	14:34:51		seconds: 1142.0 Wall: 14:53:53
Duration	00:30:00
	15:04:51		seconds: 0.0 Wall: 14:34:51
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2017-12-02/15_04_51.ts Apply: 15:04:51 - 15:11:58 ( 00:07:07 ) S: 15:04:51 - E: 15:34:50 D: 00:29:59 (End: 427.0) show more...

vlc ~/Videos/veyepar/nbpy/nbpy17/dv/mystic/2017-12-02/15_04_51.ts :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	15:04:51		seconds: 0.0 Wall: 15:04:51
Duration	00:29:59
	15:34:50		seconds: 427.0 Wall: 15:11:58
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2017-12-02/15_04_51.ts Apply: 15:11:58 - 15:16:31 ( 00:04:33 ) S: 15:04:51 - E: 15:34:50 D: 00:29:59 (Start: 427.0) (End: 700.0) show more...

vlc ~/Videos/veyepar/nbpy/nbpy17/dv/mystic/2017-12-02/15_04_51.ts :start-time=0427.0 --audio-desync=0

	Raw File	Cut List
	15:04:51		seconds: 427.0 Wall: 15:11:58
Duration	00:29:59
	15:34:50		seconds: 700.0 Wall: 15:16:31
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2017-12-02/15_04_51.ts Apply: 15:16:31 - 15:17:21 ( 00:00:50 ) S: 15:04:51 - E: 15:34:50 D: 00:29:59 (Start: 700.0) (End: 750.0) show more...

vlc ~/Videos/veyepar/nbpy/nbpy17/dv/mystic/2017-12-02/15_04_51.ts :start-time=0700.0 --audio-desync=0

	Raw File	Cut List
	15:04:51		seconds: 700.0 Wall: 15:16:31
Duration	00:29:59
	15:34:50		seconds: 750.0 Wall: 15:17:21
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2017-12-02/15_04_51.ts Apply: 15:17:21 - 15:34:50 ( 00:17:29 ) S: 15:04:51 - E: 15:34:50 D: 00:29:59 (Start: 750.0) show more... TS=05:10:59.874 Catherine Moroney comes to us

vlc ~/Videos/veyepar/nbpy/nbpy17/dv/mystic/2017-12-02/15_04_51.ts :start-time=0750.0 --audio-desync=0

	Raw File	Cut List
	15:04:51		seconds: 750.0 Wall: 15:17:21
Duration	00:29:59
	15:34:50		seconds: 0.0 Wall: 15:04:51
Comments:		TS=05:10:59.874 Catherine Moroney comes to us
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2017-12-02/15_34_51.ts Apply: 15:34:51 - 15:46:27 ( 00:11:36 ) S: 15:34:51 - E: 16:04:50 D: 00:29:59 (End: 696.0) show more... TE=05:40:07.620 Catherine.

vlc ~/Videos/veyepar/nbpy/nbpy17/dv/mystic/2017-12-02/15_34_51.ts :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	15:34:51		seconds: 0.0 Wall: 15:34:51
Duration	00:29:59
	16:04:50		seconds: 696.0 Wall: 15:46:27
Comments:		TE=05:40:07.620 Catherine.
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2017-12-02/15_34_51.ts Apply: 15:46:27 - 16:04:50 ( 00:18:23 ) S: 15:34:51 - E: 16:04:50 D: 00:29:59 (Start: 696.0) show more...

vlc ~/Videos/veyepar/nbpy/nbpy17/dv/mystic/2017-12-02/15_34_51.ts :start-time=0696.0 --audio-desync=0

	Raw File	Cut List
	15:34:51		seconds: 696.0 Wall: 15:46:27
Duration	00:29:59
	16:04:50		seconds: 0.0 Wall: 15:34:51
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

Rf filename:	root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:	check and save to add this

(00:00) TS=05:10:59.874 Catherine Moroney comes to us

(0:17:29) TE=05:40:07.620 Catherine.

2017-12-02/14_34_51.ts
audio viz

audio viz

2017-12-02/15_04_51.ts
audio viz

audio viz

2017-12-02/15_34_51.ts
audio viz

audio viz

Veyepar Video Eyeball Processor and Review