veyepar: Scraping (some of) the NYPL Catalog: a story of Requests and BeautifulSoup

Author(s):	Susan Steinman
Location	Room 705
Date	aug Sun 16	Days Raw Files
Start	10:00	First Raw Start	09:56
Duration	00:55:00	Offset	0:03:10
End	10:55	Last Raw End	11:14
Chapters	00:00 0:01:27 0:11:31 0:16:43
Total cuts_time	32 min.

https://pygotham.org/2015/talks/125/scraping-some-of-the-nypl-catalog-a-story-of-requests-and-beautifulsoup
raw-playlist raw-mp4-playlist encoded-files-playlist host public tweet mp4 svg png

assets release.pdf Scraping_some_of_the_NYPL_Catalog_a_story_of_Requests_and_BeautifulSoup.json
logs
Admin: episode episode list cut list raw files day marks day marks day image_files

State:
Locked:	clear this to unlock
Locked by:	user/process that locked.
Start:	initially scheduled time from master, adjusted to match reality
Duration:	length in hh:mm:ss
Name:	Video Title (shows in video search results)
Emails:	email(s) of the presenter(s)
Released:	has someone authorised pubication
Normalise:
Channelcopy:	m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:	filename.png
Description:	A foray into web scraping in Python markdown
Comment:	production notes

2015-08-16/09_56_50.dv Apply: 09:56:50 - 10:00:20 ( 00:03:30 ) S: 09:56:50 - E: 10:00:20 D: 00:03:30 show more...

vlc ~/Videos/veyepar/big_apple_py/pygotham_2015/dv/room705/2015-08-16/09_56_50.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	09:56:50		seconds: 0.0 Wall: 09:56:50
Duration	00:03:30
	10:00:20		seconds: 0.0 Wall: 09:56:50
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2015-08-16/10_00_22.dv Apply: 10:00:22 - 10:00:23 ( 00:00:01 ) S: 10:00:22 - E: 10:00:23 D: 00:00:01 show more...

vlc ~/Videos/veyepar/big_apple_py/pygotham_2015/dv/room705/2015-08-16/10_00_22.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	10:00:22		seconds: 0.0 Wall: 10:00:22
Duration	00:00:01
	10:00:23		seconds: 0.0 Wall: 10:00:22
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2015-08-16/10_00_23.dv Apply: 10:00:23 - 10:00:27 ( 00:00:04 ) S: 10:00:23 - E: 10:00:27 D: 00:00:04 show more...

vlc ~/Videos/veyepar/big_apple_py/pygotham_2015/dv/room705/2015-08-16/10_00_23.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	10:00:23		seconds: 0.0 Wall: 10:00:23
Duration	00:00:04
	10:00:27		seconds: 0.0 Wall: 10:00:23
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2015-08-16/10_00_28.dv Apply: 10:00:28 - 10:01:55 ( 00:01:27 ) S: 10:00:28 - E: 10:34:33 D: 00:34:05 (End: 1:27) show more... 1:27-1:53 11:57-12:37 17:49-18:45

vlc ~/Videos/veyepar/big_apple_py/pygotham_2015/dv/room705/2015-08-16/10_00_28.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	10:00:28		seconds: 0.0 Wall: 10:00:28
Duration	00:34:05
	10:34:33		seconds: 87.0 Wall: 10:01:55
Comments:		1:27-1:53 11:57-12:37 17:49-18:45
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2015-08-16/10_00_28.dv Apply: 10:02:21 - 10:12:25 ( 00:10:04 ) S: 10:00:28 - E: 10:34:33 D: 00:34:05 (Start: 1:53) (End: 11:57) show more... 1:27-1:53 11:57-12:37 17:49-18:45

vlc ~/Videos/veyepar/big_apple_py/pygotham_2015/dv/room705/2015-08-16/10_00_28.dv :start-time=0113.0 --audio-desync=0

	Raw File	Cut List
	10:00:28		seconds: 113.0 Wall: 10:02:21
Duration	00:34:05
	10:34:33		seconds: 717.0 Wall: 10:12:25
Comments:		1:27-1:53 11:57-12:37 17:49-18:45
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2015-08-16/10_00_28.dv Apply: 10:13:05 - 10:18:17 ( 00:05:12 ) S: 10:00:28 - E: 10:34:33 D: 00:34:05 (Start: 12:37) (End: 17:49) show more...

vlc ~/Videos/veyepar/big_apple_py/pygotham_2015/dv/room705/2015-08-16/10_00_28.dv :start-time=0757.0 --audio-desync=0

	Raw File	Cut List
	10:00:28		seconds: 757.0 Wall: 10:13:05
Duration	00:34:05
	10:34:33		seconds: 1069.0 Wall: 10:18:17
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2015-08-16/10_00_28.dv Apply: 10:19:13 - 10:34:33 ( 00:15:20 ) S: 10:00:28 - E: 10:34:33 D: 00:34:05 (Start: 18:45) show more...

vlc ~/Videos/veyepar/big_apple_py/pygotham_2015/dv/room705/2015-08-16/10_00_28.dv :start-time=01125.0 --audio-desync=0

	Raw File	Cut List
	10:00:28		seconds: 1125.0 Wall: 10:19:13
Duration	00:34:05
	10:34:33		seconds: 0.0 Wall: 10:00:28
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

2015-08-16/10_34_34.dv Apply: 10:34:34 - 11:14:00 ( 00:39:26 ) S: 10:34:34 - E: 11:14:00 D: 00:39:26 show more...

vlc ~/Videos/veyepar/big_apple_py/pygotham_2015/dv/room705/2015-08-16/10_34_34.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	10:34:34		seconds: 0.0 Wall: 10:34:34
Duration	00:39:26
	11:14:00		seconds: 0.0 Wall: 10:34:34
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

Rf filename:	root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:	check and save to add this