Hi
user
Admin Login:
Username:
Password:
Name:
Introduction to Web Scraping using Scrapy
--client
big_apple_py
--show
pygotham_2016
--room Room_CR6 11084 --force
Next: 11 We're All Database Engineers (WADE)
show more...
Marks
Author(s):
Kaira Villanueva
Location
Room CR6
Date
jul Sun 17
Days Raw Files
Start
13:45
First Raw Start
12:24
Duration
00:25:00
Offset
1:20:45
End
14:10
Last Raw End
13:21
Chapters
00:00
Total cuts_time
21 min.
https://2016.pygotham.org/talks/314/introduction-to-web-scraping-using-scrapy
raw-playlist
raw-mp4-playlist
encoded-files-playlist
host
archive
mp4
svg
png
assets
release.pdf
Introduction_to_Web_Scraping_using_Scrapy.json
logs
Admin:
episode
episode list
cut list
raw files day
marks day
marks day
image_files
State:
---------
borked
edit
encode
push to queue
post
richard
review 1
email
review 2
make public
tweet
to-miror
conf
done
Locked:
clear this to unlock
Locked by:
user/process that locked.
Start:
initially scheduled time from master, adjusted to match reality
Duration:
length in hh:mm:ss
Name:
Video Title (shows in video search results)
Emails:
email(s) of the presenter(s)
Released:
has someone authorised pubication
Unknown
Yes
No
Normalise:
Channelcopy:
m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:
filename.png
Description:
markdown
Have you wanted to grab data from websites and automatically categorize it into a formatted list? Or maybe you want to opt out of registering for API keys and want data straight out of a web page? This is an introduction to web scraping and we will cover building bots through Scrapy to crawl a few sample web pages and have it extract information that we want. Prior knowledge not required; we’ll break down the steps in creating your own bot, and before you know it you'll be scraping the web.
Comment:
production notes
2016-07-17/12_24_15.ts
Apply:
12:24:15 - 12:54:14 ( 00:29:59 )
S:
12:24:15 -
E:
12:54:14
D:
00:29:59
show more...
vlc ~/Videos/veyepar/big_apple_py/pygotham_2016/dv/Room_CR6/2016-07-17/12_24_15.ts :start-time=00.0 --audio-desync=0
Raw File
Cut List
12:24:15
seconds: 0.0
Wall: 12:24:15
Duration
00:29:59
12:54:14
seconds: 0.0
Wall: 12:24:15
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2016-07-17/12_54_15.ts
Apply:
12:54:15 - 12:54:29 ( 00:00:14 )
S:
12:54:15 -
E:
13:21:37
D:
00:27:22
(
End:
14.0)
show more...
vlc ~/Videos/veyepar/big_apple_py/pygotham_2016/dv/Room_CR6/2016-07-17/12_54_15.ts :start-time=00.0 --audio-desync=0
Raw File
Cut List
12:54:15
seconds: 0.0
Wall: 12:54:15
Duration
00:27:22
13:21:37
seconds: 14.0
Wall: 12:54:29
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2016-07-17/12_54_15.ts
Apply:
12:54:29 - 13:16:03 ( 00:21:34 )
S:
12:54:15 -
E:
13:21:37
D:
00:27:22
(
Start:
14.0) (
End:
1308.0)
show more...
vlc ~/Videos/veyepar/big_apple_py/pygotham_2016/dv/Room_CR6/2016-07-17/12_54_15.ts :start-time=014.0 --audio-desync=0
Raw File
Cut List
12:54:15
seconds: 14.0
Wall: 12:54:29
Duration
00:27:22
13:21:37
seconds: 1308.0
Wall: 13:16:03
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2016-07-17/12_54_15.ts
Apply:
13:16:03 - 13:21:37 ( 00:05:34 )
S:
12:54:15 -
E:
13:21:37
D:
00:27:22
(
Start:
1308.0)
show more...
vlc ~/Videos/veyepar/big_apple_py/pygotham_2016/dv/Room_CR6/2016-07-17/12_54_15.ts :start-time=01308.0 --audio-desync=0
Raw File
Cut List
12:54:15
seconds: 1308.0
Wall: 13:16:03
Duration
00:27:22
13:21:37
seconds: 0.0
Wall: 12:54:15
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
Rf filename:
root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:
check and save to add this
2016-07-17/12_24_15.ts
2016-07-17/12_54_15.ts
Veyepar
Video Eyeball Processor and Review
