Hi
user
Admin Login:
Username:
Password:
Name:
Building a Twitter Metadata Scraper: Learnings from Working with a New Twitter API
--client
pyohio
--show
pyohio_2018
--room barbietootle 14222 --force
Next: 11 Conversational Interfaces for Chatbots and Artificial Intelligence
show more...
Marks
Author(s):
Elizabeth Wehner
Location
Barbie Tootle
Date
jul Sat 28
Days Raw Files
Start
15:45
First Raw Start
15:10
Duration
0:30:0
Offset
0:34:17
End
16:15
Last Raw End
16:40
Chapters
00:00
0:25:06
0:30:52
Total cuts_time
31 min.
https://pyohio.org/2018/schedule/presentation/28/
raw-playlist
raw-mp4-playlist
encoded-files-playlist
host
archive
tweet
mp4
svg
png
assets
release.pdf
Building_a_Twitter_Metadata_Scraper_Learnings_from_Working_with_a_New_Twitter_API.json
logs
Admin:
episode
episode list
cut list
raw files day
marks day
marks day
image_files
State:
---------
borked
edit
encode
push to queue
post
richard
review 1
email
review 2
make public
tweet
to-miror
conf
done
Locked:
clear this to unlock
Locked by:
user/process that locked.
Start:
initially scheduled time from master, adjusted to match reality
Duration:
length in hh:mm:ss
Name:
Video Title (shows in video search results)
Emails:
email(s) of the presenter(s)
Released:
has someone authorised pubication
Unknown
Yes
No
Normalise:
Channelcopy:
m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:
filename.png
Description:
markdown
BuzzFeed (especially our News team) creates a lot of time-sensitive content. But when shared on Twitter, the twitter-share data would remain fixed. This could lead to articles that changed from "So-and-so leads in election" to "so and so won the election" still being shared with an old title. BuzzFeed worked with Twitter on the development of a new API that could be used to rescrape the metadata to update share card information on request. I then built a "twitter scraper" using Python 3.5 that would request a rescrape every time we updated a published article. This proved especially tricky as existing twitter API support did not not quite fit our needs, requiring new solutions on our end. In this talk I'll go through the challenges involved in working with the new Twitter API and how I ultimately solved them.
Comment:
production notes
2018-07-28/15_10_43.ts
Apply:
15:10:43 - 15:31:40 ( 00:20:57 )
S:
15:10:43 -
E:
15:40:43
D:
00:30:00
(
End:
1257.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/barbietootle/2018-07-28/15_10_43.ts :start-time=00.0 --audio-desync=0
Raw File
Cut List
15:10:43
seconds: 0.0
Wall: 15:10:43
Duration
00:30:00
15:40:43
seconds: 1257.0
Wall: 15:31:40
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/15_10_43.ts
Apply:
15:31:40 - 15:40:43 ( 00:09:03 )
S:
15:10:43 -
E:
15:40:43
D:
00:30:00
(
Start:
1257.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/barbietootle/2018-07-28/15_10_43.ts :start-time=01257.0 --audio-desync=0
Raw File
Cut List
15:10:43
seconds: 1257.0
Wall: 15:31:40
Duration
00:30:00
15:40:43
seconds: 0.0
Wall: 15:10:43
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/15_40_43.ts
Apply:
15:40:43 - 15:45:21 ( 00:04:38 )
S:
15:40:43 -
E:
16:10:42
D:
00:29:59
(
End:
278.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/barbietootle/2018-07-28/15_40_43.ts :start-time=00.0 --audio-desync=0
Raw File
Cut List
15:40:43
seconds: 0.0
Wall: 15:40:43
Duration
00:29:59
16:10:42
seconds: 278.0
Wall: 15:45:21
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/15_40_43.ts
Apply:
15:45:21 - 15:45:36 ( 00:00:15 )
S:
15:40:43 -
E:
16:10:42
D:
00:29:59
(
Start:
278.0) (
End:
293.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/barbietootle/2018-07-28/15_40_43.ts :start-time=0278.0 --audio-desync=0
Raw File
Cut List
15:40:43
seconds: 278.0
Wall: 15:45:21
Duration
00:29:59
16:10:42
seconds: 293.0
Wall: 15:45:36
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/15_40_43.ts
Apply:
15:45:36 - 16:10:42 ( 00:25:06 )
S:
15:40:43 -
E:
16:10:42
D:
00:29:59
(
Start:
293.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/barbietootle/2018-07-28/15_40_43.ts :start-time=0293.0 --audio-desync=0
Raw File
Cut List
15:40:43
seconds: 293.0
Wall: 15:45:36
Duration
00:29:59
16:10:42
seconds: 0.0
Wall: 15:40:43
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/16_10_43.ts
Apply:
16:10:43 - 16:16:29 ( 00:05:46 )
S:
16:10:43 -
E:
16:40:42
D:
00:29:59
(
End:
346.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/barbietootle/2018-07-28/16_10_43.ts :start-time=00.0 --audio-desync=0
Raw File
Cut List
16:10:43
seconds: 0.0
Wall: 16:10:43
Duration
00:29:59
16:40:42
seconds: 346.0
Wall: 16:16:29
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/16_10_43.ts
Apply:
16:16:29 - 16:16:41 ( 00:00:12 )
S:
16:10:43 -
E:
16:40:42
D:
00:29:59
(
Start:
346.0) (
End:
358.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/barbietootle/2018-07-28/16_10_43.ts :start-time=0346.0 --audio-desync=0
Raw File
Cut List
16:10:43
seconds: 346.0
Wall: 16:16:29
Duration
00:29:59
16:40:42
seconds: 358.0
Wall: 16:16:41
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/16_10_43.ts
Apply:
16:16:41 - 16:29:41 ( 00:13:00 )
S:
16:10:43 -
E:
16:40:42
D:
00:29:59
(
Start:
358.0) (
End:
1138.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/barbietootle/2018-07-28/16_10_43.ts :start-time=0358.0 --audio-desync=0
Raw File
Cut List
16:10:43
seconds: 358.0
Wall: 16:16:41
Duration
00:29:59
16:40:42
seconds: 1138.0
Wall: 16:29:41
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/16_10_43.ts
Apply:
16:29:41 - 16:29:57 ( 00:00:16 )
S:
16:10:43 -
E:
16:40:42
D:
00:29:59
(
Start:
1138.0) (
End:
1154.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/barbietootle/2018-07-28/16_10_43.ts :start-time=01138.0 --audio-desync=0
Raw File
Cut List
16:10:43
seconds: 1138.0
Wall: 16:29:41
Duration
00:29:59
16:40:42
seconds: 1154.0
Wall: 16:29:57
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2018-07-28/16_10_43.ts
Apply:
16:29:57 - 16:40:42 ( 00:10:45 )
S:
16:10:43 -
E:
16:40:42
D:
00:29:59
(
Start:
1154.0)
show more...
vlc ~/Videos/veyepar/pyohio/pyohio_2018/dv/barbietootle/2018-07-28/16_10_43.ts :start-time=01154.0 --audio-desync=0
Raw File
Cut List
16:10:43
seconds: 1154.0
Wall: 16:29:57
Duration
00:29:59
16:40:42
seconds: 0.0
Wall: 16:10:43
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
Rf filename:
root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:
check and save to add this
2018-07-28/15_10_43.ts
2018-07-28/15_40_43.ts
2018-07-28/16_10_43.ts
Veyepar
Video Eyeball Processor and Review