veyepar: Dimensionality reduction - squeezing out the good stuff with PCA

Hi user

Admin Login:

Name: Dimensionality reduction - squeezing out the good stuff with PCA
--client pyconza --show pyconza2018 --room baobab 14359 --force
Prev: 11 So What's the Story?
Next: 11 Guide to choose right deep Learning framework for your AI project

show more...

Author(s):	Aabir Abubaker Kar
Location	Baobab
Date	oct Fri 12	Days Raw Files
Start	10:00	First Raw Start	09:54
Duration	00:45:00	Offset	0:05:31
End	10:45	Last Raw End	10:48
Chapters	00:00 0:00:09 0:19:25 0:22:59 0:23:01
Total cuts_time	39 min.

https://za.pycon.org/talks/28-dimensionality-reduction-squeezing-out-the-good-stuff-with-pca/
raw-playlist raw-mp4-playlist encoded-files-playlist host archive tweet mp4 svg png

final audio

assets release.pdf Dimensionality_reduction_squeezing_out_the_good_stuff_with_PCA.json
logs
Admin: episode episode list cut list raw files day marks day marks day image_files

State:
Locked:	clear this to unlock
Locked by:	user/process that locked.
Start:	initially scheduled time from master, adjusted to match reality
Duration:	length in hh:mm:ss
Name:	Video Title (shows in video search results)
Emails:	email(s) of the presenter(s)
Released:	has someone authorised pubication
Normalise:
Channelcopy:	m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:	filename.png
Description:	Data is often high-dimensional - millions of pixels, frequencies, categories. A lot of this detail is unnecessary for data analysis - but how much exactly? This talk will discuss the ideas and techniques of dimensionality reduction, provide useful mathematical intuition about how it's done, and show you how Netflix uses it to lead you from binge to binge. In this session, we'll start by remembering what data really is and what it stands for. Data is a structured set of numbers, and these numbers typically (hopefully!) hold some information. This will lead us naturally to the concept of a high-dimensional dataspace, the mystical realm in which data lives. It turns out that data in this space displays an extremely useful 'selection bias' - *a datapoint can be known by the company it keeps. This is one of the basic ideas behind k-means clustering, which we will briefly discuss. We'll then talk about the informative-ness* of certain dimensions of the data space over others. This lays the mathematical foundation for the technique of Principal Component Analysis (PCA), which we will run on the Netflix movie dataset using scikit-learn. We will also touch upon tSNE, another popular dimensionality-reduction algorithms. I will be using scikit-learn for processing and matplotlib for visualization. The purpose of this session is to introduce dimensionality-reduction to those who do not know it, and to provide useful guiding intuitions to those who do. We'll also discuss some seminal use-cases, with tips and warnings for your own applications. markdown
Comment:	production notes

recording sheet

recording sheet

2018-10-12/09_54_29.ts Apply: 09:54:29 - 10:00:23 ( 00:05:54 ) S: 09:54:29 - E: 10:24:28 D: 00:29:59 (End: 354.0) show more...

vlc ~/Videos/veyepar/pyconza/pyconza2018/dv/baobab/2018-10-12/09_54_29.ts :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	09:54:29		seconds: 0.0 Wall: 09:54:29
Duration	00:29:59
	10:24:28		seconds: 354.0 Wall: 10:00:23
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2018-10-12/09_54_29.ts Apply: 10:00:23 - 10:05:03 ( 00:04:40 ) S: 09:54:29 - E: 10:24:28 D: 00:29:59 (Start: 354.0) (End: 634.0) show more...

vlc ~/Videos/veyepar/pyconza/pyconza2018/dv/baobab/2018-10-12/09_54_29.ts :start-time=0354.0 --audio-desync=0

	Raw File	Cut List
	09:54:29		seconds: 354.0 Wall: 10:00:23
Duration	00:29:59
	10:24:28		seconds: 634.0 Wall: 10:05:03
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2018-10-12/09_54_29.ts Apply: 10:05:03 - 10:05:12 ( 00:00:09 ) S: 09:54:29 - E: 10:24:28 D: 00:29:59 (Start: 634.0) (End: 643.0) show more...

vlc ~/Videos/veyepar/pyconza/pyconza2018/dv/baobab/2018-10-12/09_54_29.ts :start-time=0634.0 --audio-desync=0

	Raw File	Cut List
	09:54:29		seconds: 634.0 Wall: 10:05:03
Duration	00:29:59
	10:24:28		seconds: 643.0 Wall: 10:05:12
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2018-10-12/09_54_29.ts Apply: 10:05:12 - 10:24:28 ( 00:19:16 ) S: 09:54:29 - E: 10:24:28 D: 00:29:59 (Start: 643.0) show more...

vlc ~/Videos/veyepar/pyconza/pyconza2018/dv/baobab/2018-10-12/09_54_29.ts :start-time=0643.0 --audio-desync=0

	Raw File	Cut List
	09:54:29		seconds: 643.0 Wall: 10:05:12
Duration	00:29:59
	10:24:28		seconds: 0.0 Wall: 09:54:29
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2018-10-12/10_24_29.ts Apply: 10:24:29 - 10:28:03 ( 00:03:34 ) S: 10:24:29 - E: 10:48:01 D: 00:23:32 (End: 214.0) show more...

vlc ~/Videos/veyepar/pyconza/pyconza2018/dv/baobab/2018-10-12/10_24_29.ts :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	10:24:29		seconds: 0.0 Wall: 10:24:29
Duration	00:23:32
	10:48:01		seconds: 214.0 Wall: 10:28:03
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2018-10-12/10_24_29.ts Apply: 10:28:03 - 10:28:05 ( 00:00:02 ) S: 10:24:29 - E: 10:48:01 D: 00:23:32 (Start: 214.0) (End: 216.0) show more...

vlc ~/Videos/veyepar/pyconza/pyconza2018/dv/baobab/2018-10-12/10_24_29.ts :start-time=0214.0 --audio-desync=0

	Raw File	Cut List
	10:24:29		seconds: 214.0 Wall: 10:28:03
Duration	00:23:32
	10:48:01		seconds: 216.0 Wall: 10:28:05
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2018-10-12/10_24_29.ts Apply: 10:28:05 - 10:44:40 ( 00:16:35 ) S: 10:24:29 - E: 10:48:01 D: 00:23:32 (Start: 216.0) (End: 1211.0) show more...

vlc ~/Videos/veyepar/pyconza/pyconza2018/dv/baobab/2018-10-12/10_24_29.ts :start-time=0216.0 --audio-desync=0

	Raw File	Cut List
	10:24:29		seconds: 216.0 Wall: 10:28:05
Duration	00:23:32
	10:48:01		seconds: 1211.0 Wall: 10:44:40
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2018-10-12/10_24_29.ts Apply: 10:44:40 - 10:48:01 ( 00:03:21 ) S: 10:24:29 - E: 10:48:01 D: 00:23:32 (Start: 1211.0) show more...

vlc ~/Videos/veyepar/pyconza/pyconza2018/dv/baobab/2018-10-12/10_24_29.ts :start-time=01211.0 --audio-desync=0

	Raw File	Cut List
	10:24:29		seconds: 1211.0 Wall: 10:44:40
Duration	00:23:32
	10:48:01		seconds: 0.0 Wall: 10:24:29
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

Rf filename:	root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:	check and save to add this

2018-10-12/09_54_29.ts
audio viz

audio viz

2018-10-12/10_24_29.ts
audio viz

audio viz

Veyepar Video Eyeball Processor and Review