veyepar: When Everything Falls Apart: Stories of Version Control System Scaling

Hi user

Admin Login:

Name: When Everything Falls Apart: Stories of Version Control System Scaling
--client lca --show lca_2015 --room OGGB_260098 9453 --force
Next: 12 Mixing In The Free World

show more... Marks

Author(s):	Ben Kero
Location	OGGB 260-098
Date	jan Fri 16	Days Raw Files
Start	13:20	First Raw Start	12:24
Duration	0:45:00	Offset	0:55:33
End	14:05	Last Raw End	14:23
Chapters	00:00
Total cuts_time	33 min.

http://lca2015.linux.org.au/schedule/30262/view_talk
raw-playlist raw-mp4-playlist encoded-files-playlist host public tweet mp4 svg png

final audio

assets release.pdf When_Everything_Falls_Apart_Stories_of_Version_Control_System_Scaling.json
logs
Admin: episode episode list cut list raw files day marks day marks day image_files

State:
Locked:	clear this to unlock
Locked by:	user/process that locked.
Start:	initially scheduled time from master, adjusted to match reality
Duration:	length in hh:mm:ss
Name:	Video Title (shows in video search results)
Emails:	email(s) of the presenter(s)
Released:	has someone authorised pubication
Normalise:
Channelcopy:	m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:	filename.png
Description:	At Mozilla we have a great dependency on version control systems and software. All contributors format patches against it, all of our build automation infrastructure pulls from it, all online collaboration links against it. Over the life of various Mozilla projects, we've shifted version control systems many times, which led us to being large users of a multitude of systems: Git, Mercurial, CVS, SVN, BZR, and even RCS. Over the years we've also developed bizarre sets of hooks and various externally-hosted barnacles that promise to add greater insight into incoming code, along with notifications and beautiful graphs to keep all the developers up-to-date with the status of the project and to keep the PHBs (pointy-haired bosses) happy with the progress of overall development. In keeping up with this massive demand of hundreds of thousands of checkouts/clones per day, we've had to do heavy capacity planning in terms of hardware (the easy part). The hard part has been trying to scale the backend version control server software, which has led us into some interesting problems that haven't been discussed or shared at length of in detail in a public setting. In particular this talk will be about about experiences and trials that we've faced keeping reliabile, quick response times, and general uptime of the Git and Mercurial version control systems. Join me as we explore when, how, and how often these systems break, how to properly monitor and diagnose them, critical caching failures, backend-switching shenanigans, grumpy upstream correspondence, NFS atomicity being sketchy, and lots of throwing hands into the air and ragequitting. markdown
Comment:	production notes

recording sheet

recording sheet

2015-01-16/12_24_27.dv Apply: 12:24:27 - 13:20:51 ( 00:56:24 ) S: 12:24:27 - E: 13:20:51 D: 00:56:24 show more...

vlc ~/Videos/veyepar/lca/lca_2015/dv/OGGB_260098/2015-01-16/12_24_27.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	12:24:27		seconds: 0.0 Wall: 12:24:27
Duration	00:56:24
	13:20:51		seconds: 0.0 Wall: 12:24:27
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2015-01-16/13_20_52.dv Apply: 13:20:52 - 13:54:33 ( 00:33:41 ) S: 13:20:52 - E: 13:54:33 D: 00:33:41 show more...

vlc ~/Videos/veyepar/lca/lca_2015/dv/OGGB_260098/2015-01-16/13_20_52.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	13:20:52		seconds: 0.0 Wall: 13:20:52
Duration	00:33:41
	13:54:33		seconds: 0.0 Wall: 13:20:52
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

2015-01-16/13_54_33.dv Apply: 13:54:33 - 14:23:19 ( 00:28:46 ) S: 13:54:33 - E: 14:23:19 D: 00:28:46 show more...

vlc ~/Videos/veyepar/lca/lca_2015/dv/OGGB_260098/2015-01-16/13_54_33.dv :start-time=00.0 --audio-desync=0

	Raw File	Cut List
	13:54:33		seconds: 0.0 Wall: 13:54:33
Duration	00:28:46
	14:23:19		seconds: 0.0 Wall: 13:54:33
Comments:
mp4 mp4.m3u	dv.m3u	Split: Sequence:: delete

audio viz

Rf filename:	root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:	check and save to add this

2015-01-16/12_24_27.dv
audio viz

audio viz

2015-01-16/13_20_52.dv
audio viz

audio viz

2015-01-16/13_54_33.dv
audio viz

audio viz

Veyepar Video Eyeball Processor and Review