Hi
user
Admin Login:
Username:
Password:
Name:
Twoskip - a robust single-file key-value database
--client
lca
--show
lca2016
--room r3mix 10664 --force
Next: 12 Melvin: A new implementation of LVM in Rust
show more...
Marks
Author(s):
Bron Gondwana
Location
Wool Museum
Date
feb Wed 03
Days Raw Files
Start
14:15
First Raw Start
14:14
Duration
0:45:00
Offset
0:00:03
End
15:00
Last Raw End
15:40
Chapters
00:00
Total cuts_time
43 min.
https://linux.conf.au/schedule/30190/view_talk
raw-playlist
raw-mp4-playlist
encoded-files-playlist
host
archive
tweet
mp4
svg
png
assets
release.pdf
Twoskip_a_robust_singlefile_keyvalue_database.json
logs
Admin:
episode
episode list
cut list
raw files day
marks day
marks day
image_files
State:
---------
borked
edit
encode
push to queue
post
richard
review 1
email
review 2
make public
tweet
to-miror
conf
done
Locked:
clear this to unlock
Locked by:
user/process that locked.
Start:
initially scheduled time from master, adjusted to match reality
Duration:
length in hh:mm:ss
Name:
Video Title (shows in video search results)
Emails:
email(s) of the presenter(s)
Released:
has someone authorised pubication
Unknown
Yes
No
Normalise:
Channelcopy:
m=mono, 01=copy left to right, 10=right to left, 00=ignore.
Thumbnail:
filename.png
Description:
markdown
They Cyrus IMAPd server uses key-value stores a lot inside, and it needs absolute robustness and consistent performance more than it needs raw speed. The skiplist implementation sometimes took hours to recover large files as it rebuilt the entire database after a process or server crash. After evaluating other options, I decided to extend skiplist to provide fast recovery, 64 bit support and extra robustness with checksums throughout. Using only POSIX guarantees, here's a single-file database format that's extremely robust, if not the fastest thing in the world. This talk explains how the skiplist data structure works, and how twoskip creates a flat file representation of a skiplist with an intertwined single linked list to provide fast recovery of corrupted databases while requiring nothing more than a guarantee of fsync ordering and atomic single block writes.
Comment:
production notes
2016-02-03/14_14_57.dv
Apply:
14:14:57 - 14:15:03 ( 00:00:06 )
S:
14:14:57 -
E:
14:15:03
D:
00:00:06
show more...
vlc ~/Videos/veyepar/lca/lca2016/dv/r3mix/2016-02-03/14_14_57.dv :start-time=00.0 --audio-desync=0
Raw File
Cut List
14:14:57
seconds: 0.0
Wall: 14:14:57
Duration
00:00:06
14:15:03
seconds: 0.0
Wall: 14:14:57
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2016-02-03/14_15_04.dv
Apply:
14:15:04 - 14:58:11 ( 00:43:07 )
S:
14:15:04 -
E:
14:58:11
D:
00:43:07
show more...
vlc ~/Videos/veyepar/lca/lca2016/dv/r3mix/2016-02-03/14_15_04.dv :start-time=00.0 --audio-desync=0
Raw File
Cut List
14:15:04
seconds: 0.0
Wall: 14:15:04
Duration
00:43:07
14:58:11
seconds: 0.0
Wall: 14:15:04
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
2016-02-03/14_58_09.dv
Apply:
14:58:09 - 15:40:04 ( 00:41:55 )
S:
14:58:09 -
E:
15:40:21
D:
00:42:12
(
End:
2515.0)
show more...
vlc ~/Videos/veyepar/lca/lca2016/dv/r3mix/2016-02-03/14_58_09.dv :start-time=00.0 --audio-desync=0
Raw File
Cut List
14:58:09
seconds: 0.0
Wall: 14:58:09
Duration
00:42:12
15:40:21
seconds: 2515.0
Wall: 15:40:04
Comments:
mp4
mp4.m3u
dv.m3u
Split:
Sequence:
:
delete
Rf filename:
root is .../show/dv/location/, example: 2013-03-13/13:13:30.dv
Sequence:
get this:
check and save to add this
2016-02-03/14_14_57.dv
2016-02-03/14_15_04.dv
2016-02-03/14_58_09.dv
Veyepar
Video Eyeball Processor and Review
