Videoteam/Archive

Archive and mirrors

• https://meetings-archive.debian.net/pub/debian-meetings/ - offical archive, updated hourly at :54, contact debconf-video list
• http://linux3.cc.ntu.edu.tw/pub/debian-meetings/ - mirror, updated daily at 2:30 localtime, ipv4, contact machine admin: Jason Chang <mailto:jsc@ntu.edu.tw>, system admin: Andrew Lee
• http://debian-video.s3-website-us-east-1.amazonaws.com/debian-meetings/ - mirror, only updated manually, ipv4, contact: James Bromberger
• https://mirror.netcologne.de/debian-video/ - mirror, updated 4 times per day, ipv4, ipv6, contact Alexander Wirt
• http://mirror.ox.ac.uk/sites/meetings-archive.debian.net/pub/debian-meetings/ - ipv4, updated daily at 04:25 localtime, contact <mailto:sysdev@it.ox.ac.uk>
• YouTube channel

Information for mirror operators

Use rsync://meetings-archive.debian.net/pub/debian-meetings/ to mirror the archive. 2004-2013 is around 810G, growing at around 100GB per year.

Use this settings in your vhost.conf:

<Directory "/export/ftp/pub/debian-meetings">
         Options Indexes FollowSymLinks
         ReadmeName FOOTER.html
         DirectoryIndex index.html
</Directory>

git-annex

Please see the git-annex walkthrough for basic information about git-annex.

TODO

• Make clear-text backends work
• Create workflow for public read-only consumption
• Use chunking for large files on Amazon S3 once Jessie is released

Add new data

git annex add $path
git annex sync # once Jessie releases, we can do git annex sync -m 'This is my message'
    # you can also git commit --amend for now

Edit data

git annex unlock $path
# edit what needs editing
git annex add $path
git annex sync # once Jessie releases, we can do git annex sync -m 'This is my message'
    # you can also git commit --amend for now

Sync data to Amazon S3

Normal every-day sync

git annex copy --to amazon_aws_s3-us_east_1-SHA512E --fast

Thourough sync

git annex copy --to amazon_aws_s3-us_east_1-SHA512E

Initial clone

git clone ssh://apu.debconf.org:/srv/video/video.debian.net
cd video.debian.net
git annex init '$yourname.localh/video.debian.net' # (or some other name which can be easily recognized by you and others. If in doubt, ask in #debconf-video. Please document your storage below. Ask RichiH about trust levels of your repo)
git annex get # if you want a full clone. Currently, this weighs in at less than 1TB
git annex sync

Consistency check & grabbing new data

Every X time, it would be nice if you ran:

git fsck && git annex fsck
##### check that there are no errors! If there are, ask in #debconf-video!
git annex sync
git annex get

Exisiting repos

Full data

• apu.debconf.org/srv/video/video.debian.net - semitrusted
• Amazon S3

Git-only

• richih@{master.d.o,local}
• https://github.com/RichiH/video.debian.net

Planned

• Archive.org