Snapshot planning meeting notes 2024-02-20

[Linus Nordberg <linus@nordberg.se>]

Hi,

Please find the notes from the 2024-02-20 meeting below.

For those interested in participating in the next meeting, in ~2w from
now, enter your availability in https://framadate.org/debian-snapshot-plan-2 .


--8<---------------cut here---------------start------------->8---
# Debian snapshot service planning meet 2024-02-20 16:00 UTC 

Where: #debian-snapshot @ OFTC.net
Who:
    - h01ger
    - jcristau
    - ln5
    - olasd
    - weasel

## Current status

- imports on sallinen can't keep up, storage over nfs on sibelius is one reason
- secondaries see metadata updates before the farms are done syncing => 404
- both code and service are practically unmaintained atm

## Identified work items

1) set up dev/staging/test environment
2) find new main storage
   - 1 x physical server with > 150T (potentially slow) disk for storage
   - 1 x postgresql with >= 256G RAM and >= 2 x 512G fast disk (SSD/NVMe)
   - for hw, either
     - find donor for, or procure for purchase, hw and find hosting, or
     - go hetzner dedicated SX-294 for storage and maybe AX-52 for postgres
   - storage growth is ~8T/year (144->152), cf. https://munin.debian.org/debian.org/sibelius.debian.org/df_abs.html
3) S3 for serving web content
  - implement s3 backend for snapshot import/indexing
  - serve s3 to web (fastly magic?)
4) improve importing/indexing efficiency
5) add support for sha256

## Next steps

- jcristau will ask hetzner if they're willing to give us a discount for a manydisks machine
- ln5 sets up a poll for another IRC meeting in ~2w, sending it to debian-snapshot@
--8<---------------cut here---------------end--------------->8---