*** radiofree is now known as RadioFree | 00:39 | |
*** RadioFree is now known as RADIOfree | 02:12 | |
*** RADIOfree is now known as radiofree | 02:17 | |
*** gtristan has joined #baserock | 05:44 | |
*** noisecell has joined #baserock | 08:09 | |
*** gtristan has quit IRC | 08:10 | |
*** gtristan has joined #baserock | 08:15 | |
*** edcragg_ has quit IRC | 08:33 | |
*** edcragg has joined #baserock | 08:36 | |
*** ssam2 has joined #baserock | 08:44 | |
*** ChanServ sets mode: +v ssam2 | 08:44 | |
paulsherwood | /win/win 8 | 08:45 |
---|---|---|
paulsherwood | buh | 08:45 |
*** jonathanmaw has joined #baserock | 08:50 | |
*** bruce has joined #baserock | 09:02 | |
*** bruce is now known as Guest51519 | 09:03 | |
*** jude_ has joined #baserock | 09:38 | |
*** locallycompact has joined #baserock | 09:52 | |
*** CTtpollard has quit IRC | 09:59 | |
*** CTtpollard has joined #baserock | 11:10 | |
ssam2 | jjardon, do the Baserock gitlab runners have local cache that persists between runs? | 11:22 |
ssam2 | or does it clone gits for every build ? | 11:22 |
*** gtristan has quit IRC | 11:25 | |
*** tiagogomes has quit IRC | 11:32 | |
*** gtristan has joined #baserock | 12:05 | |
*** tiagogomes has joined #baserock | 12:22 | |
jjardon | ssam2: no cache between runs: they are ephemeral so to persist the cache Distributed runners caching needs to be configured and enabled: https://gitlab.com/gitlab-org/gitlab-ci-multi-runner/blob/master/docs/configuration/autoscale.md | 12:41 |
ssam2 | right so we'd need an S3 bucket ? :-( | 12:48 |
ssam2 | would be nice if https://docs.gitlab.com/ce/ci/yaml/README.html#cache would work | 12:49 |
jjardon | ssam2: yes, that or have runners always up | 12:52 |
ironfoot | we could have something always up in Datacentred | 12:54 |
ironfoot | "always" :P | 12:54 |
ironfoot | but if this "somethin" needs to be a runner, I guess that the builds won't be as fast as they are right now | 12:55 |
ssam2 | well, if we get BuildStream builds that are using the Freedesktop SDK host tools and have no cache, they will take hours | 12:58 |
ssam2 | as in my experience it takes hours to pull the thing | 12:58 |
ssam2 | maybe if they're running in AWS it'll be faster though | 12:58 |
jjardon | ironfoot: happy to setup a runner in Datacentred if a machine is provided | 12:59 |
ssam2 | plus we'd be cloning linux.git and gcc.git each time which is slow as feck | 12:59 |
ironfoot | It will be easy for me to allocate some resources in Datacentred, not in AWS though | 13:00 |
jjardon | ssam2: Can Buildstream build everything from scratch, instead using the Freedesktop SDK? | 13:21 |
ssam2 | no, it has to have some prebuilt host tools | 13:23 |
ssam2 | i've been using Alpine Linux locally which is just over 200MB for a toolchain etc. | 13:24 |
ssam2 | i'm not sure how big Freedesktop SDK is, but it sure takes a while to pull from OSTree for me | 13:24 |
ssam2 | Baserock should probably one day produce its own "host tools" | 13:25 |
ssam2 | which would basically be the stage2-*.morph elements | 13:25 |
ssam2 | so effectively we'd bootstrap the same way, it's just arranged differently | 13:25 |
ssam2 | we'd need CI to build tagged versions of the stage2.bst stack and push it to a public OSTree repo | 13:26 |
ssam2 | then Baserock definitions would refer to that OSTree repo as the first dependency of each build | 13:26 |
ssam2 | so it's like what we did before with stage2-* chunks in a kbas / morph-cache-server cache... except without the mess of bootstrapping on a variety of hosts | 13:27 |
ssam2 | which goes badly wrong when the GLIBC ABI changes | 13:27 |
jjardon | I see | 13:41 |
gtristan | artifact cache is coming soon | 13:43 |
gtristan | And what we're going to want, which I'm not sure is going to be an issue or not... | 13:44 |
gtristan | Is an ssh key pair | 13:44 |
gtristan | jjardon, maybe you know about this for the runners, but... what we want is to collect the public keys of anyone who can push artifacts to the server | 13:44 |
gtristan | jjardon, that would mean the runner needs a private key, and that private key should remain private (i.e. it should not be revisioned in git and copied into place in a .gitlab-ci.yml, it should be a part of the host that is auto-building) | 13:45 |
gtristan | I'm not sure how best to set that up, or if it's possible on gitlab runners | 13:45 |
*** gtristan has quit IRC | 13:59 | |
jjardon | gtristan: maybe generate and use a docker image with those keys included? | 14:06 |
jjardon | but that is very inflexible, maybe using deploy keys? a possible solution could be this: https://docs.gitlab.com/ee/ci/ssh_keys/README.html | 14:09 |
ssam2 | that looks like what we would need | 14:10 |
ssam2 | GitLab EE only though ? | 14:10 |
benbrown_ | not EE only | 14:13 |
ssam2 | ah, sound then | 14:14 |
benbrown_ | Potentially stupid question, but is population of the bst remote cache just through scp? | 14:16 |
* benbrown_ is wondering how much sanity checking there is likely to be on the receiving end | 14:16 | |
ssam2 | through sshfs I believe | 14:19 |
*** gtristan has joined #baserock | 14:21 | |
*** toscalix has joined #baserock | 15:27 | |
*** Guest51519 has quit IRC | 15:38 | |
*** Guest51519 has joined #baserock | 15:38 | |
*** jonathanmaw has quit IRC | 16:36 | |
*** jude_ has quit IRC | 16:55 | |
*** noisecell has quit IRC | 17:11 | |
*** ssam2 has quit IRC | 17:16 | |
*** toscalix has quit IRC | 17:25 | |
*** locallycompact has quit IRC | 18:18 | |
*** tiagogomes has quit IRC | 18:35 | |
*** paulwaters_ has joined #baserock | 19:31 | |
*** locallycompact has joined #baserock | 20:38 | |
*** locallycompact has quit IRC | 20:38 | |
*** Guest51519 has quit IRC | 22:41 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!