| *** gtristan has quit IRC | 05:04 | |
| *** gtristan has joined #baserock | 05:31 | |
| *** gtristan has quit IRC | 05:35 | |
| *** gtristan has joined #baserock | 05:51 | |
| *** jude_ has joined #baserock | 07:36 | |
| *** rdale has joined #baserock | 07:42 | |
| *** edcragg has quit IRC | 08:07 | |
| *** edcragg has joined #baserock | 08:07 | |
| *** toscalix has joined #baserock | 08:11 | |
| *** jonathanmaw has joined #baserock | 08:20 | |
| *** ssam2 has joined #baserock | 09:10 | |
| *** ChanServ sets mode: +v ssam2 | 09:10 | |
| *** tiagogomes has quit IRC | 09:22 | |
| *** locallycompact has joined #baserock | 09:23 | |
| *** tiagogomes has joined #baserock | 09:23 | |
| gitlab-br-bot | ybd: merge request (benbrown/fix-config-access->master: Fix config access, it is in the app module) #395 changed state ("opened"): https://gitlab.com/baserock/ybd/merge_requests/395 | 09:48 |
|---|---|---|
| gitlab-br-bot | ybd: merge request (benbrown/fix-config-access->master: Fix config access, it is in the app module) #395 changed state ("opened"): https://gitlab.com/baserock/ybd/merge_requests/395 | 09:49 |
| gitlab-br-bot | ybd: merge request (benbrown/fix-config-access->master: Fix config access, it is in the app module) #395 changed state ("merged"): https://gitlab.com/baserock/ybd/merge_requests/395 | 09:53 |
| gitlab-br-bot | definitions: merge request (benbrown/sam/fix-ci->master: Fix caching in CI and some other optimizations) #63 changed state ("opened"): https://gitlab.com/baserock/definitions/merge_requests/63 | 09:58 |
| benbrown_ | ssam2: The issue is likely that the job gets a runner that's been used for ybd, which stores non-gits in /cache | 10:00 |
| ssam2 | between builds ? | 10:01 |
| ssam2 | oh, between builds if the runner is reused | 10:02 |
| ssam2 | but not in the shared cache | 10:02 |
| ssam2 | yeah i see the issue i guess | 10:02 |
| * benbrown_ nods | 10:02 | |
| benbrown_ | So I was considering adding a new manager instance that was explicitly used for bst pipelines | 10:03 |
| ssam2 | is that difficult ? | 10:03 |
| benbrown_ | Not really | 10:03 |
| ssam2 | ok. an easier approach would be to just `rm cache/ybd/artifacts` before running buildstream builds | 10:03 |
| benbrown_ | that also works | 10:03 |
| benbrown_ | just means that we're not getting the full benefit of /cache | 10:03 |
| ssam2 | yeah | 10:04 |
| ssam2 | ha, my diagnostic broke everything anyway | 10:04 |
| ssam2 | ok, well you've got to sort out separate runners then i shall leave it in your capable hands | 10:04 |
| ssam2 | *if you've got time | 10:05 |
| gitlab-br-bot | definitions: merge request (benbrown/sam/fix-ci->master: Fix caching in CI and some other optimizations) #63 changed state ("opened"): https://gitlab.com/baserock/definitions/merge_requests/63 | 10:06 |
| benbrown_ | ssam2: Aye, I'll aim to get it sorted today | 10:10 |
| jjardon | benbrown_: no , only one manager, please | 10:30 |
| *** adds68 has quit IRC | 10:33 | |
| *** adds68 has joined #baserock | 10:36 | |
| *** toscalix has quit IRC | 10:40 | |
| benbrown_ | jjardon: Any particular reason why? Not after a new digitalocean instance, just another docker+machine registered from the same machine. | 10:41 |
| jjardon | I would prefer not to have to tag jobs to run in specific hardware | 10:46 |
| benbrown_ | jjardon: I'd rather we didn't have to nuke ybd cache every time for bst jobs | 10:46 |
| benbrown_ | tags are designed for this, why not use them? | 10:47 |
| jjardon | Think in gitlab.com runners; you don't use a specific runner | 10:47 |
| benbrown_ | Don't we have shared runners disabled? | 10:48 |
| benbrown_ | Regardless, we would use a specific runner if we used tags | 10:49 |
| benbrown_ | jjardon: Yeah, we don't use shared runners. Not sure what you mean? | 10:50 |
| jjardon | When you use gitlab runners you don't specify what runner you want to run on | 10:50 |
| jjardon | I'd like to keep that way (in case we do not have more funding for ours own runners, for example) | 10:51 |
| benbrown_ | jjardon: do shared runners even provide /cache? | 10:53 |
| benbrown_ | jjardon: actually, do the shared set privileged to true, because that's a requirement for ybd | 10:55 |
| ssam2 | shared runners do set privileged to true | 10:56 |
| ssam2 | buildstream is using the shared runners | 10:56 |
| ssam2 | (for the buildstream/ repos) | 10:56 |
| benbrown_ | jjardon: since we already require our manager for ybd, we may as well set that as the tagged instance | 10:57 |
| benbrown_ | jjardon: and enable shared runners for buildstream jobs | 10:57 |
| ssam2 | that would make buildstream builds really slow though | 10:58 |
| jjardon | Is this sth that definitely can't be fix in .gitlab-ci.yml or in builstream? | 10:59 |
| benbrown_ | jjardon: the only fix in the CI yaml is nuking /cache before each bst task | 10:59 |
| ssam2 | nuking cache/ybd/artifacts/ should be enough ? | 10:59 |
| ssam2 | maybe cache/buildstream/artifacts too | 11:00 |
| benbrown_ | ssam2: sure, but that's currently all that's in there | 11:00 |
| ssam2 | no, there are also gits | 11:00 |
| ssam2 | and ostree sources for buildstream builds | 11:00 |
| benbrown_ | separate mechanism | 11:00 |
| ssam2 | and those are the things which are really slow to re-fetch | 11:00 |
| ssam2 | oh OK | 11:01 |
| *** adds68 has quit IRC | 11:01 | |
| ssam2 | those are the only things i care about caching though really | 11:01 |
| ssam2 | pulling artifacts from the remote cache is a pretty fast operation | 11:01 |
| ssam2 | whereas pulling gits from git.baserock.org takes ages | 11:01 |
| *** adds68 has joined #baserock | 11:01 | |
| benbrown_ | true, just a nice to have I guess | 11:01 |
| ssam2 | and pulling ostree sources from sdk.gnome.org is similarly dog slow | 11:01 |
| benbrown_ | I'll go for nuking /cache/ybd/ then :) | 11:02 |
| gitlab-br-bot | definitions: merge request (benbrown/sam/fix-ci->master: Fix caching in CI and some other optimizations) #63 changed state ("opened"): https://gitlab.com/baserock/definitions/merge_requests/63 | 11:09 |
| benbrown_ | ssam2: This error is seemingly non-full disk related: https://gitlab.com/baserock/definitions/-/jobs/36291989 | 11:13 |
| ssam2 | yes, that one is weird | 11:13 |
| ssam2 | i think it may be path length related ... as that system has definitely built in the past | 11:14 |
| ssam2 | i can try and reproduce locally; but it may depend on the filesystem used on that machine | 11:19 |
| ssam2 | i moved my cache to an even longer path name and built that element (unmaintained/openstack-services/posix-ipc-tarball.bst) and it worked ifne | 12:09 |
| ssam2 | *fine | 12:09 |
| ssam2 | oh, maybe it's not quite as long | 12:11 |
| ssam2 | also, seems that the CI is not pushing buildstream artifacts any more | 12:18 |
| ssam2 | which is weird | 12:18 |
| ssam2 | oh, because it's not on a protected branch so it doesn't get the private key | 12:19 |
| benbrown_ | We only allow pushes for protected branches, I unprotected so I could force push. | 12:19 |
| ssam2 | right | 12:20 |
| ssam2 | i was just wondering why buildstream was going so slow | 12:20 |
| benbrown_ | I'd hoped once it got to that step, it would see that the branch is now re-protected, but that's not happened. | 12:21 |
| *** gtristan has quit IRC | 13:24 | |
| *** gtristan has joined #baserock | 13:26 | |
| *** toscalix has joined #baserock | 14:55 | |
| *** toscalix has quit IRC | 15:56 | |
| *** ssam2 has quit IRC | 16:28 | |
| *** jude_ has quit IRC | 16:29 | |
| *** locallycompact has quit IRC | 17:02 | |
| *** locallycompact has joined #baserock | 17:02 | |
| *** locallycompact has quit IRC | 17:02 | |
| *** locallycompact has joined #baserock | 17:03 | |
| *** jonathanmaw has quit IRC | 17:08 | |
| *** locallycompact has quit IRC | 18:37 | |
| *** rdale has quit IRC | 18:58 | |
| *** gtristan has quit IRC | 21:13 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!