IRC logs for #buildstream for Wednesday, 2020-07-15

*** tristan has quit IRC03:25
*** tristan has joined #buildstream04:15
*** ChanServ sets mode: +o tristan04:15
tristanUhhhh04:15
tristanDid someone pull the plug on CI completely ?04:16
tristanhttps://gitlab.com/BuildStream/buildstream/-/pipelines/16667663904:16
tristanjjardon, ?04:16
*** tristan has quit IRC04:30
*** phildawson has quit IRC05:13
*** benschubert has joined #buildstream07:19
*** tristan has joined #buildstream07:24
*** ChanServ sets mode: +o tristan07:24
tristanCI seems to have springed back to life07:25
nanonymetristan, maybe it was just tired and went to sleep07:27
tristanMaybe the config changed somehow07:30
tristanLike, before when it warmed up, you'd have the jobs starting and blocking in the beginning07:31
tristanIn this case you just had the whole board stuck on pause07:31
*** tristan has quit IRC08:17
*** tristan has joined #buildstream08:33
*** ChanServ sets mode: +o tristan08:33
*** philn has quit IRC08:44
*** santi has joined #buildstream08:45
jjardontristan: maybe gitlab update?10:24
jjardonseems they are in 13.2.0-pre now10:24
tristanmm10:59
*** adds68 has quit IRC15:12
juergbitristan, benschubert: iirc, there was a discussion quite a while ago about dropping the project/element name prefix from artifact cache keys. do either of you or anyone else remember where and when this happened?15:19
benschubertjuergbi: I think we discussed it at least in the meeting around blockers for bst 2.0 ? I can't remember where else though15:19
juergbihm, don't see it in those notes. I thought we had a discussion about this much earlier than that15:22
benschubertjuergbi: earliest I remember was the last meeting in London15:22
benschubertcan't recall exactly when... october 2019 maybe?15:22
juergbibuild meetup london was in October 2019. we might have briefly discussed it there as part of the then Fetch API discussion15:25
benschubertand cleaning up the artifact protos15:26
juergbirelated discussions happened in these threads: https://mail.gnome.org/archives/buildstream-list/2018-September/msg00050.html and https://mail.gnome.org/archives/buildstream-list/2019-August/msg00003.html15:52
WSalmoni have definitly discused that moving a element should not invalidate its cache key, or the cache key of things that depend on it. it dose seem rather silly that it dose. but i dont recall were16:00
tristanjuergbi, it will be linked in the 2.0 targets email16:03
tristanthat took me a while to find16:03
juergbiah, as part of cache key stability, right16:05
juergbiWSalmon: unfortunately, support for non-strict builds essentially prevents this due to the way weak cache keys work16:06
juergbibut it means it should probably be a whole separate discussion. maybe try to keep Remote Asset API migration as orthogonal as possible16:08
WSalmonjuergbi, i do understand it would be quite something to untanble at this point but i think its a shame16:11
WSalmonun-tangle16:12
juergbiit's impossible for weak keys as they use names in their dependencies16:12
juergbiit would be possible for strong keys but only if we completely decoupled strong and weak keys, which would be fairly odd, imo16:13
juergbi(name change resulting in a new weak key but unchanged strong key)16:13
juergbiunless we support completely disabling non-strict builds on a per-project basis (affecting cache keys)16:15
tristanjuergbi, I'm not sure that would be odd honestly16:23
tristanI'm not convinced there is an inherent "sense" to building strong keys on top of weak keys16:23
juergbiI would be surprised by non-strict bst build taking longer than strict bst build16:24
juergbiI suppose that wouldn't actually be the case16:24
tristanOnly in the rare case something was renamed ?16:24
juergbiyes16:25
tristanNot sure it's something worth caring about16:25
juergbiit's not the only issue16:25
tristanBetter that, than completely disabling non-strict on a per-project basis I think16:25
juergbiwe currently store the two cache keys in the artifact proto16:25
juergbiwe would have to drop this16:25
tristansounds like plumbing16:26
juergbiwhich means we could no longer get the weak cache key from a strong one16:26
tristanone is effectively an alias to another conceptually speaking16:26
juergbiyes but we could no longer store the aliases in the artifact prpoto16:26
tristanmeans an extra (hopefully lightweight) round trip ?16:27
juergbiyes16:28
juergbior it might16:28
tristanStill sounds better than locking a project into strict/non-strict on a per project basis16:28
juergbiyes16:29
juergbiit still adds an extra wrinkle to non-strict mode, which can already be confusing at times16:29
tristanjuergbi, the speed of build on rename should be eliminated with reproducible builds and build cutoff detections in some realistic future16:30
juergbiif we essentially create a local action cache (or use remote execution), it might16:31
juergbialthough, the element name is also in the input tree right now, isn't it?16:31
juergbibuild-root: /buildstream/autotools/hello.bst16:32
tristanright but if we find a matching content hash of something we do build, we still save ourselves from rebuilding reverse deps.... maybe ?16:32
tristanmaybe not16:32
tristanfor renamed elements on weak keys16:32
tristanmaybe there is a more ideal solution I'm not seeing yet16:33
juergbiit might actually not be that much of an issue as we still check strict keys even in non-strict modes16:33
tristannot sure, but I think I'd still be comfortable with the tradeoffs16:33
tristanright16:33
juergbihave to think about it some more. I thought it might be a quick discussion about dropping the name prefix from the artifact ref on the artifact server as part of switching to the remote asset API16:35
juergbihowever, I'm now tending towards keeping the name prefix in the initial switchover and pursuing the potential name prefix drop separately16:36
juergbidon't want to mix matters more than necessary if it's not a trivial topic16:36
juergbias long as we don't have cache key stability yet in master, an extra step that invalidates previously cached entries may not be a big deal16:37
juergbi(and dropping names would anyway require cache key version increment)16:38
*** philn has joined #buildstream17:52
*** santi has quit IRC17:53
*** bwh has joined #buildstream19:29
*** benschubert has quit IRC19:46
bwhI'm seeing an issue with bst 1.4.3 where the git source is unable to fetch updates19:59
bwhThe local git repo has remotes called 'origin' and 'https___gitlab_com_freedesktop_sdk_mirrors_gitlab_', but it tries to fetch from a remote called 'https___gitlab_com_'20:00
bwhI think this might have been fixed on master some time back, but not picked for the 1.4 branch yet20:01

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!