IRC logs for #buildstream for Sunday, 2021-01-17

*** tristan has joined #buildstream07:00
*** ChanServ sets mode: +o tristan07:00
* tristan now has 3 PRs on the friar...09:46
tristanjuergbi, I don't recall why pull-artifact-files is allowed to be specifically set to False even when there is no RE service11:08
tristanShould it really reside within the `remote-execution` config block in that case ?11:09
nanonymetristan, I don't think it's necessarily undesirable, it just makes me wonder if we're understanding RE right withing scope of the new cache12:10
nanonymejjardon, oops, meant that to you12:10
nanonymetristan, you obviously understand it right, I was mainly trying to figure out from your post whether we are12:11
jjardonnanonyme: I think we are, that's why we started the asset server project for example12:13
nanonymejjardon, right. But eg what does that exactly mean that you could not define RE service in project configuration, only user configuration12:14
nanonymeWith regards to our CI it doesn't really matter since we can in CI generate expected user configuration. But what are the exact implications for dev machines?12:15
*** tristan has quit IRC12:19
*** tristan has joined #buildstream12:22
*** ChanServ sets mode: +o tristan12:22
tristanI think what I understand from that setting is, whether we want to download the artifact files after a build completes12:24
tristanMy question is rather, how that is useful if the build is happening locally12:24
jjardonnanonyme: for what I understand most of the config (specially the one that allows write access to remote services) will be moved to buildstream.conf ? Although some "hints" can be left in project.conf ?12:24
tristanThe current code allows configuring this setting without having a remote execution service configured, which I don't understand the logic behind12:24
tristanI seem to vaguely recall that there was some reason for this, though12:25
tristanRegarding user configuration, techinically anything that does not define what a project *is* is user configuration, and in some corner cases project.conf is allowed to provide a suggestion/recommendation for user configuration: This must always be overridable by user configuration12:27
tristanuser configuration specifies how to run a build, but not the content of a build, as such it never affects cache keys and in theory at least should not affect how builds run12:28
tristanhttps://lists.apache.org/thread.html/rf2da9830e2fa918357f99a6021e55fc43df876f0b19d43f68802f083%40%3Cdev.buildstream.apache.org%3E This proposal suggests we remove a mountain of complexity12:28
jjardonYeah, I think we are working more or less like that on other projects: project.conf define the "default" read only cache; if someone have access to write (CI server) we override the config in the CI job12:29
tristanone of the ways we do that is by at least admitting that if you have write access to a service, you will anyway need a priviledged key of some sort12:29
tristanIn which case it doesn't make much sense supporting that suggestion in project.conf, since you can just as well set it up in buildstream.conf12:29
tristansince you will anyway need to provide that key separately12:29
jjardonI think that makes sense12:30
tristanthat's not the same as read access, which can sometimes involve a key for signature verifications12:30
tristanlike a gpg key makes sense to store with a project, it's no secret12:30
jjardonYeah, or to verify a public ostree repo to use it as a source12:31
tristanexactly the example I was referring to :) (but could make sense in other scenarios too of course)12:32
jjardonnanonyme: so I think for us nothing will change as we already put "write" config in buildstream.conf : https://gitlab.com/freedesktop-sdk/freedesktop-sdk/-/blob/master/.gitlab-ci.yml#L6712:51
*** tristan has quit IRC13:04
*** tristan has joined #buildstream13:06
*** ChanServ sets mode: +o tristan13:06
*** dftxbs3e_ has quit IRC14:50
*** dftxbs3e_ has joined #buildstream14:50
nanonymejjardon, right. It's mostly that tristan commented there that there's no "read-only" configuration for RE. Hence it can only be configured in user config, not project config15:07
nanonymeIf I understood correctly15:07
nanonymeBut maybe the important difference here is "having a cache that uses RE API's" and "using RE"?15:08
nanonymeWe most definitely need to be able to configure our cache such that developers can more or less automatically consume artifacts created through CI15:09
jjardonnanonyme: yeah, I think you are right16:07
*** tristan has quit IRC16:12
*** toscalix has joined #buildstream17:42
*** toscalix has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!