IRC logs for #buildstream for Friday, 2019-08-16

*** xjuan has quit IRC00:52
gitlab-br-botcoldtom approved MR !1549 (abderrahim/backport-947->bst-1: plugins/elements/cmake.yaml: always specify variable types) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/154907:12
*** rdale has joined #buildstream08:21
*** bochecha has joined #buildstream08:24
*** tme5 has joined #buildstream08:38
*** rdale has quit IRC08:53
*** rdale has joined #buildstream08:54
*** rdale_ct has joined #buildstream08:54
*** rdale has quit IRC08:57
*** rdale_ct has quit IRC08:57
*** rdale has joined #buildstream08:57
tlater[m]juergbi: Regarding your comment on !154009:01
gitlab-br-botMR !1540: WIP: Support separate end points for artifact caches https://gitlab.com/BuildStream/buildstream/merge_requests/154009:01
tlater[m]How would we find our blobs if we didn't link the servers?09:02
juergbitlater[m]: we could check CAS servers one by one until we have all blobs09:10
juergbitypical case will anyway be single CAS server09:10
juergbiit's difficult to say whether this would adversely affect multi-CAS use cases as they aren't clearly defined09:12
tlater[m]Hm09:12
tlater[m]Yeah, I feel like it could be slow in the latter case09:12
tlater[m]But I'm also struggling to see a use case for that09:12
juergbiyou could have a CAS server that is read-only to developers, only populated by CI09:14
juergbiand then a secondary CAS server for free use09:14
juergbias we batch blob retrieval, I don't expect the performance to be a big issue as long as we're just talking about 2-3 CAS servers09:15
juergbialso, I think we should rather try to go towards the approach of 'unified CAS' from the buildstream point of view (following https://docs.google.com/document/d/17WJ4cz150IHeTgvJGxcbSGK1Zg2vsLpcgUSVffrwGfk/edit# )09:16
juergbiI'm not suggesting to drop support for multiple servers, however, I don't think we should worry too much about performance of hypothetical use cases09:18
*** rdale_ct has joined #buildstream09:18
tlater[m]Alright, patch rework coming up!09:18
tlater[m]Haha09:18
*** rdale_ct has quit IRC09:18
tlater[m]Thanks juergbi09:18
tlater[m]I suppose if anyone ever comes to complain that their CAS pushes are slow we can rework then.09:19
juergbitlater[m]: that said, it could be sensible to talk to fdo-sdk devs to make sure we're not forgetting real use cases09:19
tlater[m]juergbi: Their use case is simply using BuildStream with normal remote execution build servers.09:20
tlater[m]Which means they'd have two CASes at most09:20
tlater[m]And for that an iterative search won't be too bad. If we keep configuration order then users can even configure the cache that is typically addressed to be checked first.09:21
juergbiok, maybe also reply to your ML thread about this09:22
tlater[m]Will do09:23
juergbitristan's reply actually described both cases 'If it is [not] important to express that a given artifact server is related to a given CAS server...'09:23
juergbibut there was no further public discussion, afaict09:23
*** lachlan has joined #buildstream09:27
*** traveltissues has joined #buildstream09:39
*** jonathanmaw has joined #buildstream09:39
*** lachlan has quit IRC10:21
*** lachlan has joined #buildstream10:40
tlater[m]Do we have EnumNodes?10:45
tlater[m]Ah, there's a `get_enum()`10:46
*** lachlan has quit IRC10:48
*** lachlan has joined #buildstream10:53
*** lachlan has quit IRC10:58
*** toscalix has joined #buildstream11:27
*** lachlan has joined #buildstream11:34
*** lachlan has quit IRC11:40
*** lachlan has joined #buildstream11:48
*** lachlan has quit IRC12:36
gitlab-br-botdanielsilverstone-ct opened MR !1551 (danielsilverstone-ct/fix-node-provenance->master: Improve node provenance in error reporting) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/155112:58
gitlab-br-botjennis approved MR !1551 (danielsilverstone-ct/fix-node-provenance->master: Improve node provenance in error reporting) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/155113:16
*** lachlan has joined #buildstream13:36
gitlab-br-botmarge-bot123 closed issue #1059 (Regression: Unhelpful error message on missing variables) on buildstream https://gitlab.com/BuildStream/buildstream/issues/105913:50
gitlab-br-botmarge-bot123 merged MR !1551 (danielsilverstone-ct/fix-node-provenance->master: Improve node provenance in error reporting) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/155113:50
gitlab-br-botdanielsilverstone-ct approved MR !1511 (aevri/spawn->master: Support the 'spawn' method of starting processes) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/151113:58
Kinnisontme5: Is it your intent to close/abandon !1541, or to clean up the last bits and merge?13:58
gitlab-br-botMR !1541: Clarify bst artifact subcommand help text https://gitlab.com/BuildStream/buildstream/merge_requests/154113:58
*** toscalix has quit IRC13:59
tme5Kinnison, i'm not sure, i've since realised the command help text is inconsistent for a reason, because the commands actually don't behave the same right now14:03
Kinnisonoh dear14:04
Kinnison:D14:04
KinnisonCheck with jennis -- he was doing some artifacty stuff recently14:04
tme5something like my MR ought to be done eventually but idk if its sensible to do beforehand14:04
KinnisonMaybe you can combine efforts14:04
tme5yeah, he is working on the features that i assumed were there14:04
Kinnisonheh14:05
jennistme5, I like the fact that you've moved the general artifact subcommand help text into `def artifact`, we should at least take that change from your MR and land that14:15
jennisIt's silly that we're repeating ourselves per artifact subcommand14:15
gitlab-br-botjennis approved MR !1529 (becky/artifact_list_contents->master: Addition of bst artifact list-contents) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/152914:17
* Kinnison concurs14:18
tme5ah ok14:20
tme5it seems that the other thing is that the other artifact commands (checkout/pull/push) only fully operate on elements, but currently accept and partially operate on artifact refs14:20
jennisYeah this is something I'm working on14:21
tme5ahh thought so14:21
jennisLong story short, it's not easy to reconstruct a dependency graph from a given artifact (which could be from any point in the past)14:21
jennisSo we can't support --deps options (with artifact refs) for these commands, yet14:22
tme5makes sense14:23
tme5ok, so I can clear up my MR, or do you want to cherry-pick the commit? not sure how such things are done14:23
jennisSo your MR makes a lot of changes where checkout/pull/push now takes "artifacts/artifact" instead of element14:24
jennisAlthough we do eventually want this, perhaps we just hold off for now14:24
jennisclear up the MR :) no need for another one14:24
tme5yeah I agree, seeing as you're adding artifact show and Becky has just done list-contents, artifact commands are changing a lot :)14:25
tme5will do14:25
jennisIndeed14:25
gitlab-br-bottlater approved MR !1529 (becky/artifact_list_contents->master: Addition of bst artifact list-contents) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/152914:25
jennisAlso, we intend to split artifact related commands from the project (you shouldn't need to be inside a project to do artifact stuff)14:25
tlater[m]jennis: That'll be weird. Running `bst` outside of a project directory and actually getting it to do something14:28
jennisBut if you want to do stuff with your artifacts, why do you need to be in a project?14:28
jennistristan gave some cool use cases for this, one sec14:29
tlater[m]Nah, I'm with you. It'll just be weird because I'm so used to BuildStream refusing to work outside a project dir :)14:29
jennishehe yeah14:30
jennisIt still won't, for most commands anyway14:30
*** jonathanmaw has quit IRC14:32
gitlab-br-botjennis approved MR !1529 (becky/artifact_list_contents->master: Addition of bst artifact list-contents) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/152914:32
gitlab-br-bottlater approved MR !1529 (becky/artifact_list_contents->master: Addition of bst artifact list-contents) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/152914:32
*** lachlan has quit IRC14:58
gitlab-br-botmarge-bot123 merged MR !1529 (becky/artifact_list_contents->master: Addition of bst artifact list-contents) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/152915:01
gitlab-br-botbeckyella16 opened issue #1106 (Addition of '--file' option to 'bst artifact log') on buildstream https://gitlab.com/BuildStream/buildstream/issues/110615:07
tme5is the unique key returned by a Source plugin used to store anything? or is it input into the cache key of the element?15:14
tlater[m]tme5: I think it was the latter. Check in element.py for cache key creation.15:18
jennistme5, have you seen this: https://buildstream.gitlab.io/buildstream/buildstream.plugin.html#buildstream.plugin.Plugin.get_unique_key ?15:19
tme5ahh15:19
*** lachlan has joined #buildstream15:19
tlater[m]jennis: Handy doc!15:21
tme5yeah that does answer my question, sorry hahah, ty15:21
*** tiagogomes has quit IRC15:33
*** tiagogomes has joined #buildstream15:34
*** tiagogomes has quit IRC15:52
*** tiagogomes has joined #buildstream15:56
*** tristan has left #buildstream15:59
*** tristan has joined #buildstream15:59
*** ChanServ sets mode: +o tristan15:59
*** tpollard has quit IRC16:04
*** tiagogomes has quit IRC16:06
gitlab-br-botbeckyella16 opened MR !1552 (becky/artifact_log_file_option->master: Addition of --file option to bst artifact log) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/155216:32
*** bochecha has quit IRC16:32
*** lachlan has quit IRC16:35
*** tme5 has quit IRC16:37
*** lachlan has joined #buildstream16:40
*** lachlan has quit IRC16:53
*** lachlan has joined #buildstream17:02
*** lachlan has quit IRC17:10
*** lachlan has joined #buildstream17:14
*** lachlan has quit IRC17:20
*** lachlan has joined #buildstream17:30
gitlab-br-botmarge-bot123 merged MR !1511 (aevri/spawn->master: Support the 'spawn' method of starting processes) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/151117:37
*** lachlan has quit IRC17:45
*** lachlan has joined #buildstream17:48
*** lachlan has quit IRC18:24
*** traveltissues has quit IRC18:34
*** lachlan has joined #buildstream18:51
*** rdale has quit IRC19:30
*** lachlan has quit IRC19:34
*** benschubert has quit IRC22:16

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!