IRC logs for #buildstream for Friday, 2019-08-09

*** tristan_ has quit IRC00:14
*** tristan_ has joined #buildstream00:30
*** tristan has joined #buildstream00:51
*** narispo has quit IRC01:41
*** narispo has joined #buildstream01:42
*** narispo has quit IRC01:45
*** narispo has joined #buildstream01:45
*** tristan has quit IRC02:14
*** tristan has joined #buildstream02:26
*** tristan has quit IRC02:29
*** tristan has joined #buildstream02:32
*** tristan has quit IRC02:33
*** tristan has joined #buildstream02:33
*** tristan has quit IRC02:36
*** tristan has joined #buildstream02:47
*** tristan has quit IRC02:48
*** tristan has joined #buildstream02:48
*** tristan has quit IRC02:51
*** tristan has joined #buildstream02:52
*** tristan has quit IRC02:54
*** tristan has joined #buildstream02:57
*** tristan has quit IRC02:58
*** tristan has joined #buildstream03:01
*** tristan has quit IRC03:02
*** tristan has joined #buildstream05:06
*** tristan has quit IRC05:14
*** tristan has joined #buildstream05:24
*** tristan has quit IRC05:25
*** tristan has joined #buildstream05:26
*** tristan has quit IRC05:28
*** tristan has joined #buildstream05:31
*** tristan has quit IRC05:32
*** tristan has joined #buildstream05:33
*** tristan has quit IRC05:34
*** tristan has joined #buildstream05:54
*** tristan has joined #buildstream05:59
*** tristan has quit IRC06:00
*** tristan has joined #buildstream06:01
*** tristan has quit IRC06:02
*** tristan has joined #buildstream06:03
*** tristan has quit IRC06:04
*** tristan has joined #buildstream06:05
*** tristan has quit IRC06:06
*** tristan has joined #buildstream06:07
*** tristan has quit IRC06:08
*** tristan has joined #buildstream06:08
*** tristan has joined #buildstream06:10
*** tristan has joined #buildstream06:12
*** tristan has quit IRC06:15
*** tristan has joined #buildstream06:44
*** narispo has quit IRC06:48
*** narispo has joined #buildstream06:48
*** toscalix has joined #buildstream07:33
*** narispo has quit IRC07:52
*** narispo has joined #buildstream07:52
*** tristan has quit IRC08:14
*** tristan has joined #buildstream08:16
*** tristan has quit IRC08:18
*** tristan has joined #buildstream08:18
*** tristan has quit IRC08:20
*** tristan has joined #buildstream08:23
*** tme5 has joined #buildstream08:27
*** tristan has joined #buildstream08:30
*** tristan has quit IRC08:33
*** tristan has joined #buildstream08:34
*** tristan has quit IRC08:36
tme5benschubert, hi, your branch fix-plugins-yaml doesn't seem to have advanced to include all your fixup commits -- do you know whether CI passes with those additions?08:44
tme5on bst-plugins-experimental08:44
benschubertI didn't get to have something working no08:44
tme5shall i open an issue for it?08:48
tme5does it block further development on the plugins or is there a way i can do that? that's why i'm curious08:48
benschubertwe already have https://gitlab.com/BuildStream/buildstream/issues/1090 for tracking this08:49
benschubertThere is lots of work to cleanup this repository that would need to be done to put it in a nice state08:49
benschubertI sadly don't have a really good answer for new plugins08:50
benschubertI might have a bit of time today to look at it, but no guarantees08:50
tme5ahh ok, no worries, i will look at something else :)08:52
tpollardDoes anybody fancy approving https://gitlab.com/BuildStream/buildstream/merge_requests/1534 to fix bst init08:54
KinnisonIs Gitlab working today?08:55
KinnisonBecause that LGTM, IMO you can marge it 👍08:56
Kinnisontpollard: ^^^08:59
tpollardcheers08:59
*** jonathanmaw has joined #buildstream09:01
gitlab-br-bottmewett closed issue #1048 (`bst artifact checkout --tar` should allow compression) on buildstream https://gitlab.com/BuildStream/buildstream/issues/104809:29
*** lachlan has joined #buildstream09:29
*** rdale has joined #buildstream09:39
gitlab-br-botmarge-bot123 closed issue #1100 (Error when using interactive bst init) on buildstream https://gitlab.com/BuildStream/buildstream/issues/110009:49
gitlab-br-botmarge-bot123 merged MR !1534 (tpollard/initfix->master: _frontend/app.py: Fixup node._assert_symbol_name() positional args) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/153409:49
benschubertjennis: you are a maintainer of bst-plugins-experimental, correct?09:50
jennisbenschubert, not officially, but my name is on the maintainers file because the repo started as a copy from bst-external :D09:58
jennisWhat'd you need?09:58
benschubertjust wanted to check if moving the repo to an architecture more like the bst-plugins-container would be accepted (tox, tip of master instead of version frozen in time, etc) ?09:59
jennisi.e. always run CI against latest master?10:02
jennisI've proposed this twice, separately to tristan_ and jjardon, and both times was informed that this is not a good idea10:03
jennisI was unaware that bst-plugins-container is tested again the tip of master10:04
benschubertit is: https://gitlab.com/BuildStream/bst-plugins-container/blob/master/tox.ini10:05
jennisoh, cool. I'm personally in favour of doing this10:06
jennisBut I would like tristan_ and/or jjardon to be part of this discussion too, seeing as they have vetoed this decision before10:06
jennisI also think that in general, we need to make an effort to get the repo in a "working" state10:08
benschubertyep10:08
benschubertespecially now that many plugins are moving to it10:09
coldtomfwiw i think testing it against the tip of master is also a good idea10:09
benschubertyeah, I'd rather have to force the merge, than test an outdated version :)10:10
*** narispo has quit IRC10:10
*** narispo has joined #buildstream10:10
benschubertAlso, we have the templated sources test, does someone how they are meant to run on other repos? I can't find where this is defined10:12
jennisphildawson does10:19
benschubertphildawson: do you have an example? :)10:21
gitlab-br-botmarge-bot123 merged MR !1533 (jennis/fix_artifact_log->master: Fix artifact log) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/153310:33
tlater[m]juergbi: What's the use case for a CASCache with no casd? Is that for remote caches?10:45
* tlater[m] wonders if there's a better way to do this since all these caches are basically just basiccache with slightly different protocols10:49
phildawsonbenschubert, !1261 (the MR which merged them) has some instructions. For an example, see https://gitlab.com/BuildStream/bst-plugins-experimental/commit/c9fb1ebb1331a4814d87f3821e6b5506f4be3cd2 Unfortunately I didn't get round to adding an example to the docs before I got reassigned.10:59
gitlab-br-botMR !1261: Expose templated source tests https://gitlab.com/BuildStream/buildstream/merge_requests/126110:59
benschubertphildawson: ok thanks a lot!11:03
phildawson:)11:07
*** lachlan has quit IRC11:23
juergbitlater[m]: casd=False is only for tests11:25
tlater[m]Ah, gotcha11:25
juergbifor read-only access casd is not required11:25
*** lachlan has joined #buildstream11:31
*** bochecha has joined #buildstream11:46
*** lachlan has quit IRC11:57
*** tpollard has quit IRC11:59
gitlab-br-botjennis opened issue #1101 (Sometimes failed builds are not cached as failed) on buildstream https://gitlab.com/BuildStream/buildstream/issues/110112:03
gitlab-br-botjennis opened MR !1536 (jennis/fix_failed_workspaces->master: Don't reset a failed (but cached) workspaced Element) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/153612:19
jennisjuergbi ^ some update_state tinkering there ;)12:20
jennisbenschubert, !1536 should resolve your open issue :)12:20
jjardonjennis: benschubert I think is better to use a fixed buildstream version so CI doesn't break between runs, without us knowing the cause. I think is nicer to expect errors and fix them when we intentionally upgrade the buildstream version we are using. Saying that if It's working fine for bst-plugins-container gor for it12:25
jjardonwe could have both things really; It's a matter of adding additional jobs12:26
juergbiwill take a look12:33
benschubertjjardon: what about having a fixed version that breaks the build, and the master version that is allowed failures? And then we can have the same on the BuildStream side of things?12:41
jjardonbenschubert: looks like a good idea12:50
benschubertOk, I'm starting a cleanup there then, thanks12:53
*** amin has joined #buildstream13:12
*** amin has quit IRC13:16
*** amin has joined #buildstream13:16
tme5would love some thoughts on this idea https://gitlab.com/BuildStream/buildstream/merge_requests/1423#note_20204935113:17
tme5i'm aware it's quite a breaking change for something that's not a big issue13:18
*** lachlan has joined #buildstream13:30
*** jonathanmaw has quit IRC13:32
*** lachlan has quit IRC13:37
benschubertphildawson: do you have a minute?13:42
benschubertphildawson: I don't understand how the testing of source plugins is supposed to work. In the commit you showed me, all the tests are skipped. Trying to run them fails because 'ostree' is not registered as a plugin. I don't see the place where this registration would happen. Am I missing some magic there?13:43
benschubertAlso, what do you mean by "repo_kind" ?13:47
phildawsonbenschubert, give me a couple of minutes to remind myself about how it all works.13:49
jennisjjardon, nice idea. I'm all for two jobs, providing we fix the current situation first13:50
jennisjuergbi: thanks :)13:50
benschubertjennis: I'm trying to fix it as we speak13:51
jennisbenschubert, oh nice, did you see that I had a branch? Which cherry-picked your changes and made some others?13:51
*** lachlan has joined #buildstream13:52
benschubertno, I didn't see that. I just restarted the process slightly differently13:52
benschuberthttps://gitlab.com/BuildStream/bst-plugins-experimental/merge_requests/22 is still in WIP13:52
gitlab-br-botaevri opened (was WIP) MR !1511 (aevri/spawn->master: Support the 'spawn' method of starting processes) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/151113:53
gitlab-br-botbeckyella16 opened (was WIP) MR !1529 (becky/artifact_list_contents->master: Addition of bst artifact list-contents) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/152913:54
jjardonbenschubert: probably you already noticed but master of that repo is now green. Not that it helps a lot for that specific problem but at least there is a reference point where things work13:54
benschubertjjardon: it's green because it's skipping most tests... so I'd rather have it red at that point13:55
benschubertuh it's not? ok, my bad sorry13:55
coldtomthe unix tests on bst-plugins-experimental are a bit redundant, given they basically all get skipped13:56
coldtombut the linux platform tests run13:56
phildawsonthe unix tests are getting skipped on unix because most of the tests are related to ostree, which won't run on a none linux platform13:57
benschubertAh, no they don't (at least not as you expect)13:57
benschuberthttps://gitlab.com/BuildStream/buildstream/tree/377f20fe5f2a20d8d432e9a5a09e666cdba5afb3/buildstream/plugins/sources is the version of BuildStream we have in bst-plugins-external master13:58
benschubertthat means the ostree tests are actually the tests on the buildstream repo, not the ones from the bst-plugins-experimental repo13:58
benschubertso we are not running the correct test13:58
benschubertphildawson: that probably means we never actually tested something external with your changes13:59
benschubertand explains why now that ostree is removed, the registration system doesn't work13:59
phildawsonbenschubert, that would explain it. And it hasn't been spotted until now because the docker image for bst-plugins experimental hasn't been updated since then.14:01
benschubertyep14:01
phildawsonWe really should have caught that.14:02
benschubertwe need to start having proper code reviews on this bst-plugins-experimentla, now that we are moving proper stuff in14:02
phildawsonbenschubert, agreed. Though I think this is a bug with the templated test code in buildstream, so I'm not sure how likely more thorough review of bst-experimental would have been to catch this. A bit more love in terms of regularly updating the CI image would have definitely uncovered it earlier though.14:06
benschubertyep14:06
benschubertI'm working on a fix14:06
phildawsonThanks benschubert14:06
*** lachlan has quit IRC14:23
gitlab-br-botcoldtom opened (was WIP) MR !1535 (coldtom/move-make->master: Move make plugin to bst-plugins-experimental) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/153514:23
*** lachlan has joined #buildstream14:27
jennisi also think we should enforce that each plugin has at least one test14:34
jennisthat tests its basic use14:34
benschuberthow is name of plugins discovered? Is it the name of the python module?14:39
jennisyes14:47
jennisif you're using pip source.. but the plugins have to be added as entry points14:48
jenniswell, benschubert, that's the name of the plugin package14:49
benschubertah right I see, thanks!14:49
jennisbenschubert, thanks for the MR on bst-experimental! I'll review shortly14:53
*** lachlan has quit IRC14:55
benschubertjennis: it's a WIP, I still have lots to do14:55
*** lachlan has joined #buildstream14:55
jennisah, yes, let me know when :)14:55
jennisjuergbi, are there some docs on how I can test with buildbox locally?14:56
juergbijennis: probably no docs yet but you can use: BST_FORCE_SANDBOX=buildbox tox14:57
juergbiif you've installed buildbox-fuse14:57
jennisah, perfect, thanks!14:58
*** lachlan has quit IRC15:14
*** toscalix has quit IRC15:16
coldtomis it possible to expect a certain node member to be either a list or a string in bst1.2.x? e.g. i have a parameter i want to take either a string or a list of strings15:27
*** lachlan has joined #buildstream15:33
jenniscoldtom, have you looked at the plugin methods?15:35
coldtomjennis: it looks to me like all require a single type?15:36
jennisIf not, I think I have recalled seeing self.node_get(node, list, 'foo'), then caught the error if it's not a list and then try and get the string15:36
jennisIt's pretty ugly though15:36
*** lachlan has quit IRC15:37
benschubertself.node_get(node, None, 'foo') should work if I remember correctly15:38
jennisoh nice trick. A shame it's not documented :( https://docs.buildstream.build/buildstream.plugin.html#buildstream.plugin.Plugin.node_get_member15:50
coldtomty15:50
benschubertThe new API is more explicit for this15:50
benschubertI'm confused as to why we call plugin kinds 'repo_kind', does someone has an explanation?15:55
*** lachlan has joined #buildstream15:59
*** tme5 has quit IRC16:02
*** lachlan has quit IRC16:03
*** lachlan has joined #buildstream16:08
benschubertphildawson: is it expected that we use ALL_REPO_KIND in tests that are outside of _sourcetests?16:15
*** lachlan has quit IRC16:16
*** phildawson_ has joined #buildstream16:32
*** phildawson has quit IRC16:33
*** lachlan has joined #buildstream16:49
*** rdale has quit IRC16:51
*** lachlan has quit IRC16:54
*** phildawson_ has quit IRC17:00
*** lachlan has joined #buildstream17:02
gitlab-br-botBenjaminSchubert opened MR !1537 (bschubert/register-sources-on-test->master: testing/sources: Automatically register plugin sources) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/153717:04
*** lachlan has quit IRC17:06
*** bochecha has quit IRC17:17
*** lachlan has joined #buildstream17:41
*** lachlan has quit IRC17:46
*** lachlan has joined #buildstream17:55
*** amin has quit IRC17:59
*** lachlan has quit IRC18:21
*** lachlan has joined #buildstream18:28
*** tristan has joined #buildstream18:30
*** lachlan has quit IRC19:03
*** lachlan has joined #buildstream19:12
*** tristan has quit IRC19:22
*** lachlan has quit IRC19:25
*** lachlan has joined #buildstream19:27
*** tristan has joined #buildstream19:29
*** tristan has quit IRC19:30
*** tristan has joined #buildstream19:31
*** tristan has quit IRC19:32
*** tristan has joined #buildstream19:33
*** tristan has quit IRC19:34
*** tristan has joined #buildstream19:35
*** lachlan has quit IRC19:35
*** tristan has quit IRC19:36
*** tristan has joined #buildstream19:37
*** tristan has quit IRC19:38
*** tristan has joined #buildstream19:39
*** lachlan has joined #buildstream19:42
*** tristan has quit IRC19:42
*** lachlan has quit IRC19:55
*** tristan has joined #buildstream22:04
*** tristan has quit IRC23:22

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!