IRC logs for #buildstream for Tuesday, 2019-11-12

*** rdale has quit IRC04:53
*** ingoerler has joined #buildstream06:40
*** ingoerler has quit IRC06:42
juergbitlater[m]: I'm now also seeing the empty alpine base issue with bb-run-userchroot and your branch. I'll start looking into this as well unless you've already discovered the root cause08:00
juergbiI'll keep you posted08:01
*** traveltissues has joined #buildstream08:47
gitlab-br-botBenjaminSchubert approved MR !1702 (chandan/fix-implicit-string-concat->master: tests/frontend/completions: Fix implicit string concatenation) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/170209:20
tlater[m]Ta juergbi - not figured it our yet, no, though I may not yet have changed the tempdir to be group-writeable09:23
*** rdale has joined #buildstream09:27
benschubertDoes someone knows why we have:09:39
benschubert```09:39
benschubert        # Write down the user configuration file09:39
benschubert        _yaml.roundtrip_dump(user_config, file=user_config_file)09:39
benschubert        # Ensure CLI calls will use it09:39
benschubert        cli.configure(user_config)09:39
benschubert```09:39
benschubertIn most tests? I would expect one of them, but both?09:39
*** tiagogomes has joined #buildstream09:42
traveltissuesthat doesn't seem right09:46
*** santi has joined #buildstream09:46
gitlab-br-bottpollard approved MR !1701 (bschubert/backport-1690->bst-1: app.py: Also catch SystemError with click.Abort) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/170109:47
gitlab-br-bottraveltissues approved MR !1702 (chandan/fix-implicit-string-concat->master: tests/frontend/completions: Fix implicit string concatenation) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/170209:56
juergbitlater[m]: the sourcecache staging temp dir is group readable but not executable09:56
juergbinot sure why, though09:56
juergbialso, utils._group_tempdir() doesn't pass on the kwargs09:56
juergbibenschubert: might have been incomplete migration to cli.configure(), no idea09:59
benschubertjuergbi: ok :) thanks!09:59
benschubertjuergbi: do you know if there is a helper to create an artifact server that forbids 'push' for the testsuite?10:02
juergbibenschubert: I don't know, brief look at the code seems like it's always enable push10:03
juergbishould be simple enough to parametrize, though10:03
benschubertright :) thanks!10:03
tpollardyou could set push to false in the user_config, but obviously that's not the server itself forbidding push10:04
benschuberttpollard: yeah I want to forbid the server10:04
benschubertbecause master currently will trip if you set 'push' = true but your server doesn't allow it :)10:04
juergbitlater[m]: ok, found it. looks like tar's stage() method changes the permission bits of the directory10:06
juergbiwe currently enforce at least 0440 permissions10:07
juergbibut that doesn't provide x for directories10:07
juergbiworkaround shouldn't be too difficult but have to think about how to handle this in general10:07
tlater[m]juergbi: Gah, I missed that :|10:11
tlater[m]Yeah, there are a lot of workarounds about, we need something a bit more generic than that branch10:12
juergbithe original 0400 was also buggy in that regard10:13
tlater[m]Odd that we never ran into that issue, though10:14
juergbiit's very uncommon for tar files to have directories that are not readable/executable by the owner, I suppose10:14
juergbiso unless we have a test for that, easy to miss10:15
juergbifor group permissions it's probably more common10:15
juergbifor now we could say sources must respect umask and not do anything more restrictive10:16
*** jonathanmaw has joined #buildstream10:16
juergbithis wouldn't allow exploiting the new UnixMode node property, however, we don't have immediate plans for that yet anyway (#38)10:17
juergbibut we should probably think about the long term plan, to avoid imposing this constraint on sources now and changing that again later on10:18
*** adds68 has joined #buildstream10:22
benschubertshould a server configured as `push` which doens't allow `push` be blacklisted entirely?10:27
juergbinot sure, I'd rather say to keep it for pull10:29
juergbibut at least warn10:29
benschubertok, because currently it's entirely blacklisted :)10:30
coldtomi would expect it to just pull too10:31
gitlab-br-bottraveltissues opened issue #1201 (Improve error communication from buildbox) on buildstream https://gitlab.com/BuildStream/buildstream/issues/120110:31
*** lachlan has joined #buildstream10:32
*** bochecha has joined #buildstream10:47
gitlab-br-bottraveltissues opened issue #1202 (Test colors and no-colors outputs) on buildstream https://gitlab.com/BuildStream/buildstream/issues/120210:50
gitlab-br-bottraveltissues approved MR !1704 (chandan/fix-no-color->master: _frontend: Simplify color handling) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/170410:51
benschuberttlater[m]: with your cas work, are you refactoring parts of the tests too or not?11:19
gitlab-br-botmarge-bot123 merged MR !1702 (chandan/fix-implicit-string-concat->master: tests/frontend/completions: Fix implicit string concatenation) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/170211:27
tlater[m]benschubert: A tiny bit. Not by much, just adding logs to them.11:31
gitlab-br-bottraveltissues opened issue #1203 (Performance regression in `bst show` and `bst build`) on buildstream https://gitlab.com/BuildStream/buildstream/issues/120311:32
gitlab-br-botBenjaminSchubert opened MR !1705 (bschubert/fix-capa-check->master: Fix capabilities check of remotes) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/170511:42
benschubert^ should also fix our overnight tests (unless something more is broken)11:43
tlater[m]benschubert: Is that RemoteError caught and then resolved so that one server not supporting capabilities doesn't keep all the others from being used?11:47
benschuberttlater[m]: I haven't changed the behavior of the RemoteError11:48
benschubertif tyou look at _remote.py:BaseRemote.check(), it does throw a RemoteError on error11:48
benschubertso if that worked, I would expect it to still work :)11:48
tlater[m]Right, yeah, I suspect it was missed during a refactor then.11:49
tlater[m]Ta benschubert :)11:49
gitlab-br-bottlater approved MR !1705 (bschubert/fix-capa-check->master: Fix capabilities check of remotes) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/170511:49
tlater[m]I also really like the context manager for the artifact share11:50
tlater[m]It's cute to spin up a grpc server that does nothing :D11:51
gitlab-br-bottraveltissues approved MR !1705 (bschubert/fix-capa-check->master: Fix capabilities check of remotes) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/170511:52
coldtomhi, i'm trying to point a bst (master) project at a remote cache, but the remote is failing to initialise with "OS Error", I managed to get a more verbose error which tells me it's coming from casd.sock, anyone know if this is from the server or the client?11:53
benschubertcoldtom: you should have casd logs in ~/.cache/buildstream/casd/logs/ , do you get anything there?11:55
benschuberttlater[m]: was the easiest way :D11:56
benschubertand this thing that does nothing catches two bugs :D11:56
coldtomah, looks like it's at least trying to connect, thanks benschubert11:58
benschubertwhat's Benchmark_Prio-1 ? :D12:01
lachlanbenschubert: This is initial testing of the benchmarking bot and that is a label used to signify that benchmarking should be carried out on that particular MR.12:06
benschubertoh sweet!12:06
tlater[m]lachlan: Any problem with modifying the MR while that is running?12:10
lachlantlater[m]: Shouldn't be12:13
lachlanThe note ref is fixed in the benchmarking pipeline build variable12:13
* tlater[m] just so happens to want to pick that MR up again today :D12:13
lachlanand the sha is fixed as well12:13
lachlanhttps://gitlab.com/BuildStream/buildstream/merge_requests/1660#note_24339674712:14
lachlanhttps://gitlab.com/BuildStream/benchmarking/benchmarks/pipelines/9533671012:14
benschuberttpollard: when running the WSL benchmark, do you still ahve the exact cmdline? And how was the terminal positioned? :)12:19
tpollardtraveltissues ^12:20
tpollardbenschubert: as a side note, would you have an issue if I proposed moving the _multiprocessing to the root of our modules?12:22
tpollardas I think I should be used it when multiprocessing in my branch12:23
benschubertNo issue at all :)12:23
tpollardcool!12:25
benschubertMy aim for this module would be to abstract away all weird things we need to do with multiprocessing: Be it to support Windows, or fork, or whatever :) And I'd like to introduce in the future a _asyncio that would do the same around asyncio :)12:26
traveltissuestpollard, vertical second monitor fullscreeen12:26
benschubertso we don't need to care anywhere else about those, and stop having the 'if windows: do_this; else do_that'12:27
benschuberttraveltissues: thanks! I'll run it the same, the embeded wsl terminal right?12:27
traveltissuestime bst --builders 4 build base-files/base-files.bst12:27
traveltissuesbenschubert, yes12:27
benschubertwith BST_PROFILE=SUBPROCESS right?12:27
tpollardnote the times listed on the MR are without the profile running, that will add it's own overheads ofc12:27
traveltissuesno12:28
benschubertok! So I'll run it twice with and without profile, cheers12:28
tpollardthanks12:31
traveltissuesbenschubert, i'm launching the ubuntu 18.04 LTS app12:31
gitlab-br-botmarge-bot123 closed issue #1200 (`bst init` does not respect `--no-colors`) on buildstream https://gitlab.com/BuildStream/buildstream/issues/120013:01
gitlab-br-botmarge-bot123 merged MR !1704 (chandan/fix-no-color->master: _frontend: Simplify color handling) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/170413:01
*** santi has quit IRC13:39
*** santi has joined #buildstream13:49
*** traveltissues has quit IRC14:27
gitlab-br-botmarge-bot123 closed issue #1178 (BuildStream doesn't check that the artifact remotes has the required capabilities) on buildstream https://gitlab.com/BuildStream/buildstream/issues/117814:31
gitlab-br-botmarge-bot123 merged MR !1705 (bschubert/fix-capa-check->master: Fix capabilities check of remotes) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/170514:31
gitlab-br-botBenjaminSchubert closed issue #1198 (overnight tests are failing:  "tests/check-platform.bst: Failed to pull artifact: Method not found!") on buildstream https://gitlab.com/BuildStream/buildstream/issues/119814:36
*** cs-shadow has joined #buildstream14:45
gitlab-br-botcs-shadow opened (was WIP) MR !1703 (chandan/black->master: Use Black to format code) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/170314:45
* tpollard looks forward to the diff14:48
bochechahi, anything I can do to get this merged? https://gitlab.com/BuildStream/bst-external/merge_requests/10915:08
*** lachlan has quit IRC15:22
*** lachlan has joined #buildstream15:24
*** santi has quit IRC15:45
*** santi has joined #buildstream15:45
*** lachlan has quit IRC15:47
bochechajjardon: ha, thanks!16:05
benschubertbochecha: would it be possible to also make a PR against bst-plugins-experimental for this?16:06
bochechabenschubert: I was waiting for the first one to be accepted, so I didn't have review feedback in two places at the same time16:07
bochechaI'm doing the -experimental right now :)16:07
benschubertgreat!16:07
bochecha(you had already asked me last week I think? :P)16:07
benschubertGah, growing old it seems :'D16:07
bochechahehe16:07
bochechasame for me, I would have completely forgotten about the MR itself if I hadn't kept the tab open in Firefox16:08
bochechabenschubert: there you go: https://gitlab.com/BuildStream/bst-plugins-experimental/merge_requests/5116:10
benschubertthanks!16:11
*** tpollard has quit IRC16:23
*** tpollard has joined #buildstream16:25
*** lachlan has joined #buildstream16:34
*** lachlan has quit IRC16:42
*** santi has quit IRC16:44
*** lachlan has joined #buildstream16:54
*** lachlan has quit IRC16:58
*** santi has joined #buildstream16:58
tpollardhmm, I think some of the colouring of the UI has gone since 170416:58
*** lachlan has joined #buildstream17:03
gitlab-br-bottpollard opened issue #1204 (Colourisation lost in Status UI) on buildstream https://gitlab.com/BuildStream/buildstream/issues/120417:13
*** jonathanmaw has quit IRC17:28
tlater[m]cs-shadow: I don't want to scope creep that MR too much, I'd just like to catch all files now if it's not too much effort. Current exceptions are mostly accidental, with the exception of proto/fuse stuff, it would be nice to clean that up.17:32
cs-shadowtlater[m]: I get that. As I said in the last comment, I was just not sure whether anyone was planning on `sphinx-quickstart` ever again17:33
* cs-shadow thinks not17:33
tlater[m]Hah17:34
*** testy has joined #buildstream17:41
*** lachlan has quit IRC17:55
*** santi has quit IRC18:02
*** lachlan has joined #buildstream18:16
*** testy has quit IRC18:26
*** phoenix has joined #buildstream18:39
*** testy has joined #buildstream18:42
*** lachlan has quit IRC19:04
gitlab-br-botcs-shadow opened issue #1205 (Improve messaging around state of junction elements) on buildstream https://gitlab.com/BuildStream/buildstream/issues/120520:15
*** phoenix has quit IRC20:23
*** bochecha_ has joined #buildstream21:30
*** cs-shadow has quit IRC21:37
*** lantw44 has quit IRC22:10
*** lantw44 has joined #buildstream22:11
*** rdale has quit IRC23:10
*** bochecha_ has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!