IRC logs for #buildstream for Friday, 2019-11-08

*** juanalday has joined #buildstream00:18
*** juanalday has quit IRC00:21
*** dylan-m__ has quit IRC00:28
*** juanalday has joined #buildstream03:19
*** juanalday has quit IRC03:22
*** juanalday has joined #buildstream07:25
*** tpollard has joined #buildstream08:46
*** akvilebirgelyte has quit IRC09:21
*** akvilebirgelyte has joined #buildstream09:22
*** tiagogomes has joined #buildstream09:41
*** santi has joined #buildstream09:42
coldtomhi, would there be any disagreement with creating a tmpfs at `/dev/shm` in the bwrap sandbox? bazel tries to use it, but I don't want to share the host one09:55
*** jonathanmaw has joined #buildstream10:01
juergbicoldtom: I can't think of an issue with that (ignoring excessive memory usage)10:22
*** benschubert has joined #buildstream10:24
*** lachlan has joined #buildstream10:30
*** lachlan has quit IRC10:31
*** lachlan has joined #buildstream10:32
tpollardsharing the host one does seem somewhat anti-sandbox10:37
tlater[m]coldtom: Once again, we don't use the host one!10:40
tlater[m]*Unless* you're running BuildStream interactively with `bst shell`10:40
coldtomtlater[m]: *or* unless you actually specify to include /dev/shm in the sandbox, when it gets --dev-bind'ed in too10:41
coldtomusing either `Sandbox.mark_directory()` or adding it to DEVICES10:42
coldtombut without using one of these apis, /dev/shm doesn't exist in the sandbox10:43
tlater[m]Yes, I think the issue is that we want an API for adding /dev/shm, not that we're adding the host /dev/shm10:43
coldtomyeah, would this be better as an api to add a generic tmpfs or just adding /dev/shm by default?10:44
tlater[m]I'd prefer a generic way, though I'm not entirely sure what that would look like10:45
juergbiI would say the sandbox should setup /dev/shm by default10:46
juergbilibc shm_open() depends on this on Linux10:46
juergbii.e., it's required for POSIX support on Linux10:46
juergbiand as this is platform-specific, we should rather not expose it to plugins10:47
tlater[m]juergbi: Does that work in a userchroot world?10:47
juergbitlater[m]: yes, userchroot --install-devices mounts a 128MB tmpfs on dev/shm10:48
juergbiwe should probably limit the size in our sandbox as well10:48
juergbiand an integration test using shm_open would make sense10:52
gitlab-br-botBenjaminSchubert opened MR !1690 (bschubert/fix-children-termination->master: app.py: Also catch SystemError with click.Abort) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/169011:43
gitlab-br-bottpollard approved MR !1690 (bschubert/fix-children-termination->master: app.py: Also catch SystemError with click.Abort) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/169011:44
benschubertjuergbi: you also were seeing ^ on 1.4 right? So we should backport. Only on 1.4 or also 1.2?11:45
benschubert(I mean do we need another backport than 1.4?)11:45
*** lachlan has quit IRC11:53
juergbibenschubert: yes, I saw that on 1.411:55
juergbidoes anyone still care about 1.2? no idea11:56
juergbidon't have a venv for it anymore11:56
coldtomafaik there are no fdsdk-derived projects still using 1.211:56
benschubertok! I'll backport to 1.4 only then, thanks!12:03
*** tpollard has quit IRC12:12
*** tpollard has joined #buildstream12:13
*** lachlan has joined #buildstream12:15
gitlab-br-botmarge-bot123 merged MR !1690 (bschubert/fix-children-termination->master: app.py: Also catch SystemError with click.Abort) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/169012:16
tpollardThanks for catching that one benschubert12:18
benschuberttpollard: more to come ;)12:18
*** lachlan has quit IRC12:21
gitlab-br-botBenjaminSchubert opened MR !1691 (bschubert/fix-children-termination->master: scheduler.py: Prevent the asyncio loop from leaking into subprocesses) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/169112:22
benschubertjuergbi: ^ I'd appreciate a thorough review on this one :)12:22
benschubertespecially on the comments and such, since it's quite arcane...12:23
benschuberttpollard: ^ is the last blocker before I can actually fix the worker errors ;)12:23
juergbiwill take a look12:23
tpollardI'll take a look too :)12:25
benschubertthanks! And if you want to ensure the behavior is correct:12:26
benschubertadd 'assert False' at https://gitlab.com/BuildStream/buildstream/blob/master/src/buildstream/_scheduler/scheduler.py#L496, and try ctrl-c twice once the pipeline is running :)12:26
benschubertAnd then change the branch while keeping the 'assert False'12:26
*** lachlan has joined #buildstream12:39
*** lachlan has quit IRC12:43
*** lachlan has joined #buildstream12:57
*** lachlan has quit IRC13:02
*** santi has quit IRC13:12
*** santi has joined #buildstream13:46
*** jonathanmaw has quit IRC14:04
*** lachlan has joined #buildstream14:56
gitlab-br-botBenjaminSchubert opened MR !1692 (bschubert/graceful-children-sigterm->master: Gracefully shutdown children on termination) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/169215:00
benschuberttpollard: ^ :D15:02
benschubertplease try to break it as inventively as you can ;)15:02
*** lachlan has quit IRC15:05
*** slaf has quit IRC15:19
*** slaf has joined #buildstream15:19
*** slaf has joined #buildstream15:19
*** phil has joined #buildstream15:20
*** slaf has joined #buildstream15:20
*** slaf has joined #buildstream15:20
*** slaf has joined #buildstream15:20
*** slaf has joined #buildstream15:20
*** phildawson_ has quit IRC15:21
gitlab-br-botcs-shadow closed issue #1175 (buildobx-casd doesn't exit cleanly after some BuildStream errors) on buildstream https://gitlab.com/BuildStream/buildstream/issues/117515:30
gitlab-br-botcoldtom opened issue #1197 (/dev/shm not available in sandbox (bwrap)) on buildstream https://gitlab.com/BuildStream/buildstream/issues/119715:36
gitlab-br-botcoldtom opened MR !1694 (coldtom/allow-dev-shm->master: _sandboxbwrap.py: Create /dev/shm in the sandbox) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/169415:38
*** lachlan has joined #buildstream15:40
*** santi has quit IRC15:43
*** lachlan has quit IRC15:46
*** lachlan has joined #buildstream15:47
gitlab-br-botcs-shadow closed issue #1027 (bst build --track documentation is unclear) on buildstream https://gitlab.com/BuildStream/buildstream/issues/102715:48
cs-shadowWSalmon: hi, mind having a look at https://gitlab.com/BuildStream/buildstream/issues/519#note_228932922 to see if it's still relevant15:51
WSalmoncs-shadow, no problem15:52
cs-shadowthanks :)15:52
WSalmonbut its based on freedesktop so im not sure i can see how well it work on master,15:52
WSalmoni will have another look anyway15:53
WSalmonand remind myself what i was doing15:53
*** phil has quit IRC15:54
*** lachlan has quit IRC15:57
coldtomWSalmon: bschubert/freedesktop-sdk-19.08.3-bst2 branch in freedesktop-sdk works with master, so you could use that to check16:04
gitlab-br-botBenjaminSchubert approved MR !1694 (coldtom/allow-dev-shm->master: _sandboxbwrap.py: Create /dev/shm in the sandbox) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/169416:06
benschubertjuergbi: https://gitlab.com/BuildStream/buildstream/-/jobs/345764095 have any idea?16:08
juergbibenschubert: doesn't look familiar16:10
tpollardI've never seen that one16:10
benschubertyeah, that seems to be coming from my changes16:10
benschubertbut why only in this one? -_-'16:11
benschubertand I don't like the 'bad file descriptor' there16:11
benschubertguess I need more thorough testing16:11
*** lachlan has joined #buildstream16:18
gitlab-br-botcs-shadow closed issue #691 (BuildStream does not automatically fetch a junction within a junction / displays an inaccurate helper) on buildstream https://gitlab.com/BuildStream/buildstream/issues/69116:18
WSalmonshould this be a thing?16:19
WSalmon(venvbuildstream) [will@wsx280 buildstream-kicad]$ bst source track freedesktop-sdk.bst16:19
WSalmonError loading user configuration: /home/will/projects/buildstream/venvbuildstream/lib64/python3.7/site-packages/buildstream/data/userconfig.yaml: Severely malformed YAML:16:19
WSalmon'NoneType' object is not callable16:19
WSalmoni havent played with master for a while so i checked out master and pip unintalled and re installed and git a git clean16:20
benschubertWSalmon: pip uninstall ruamel.yaml.clib && pip install ruamel.yaml.clib and retry please :)16:20
WSalmonthanks benschubert16:21
WSalmoni see casd has main its way in to master, well dont juergbi! et al! now to rember how to install it16:22
juergbibenschubert: corresponding file descriptor closed without calling set_wakeup_fd(-1)?16:22
benschubertjuergbi: yep16:23
benschubertthis doesn't happen when testing locally16:23
benschubertso I have no idea where this is happening16:23
benschubertalso, the test passed after a retry16:23
cs-shadowWSalmon: https://buildstream.build/buildbox_install.html16:25
*** lachlan has quit IRC16:29
*** lachlan has joined #buildstream16:29
WSalmongit clone https://gitlab.com/BuildGrid/buildbox/buildbox-casd.git16:29
WSalmoncd buildbox-casd16:29
WSalmongit checkout 0.0.416:29
WSalmoncmake -DBUILD_TESTING=OFF -Bbuild16:29
WSalmonmake -C build16:29
WSalmonmake -C build install n16:29
WSalmonsorry16:30
WSalmonthis was left in my paste buffer16:30
tpollard:)16:33
*** phil has joined #buildstream16:34
*** lachlan has quit IRC16:36
*** tpollard has quit IRC16:43
*** lachlan has joined #buildstream16:49
*** lachlan has quit IRC16:53
WSalmonis this https://hastebin.com/ipudohilok.sql just me? fells like we would rather have this have a better error message even if its my bad yaml16:53
benschubertWSalmon: please use gitlab snippets, I can't access this16:55
WSalmonoh ok16:55
gitlab-br-botcs-shadow opened MR !1695 (chandan/stack-no-sources->master: plugins/elements/stack: Disallow sources) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/169517:03
gitlab-br-botBenjaminSchubert approved MR !1695 (chandan/stack-no-sources->master: plugins/elements/stack: Disallow sources) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/169517:04
juergbiWSalmon: this means the plugin is not compatible with the buildstream version17:05
juergbinot invalid yaml17:05
*** santi has joined #buildstream17:05
WSalmonbenschubert, https://gitlab.com/willsalmon/buildstream-kicad/snippets/191154917:07
cs-shadowWSalmon: seems like you need a newer version of bst-plugins-exeperimental17:07
WSalmonfair17:08
WSalmonbut should we also have a nicer error message?17:08
cs-shadowit'll be nice from a UX perspective, but I'm not sure if it's worth maintaining such compatiability across development releases17:09
WSalmonI have seen that error before for other things, should it not be wrapped a i little?17:13
gitlab-br-botmarge-bot123 merged MR !1695 (chandan/stack-no-sources->master: plugins/elements/stack: Disallow sources) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/169517:19
WSalmonany one under stand what is going on hear? https://gitlab.com/willsalmon/buildstream-kicad/snippets/191155217:23
*** santi has quit IRC17:24
gitlab-br-botcs-shadow closed issue #699 (invalid buildstream.conf format returns stacktrace) on buildstream https://gitlab.com/BuildStream/buildstream/issues/69917:24
benschubertWSalmon: that should be https://gitlab.com/BuildStream/buildstream/issues/1178 right?17:31
*** juanalday has quit IRC17:34
*** phildawson_ has joined #buildstream17:35
*** phil has quit IRC17:35
WSalmonbenschubert, yep, but why dose your branch of free desktop not remove the caches or dose it get round it a diffrent way?17:39
benschubertWSalmon: BuilDStream used to check for capabilities, and it's currently broken on master17:41
WSalmonah17:42
benschubertso I don't want to remove it because it will hide the fact that this is broken and intend on fixing this17:42
WSalmonyep17:42
*** lachlan has joined #buildstream17:53
*** lachlan has quit IRC17:57
gitlab-br-botBenjaminSchubert opened MR !1696 (bschubert/expand-path-configs->master: _remote.py: Expand user in certificates paths) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/169617:57
*** bochecha has quit IRC17:58
*** lachlan has joined #buildstream18:20
gitlab-br-botcs-shadow opened MR !1697 (chandan/no-command-general-elements->master: Indicate that compose & stack plugins do not run commands) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/169718:28
*** lachlan has quit IRC18:28
*** lachlan has joined #buildstream18:33
*** lachlan has quit IRC18:49
*** tiagogomes has quit IRC18:50
*** lachlan has joined #buildstream18:57
*** nhbh^ has joined #buildstream19:37
*** lachlan has quit IRC20:37
*** cs-shadow has quit IRC20:46
*** narispo has quit IRC22:07
*** juanalday has joined #buildstream22:09
*** juanalday has quit IRC22:20

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!