IRC logs for #buildstream for Friday, 2019-05-10

*** slaf_ has joined #buildstream01:38
*** slaf_ has joined #buildstream01:38
*** slaf_ has joined #buildstream01:39
*** slaf_ has joined #buildstream01:39
*** slaf_ has joined #buildstream01:39
*** slaf_ has joined #buildstream01:40
*** slaf has quit IRC01:40
*** slaf has joined #buildstream01:40
*** slaf has joined #buildstream01:40
*** nimish2711 has joined #buildstream02:37
*** nimish2711 has quit IRC03:19
*** nimish2711 has joined #buildstream03:29
*** nimish2711 has quit IRC03:48
*** tristan has joined #buildstream07:46
*** u60d8809d0 has joined #buildstream08:04
*** u60d8809d0 has quit IRC08:12
gitlab-br-bottristanvb closed issue #1014 (bst build --track-all doesn't build anything) on buildstream https://gitlab.com/BuildStream/buildstream/issues/101408:15
gitlab-br-bottristanvb merged MR !1332 (tristan/fix-build-track-all-no-strict->master: Fix build track all no strict) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/133208:15
gitlab-br-bottristanvb merged MR !1331 (tristan/fix-build-track-all-no-strict-1.2->bst-1.2: Fix build track all no strict 1.2) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/133108:15
*** bochecha has joined #buildstream08:23
*** jonathanmaw has joined #buildstream08:40
*** raoul has quit IRC08:44
*** raoul has joined #buildstream08:49
*** tristan has quit IRC08:59
*** toscalix has joined #buildstream09:05
*** toscalix has quit IRC09:07
*** toscalix has joined #buildstream09:07
*** tristan has joined #buildstream09:09
tpollardthe margebot container has been restarted, nothing in the logs since May 7th09:26
tpollardseems to be working again09:35
gitlab-br-botjennis opened issue #1022 (The local cache quota is actually a CAS cache quota) on buildstream https://gitlab.com/BuildStream/buildstream/issues/102209:36
KinnisonHurrah, thanks tpollard09:36
jennisthanks tpollard!09:37
tpollardhmmm, it was active 14 minutes ago09:41
*** lachlan has joined #buildstream09:43
*** lachlan has quit IRC10:07
*** lachlan has joined #buildstream10:09
*** lachlan has quit IRC10:18
*** admin has joined #buildstream10:22
gitlab-br-botmarge-bot123 merged MR !1335 (aevri/retry_flag->master: jobs/job.py: refactor, rm redundant _retry_flag) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/133510:22
*** lachlan has joined #buildstream10:23
aevriBelated thanks tpollard!10:24
*** lachlan has quit IRC10:40
*** lachlan has joined #buildstream10:43
*** lachlan has quit IRC10:55
*** jennis has quit IRC11:03
*** lachlan has joined #buildstream11:05
*** jennis_ has joined #buildstream11:07
*** jennis_ is now known as jennis11:07
*** lachlan has quit IRC11:16
*** lachlan has joined #buildstream11:25
benschubertDid anyone ever managed to get buildstream work with BuildGrid? I have spawn a docker compose like https://gitlab.com/BuildGrid/buildgrid/tree/master/, I get a "StatusCode.UNIMPLEMENTED" when querying the action cache11:25
juergbibenschubert: basic remote execution with BuildGrid is actually tested in CI: https://gitlab.com/BuildStream/buildstream/-/jobs/21033865911:37
benschubertright -_-'11:37
juergbimaybe a configuration difference that breaks this11:38
benschubertyep, I managed ot work further. Do you know what I should use as a "instance-name" It's telling me it's invalid11:38
juergbibenschubert: in my local bgd config I have "" as instance name11:40
juergbithat works when no instance name is configured in the client11:40
benschubertjuergbi: in what place should this config be put?11:40
juergbithat was for my local (manual) test setup, not using docker-compose11:43
juergbithe docker-compose prepared config should already have that, let me check11:43
benschubertthanks11:45
juergbiyes, empty/default instance name is used in https://gitlab.com/BuildGrid/buildgrid.hub.docker.com/blob/master/buildgrid/config/controller.conf and storage.conf11:45
juergbiand those files should be in the docker images used by docker-compose.yml11:45
benschubertjuergbi: do you have the configuration for buildstream that would be correct then?11:45
juergbibenschubert: I don't have a tested buildstream config for the docker-compose setup but it should be relatively straight forward11:47
juergbihttps://buildgrid.gitlab.io/buildgrid/installation.html#install-through-docker11:47
juergbiexecution service on port 50051, storage service on 5005211:47
juergbioptional action cache service on 5005111:47
juergbithe bottom of https://buildgrid.gitlab.io/buildgrid/using_buildstream.html can be used as starting point11:48
juergbiexcept that artifacts/storage has to be changed to 5005211:49
juergbidon't know otoh whether docker-compose still provides an artifact server (referencestorage service). if not, the `artifacts` section should be removed or replaced with the URL to a separate bst-artifact-server11:49
benschubertjuergbi: the keys/certs should not be there at all correct?11:51
juergbicorrect. thsi was a workaround for a limitation in config handling11:52
juergbishould no longer be necessary in master11:52
juergbiwe should remove this from buildgrid doc11:52
juergbiwould probably be good to update the config example to match docker-compose.yml while we're at it11:52
*** lachlan has quit IRC11:54
*** lachlan has joined #buildstream11:55
benschubertjuergbi: so CAS + AC are the "storage" and cache is another cas cache?11:56
SotKthe docker compose file in https://gitlab.com/BuildGrid/buildgrid/ uses different config to the one in https://gitlab.com/BuildGrid/buildgrid.hub.docker.com/11:57
SotKand has CAS, AC, and the Execution service in different containers11:58
SotKs/different/separate/11:58
*** lachlan has quit IRC11:59
SotKit also doesn't work with buildstream because the dockerfile in that repo doesn't produce an image with buildbox in it, so the stuff from https://gitlab.com/BuildGrid/buildgrid.hub.docker.com/ is probably easier to use for trying it out with buildstream12:00
benschubertSotK: oh ok thanks a lot!12:03
tpollardif any can build freedesktop that that docker compose and bst master I'd be interested to hear12:30
benschubertjuergbi: , SotK I'm getting something like "Failed to query action cache: StatusCode.UNIMPLEMENTED (Method not found!)" when following https://gitlab.com/BuildGrid/buildgrid.hub.docker.com/blob/master/Composefile.buildstream.yml12:35
benschubertAny idea where this comes from?12:35
SotKsounds like one of the urls in your project.conf is wrong12:36
SotKcan you paste the remote-execution section of that?12:36
gitlab-br-botvalentindavid opened MR !1339 (valentindavid/git-get-ref-warnings->master: buildstream/_gitsourcebase.py: Fix return of get_ref() when no ref is available) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/133912:36
benschubertSotK:12:37
benschubertartifacts:12:37
benschubert  url: http://localhost:5005212:37
benschubert  push: true12:37
benschubertremote-execution:12:37
benschubert  execution-service:12:37
benschubert    url: http://localhost:5005112:37
benschubert  action-cache-service:12:37
benschubert    url: http://localhost:5005212:37
benschubert  storage-service:12:37
benschubert    url: http://localhost:5005212:37
SotKhm, that looks like what I would expect to work12:39
SotK(assuming you're running the containers on the same machine as buildstream)12:41
benschubertI am12:41
juergbibenschubert: does it work without action cache?12:41
raoulbenschubert (or anyone else that wants to look), would you be happy for me to pass !1330 over to marge? Not got approves but I think it's a small enough change that it's not controversial12:47
gitlab-br-botMR !1330: Ensure previous sources refs are updated during track https://gitlab.com/BuildStream/buildstream/merge_requests/133012:47
benschubertjuergbi: without the action cache it seems to work better (staging currently)12:52
*** toscalix has quit IRC13:16
*** toscalix has joined #buildstream13:17
*** lachlan has joined #buildstream13:30
*** admin has left #buildstream13:31
*** lachlan has quit IRC13:37
gitlab-br-botmarge-bot123 merged MR !1338 (coldtom/backport-MR792->bst-1.2: Backport !792 to bst-1.2) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/133813:40
benschubertMmh I've made progres sbut now get " No such file or directory: 'buildbox': 'buildbox'"13:55
benschubertDoes that ring a bell?13:56
*** nimish2711 has joined #buildstream13:59
juergbibenschubert: that's with Composefile.buildstream.yml from buildgrid.hub.docker.com?14:22
juergbithe image is supposed to include buildbox, don't know why it can't find it14:22
juergbishould be the same image as in CI, which works, though14:23
SotKyeah, I've also only ever seen that error using the image built from the dockerfile in the buildgrid repo itself14:28
*** nimish2711 has quit IRC14:43
gitlab-br-botraoul.hidalgocharman opened issue #1023 (CI test suite hanging) on buildstream https://gitlab.com/BuildStream/buildstream/issues/102314:45
* raoul grumbles and creates issue for CI pipeline hanging14:45
*** lachlan has joined #buildstream14:45
raoulAfter having to retry jobs a few times, the pipeline does pass for !1319, would you be happy for that to be merged juergbi?14:47
gitlab-br-botMR !1319: Add BST_REQUIRES_PREVIOUS_SOURCE_STAGE option https://gitlab.com/BuildStream/buildstream/merge_requests/131914:47
*** nimish2711 has joined #buildstream14:49
*** xjuan has joined #buildstream15:02
*** lachlan has quit IRC15:06
*** lachlan has joined #buildstream15:20
*** lachlan has quit IRC15:27
*** xjuan has quit IRC15:31
*** lachlan has joined #buildstream15:36
*** lachlan has quit IRC15:40
*** lachlan has joined #buildstream15:42
benschubertjuergbi: mmh seems to work now. Anyways. last problem is with a workspace... I don't get the elements?15:51
benschubertI don't get what's from the workspaced element I mean15:51
juergbibenschubert: remote execution doesn't support workspaces yet15:52
benschubertright, I thought I had seen something, sorry about that15:52
benschubertthanks!15:52
juergbiI've proposed a change in how we handle workspaces (via CAS) quite a while ago and that would allow workspaces with RE but it hasn't been implemented yet15:54
*** xjuan has joined #buildstream15:56
*** xjuan has quit IRC16:01
*** bochecha has quit IRC16:06
*** tpollard has quit IRC16:14
*** lachlan has quit IRC16:24
*** cs-shadow has quit IRC16:27
*** lachlan has joined #buildstream16:28
*** raoul has quit IRC16:44
*** nimish2711 has quit IRC16:45
*** jonathanmaw has quit IRC16:54
*** lachlan has quit IRC16:57
*** nimish2711 has joined #buildstream17:16
*** nimish2711 has quit IRC17:24
*** nimish2711 has joined #buildstream17:27
*** nimish2711 has quit IRC17:35
*** lachlan has joined #buildstream17:53
*** toscalix has quit IRC18:13
*** nimish2711 has joined #buildstream18:37
*** xjuan has joined #buildstream18:43
*** lachlan has quit IRC18:45
*** nimish2711 has quit IRC18:45
*** nimish2711 has joined #buildstream18:46
*** lachlan has joined #buildstream19:36
*** dftxbs3e has quit IRC19:45
*** nimish2711 has quit IRC19:48
*** lachlan has quit IRC19:56
*** xjuan has quit IRC20:24
*** dftxbs3e has joined #buildstream21:53
*** dftxbs3e has quit IRC23:43

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!