IRC logs for #buildstream for Thursday, 2018-05-31

*** Prince781 has joined #buildstream01:12
*** Prince781 has quit IRC01:52
*** Prince781 has joined #buildstream03:40
*** Prince781 has quit IRC06:38
noisecelljjardon, thank you for that :)06:42
*** ernestask has joined #buildstream07:06
*** jsgrant has joined #buildstream07:08
paulsherwoodjuergbi: are you aware of this https://github.com/google/gvisor ?07:27
juergbino, I don't think so, reading07:28
juergbiit's interesting but at a first glance I don't see a big benefit compared to BuildStream's current approach and I expect the performance to be lower (and there may be compatibility issues)07:33
juergbipaulsherwood: is there a particular aspect that you think would benefit BuildStream or did you just want to make sure we're aware of it?07:35
paulsherwoodjuergbi: i only heard about it today (in the context of the 'no hypervisor required' discussion)... and just wondered if it was worth considering for isolation in buildstream07:38
paulsherwoodbut actually it seems to be x86_64 only in any case07:39
juergbiyes07:39
paulsherwoodso an interesting curiosity, for now07:39
paulsherwoodbut i guess this is the 'google folks are re-writing linux in go' project i heard about a couple of years ago07:40
juergbiwe can probably improve our sandbox but I don't think we need to completely change the approach there07:40
paulsherwoodack07:41
juergbino idea. maybe they will support gVisor on top of Fuchsia07:41
juergbiif gVisor supported other host operating systems, it could be interesting for macOS. although, virtualized Linux will likely cover that case as well07:42
juergbi(as in VM)07:43
juergbion Windows there is already WSL07:43
*** toscalix has joined #buildstream07:54
*** finn has joined #buildstream07:54
*** dominic has joined #buildstream08:01
*** jonathanmaw has joined #buildstream08:20
paulsherwoodover in #baserock, the move from 1.1.2 to 1.1.3 seems to have broken the build... are there known issues?08:31
gitlab-br-botbuildstream: merge request (juerg/googlecas->master: Remote Execution CAS-based artifact cache) #337 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/33708:35
juergbiwill look into this now08:35
juergbivalentind: fyi, I've applied a couple of tweaks to the googlecas branch08:37
juergbiset minimum version for protobuf dependency to fix `__new__() got an unexpected keyword argument 'file'`08:37
juergbiand updated documentation to set CN also for client certificate08:38
juergbiif you have additional feedback, please let me know08:38
gitlab-br-botbuildstream: merge request (jennis/alternative_remote_expiry->master: Expire artifacts in the remote artifact cache) #477 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/47708:41
*** aday has joined #buildstream09:01
jennisI seem to have a test which is sometimes failing09:05
jennisbasically the test is pushing an artifact which is greater than the filesystem which mounts the test itself09:05
*** jonathanmaw has quit IRC09:06
jennisEventually I try to terminate the push, and catch an exception for a BrokenPipeError here09:06
jennisNow, the tests fail when we don't catch a BrokenPipeError09:07
jennisMeaning that sometimes, bailing out of the tar stream will raise this error and sometimes it won't...?09:08
jennisfilesystem which mounts the cache*09:08
gitlab-br-botbuildstream: issue #414 ("Project doesn't build when using bst 1.1.3 (it builds fine with 1.1.2)") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/41409:18
*** jonathanmaw has joined #buildstream09:22
gitlab-br-botbuildstream: issue #414 ("Project doesn't build when using bst 1.1.3 (it builds fine with 1.1.2)") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/41409:49
*** bochecha_ has joined #buildstream09:50
*** aday has quit IRC09:53
*** aday has joined #buildstream10:07
gitlab-br-botbuildstream: merge request (issue-21_Caching_build_trees->master: WIP: Issue 21 caching build trees) #372 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/37210:25
gitlab-br-botbuildstream: merge request (juerg/googlecas->master: Remote Execution CAS-based artifact cache) #337 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/33710:44
gitlab-br-botbuildstream: merge request (correcting_typo->master: Correcting a typo in safe_remove's comment) #472 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/47211:08
gitlab-br-botbuildstream: merge request (correcting_typo->master: Correcting a typo in safe_remove's comment) #472 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/47211:09
*** cs_shadow has joined #buildstream11:13
*** finn has quit IRC11:24
gitlab-br-botbuildstream: merge request (jennis/alternative_remote_expiry->master: Expire artifacts in the remote artifact cache) #477 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/47711:46
jennis!447: expiring artifacts in the remote cache - uses the available disk-space as opposed to determining the exact size of the ostree cache, is now ready for a review if anyone could spare sometime11:50
jennisjuergbi, the above MR (!477) doesn't implement a quota, I remember last week we said we'd discuss this. Please let me know if you feel like a quota is necessary for the new implementation11:52
*** finn has joined #buildstream12:00
juergbijennis: ok. I expect it to suffice at least for the initial version12:04
*** aday has quit IRC12:32
*** bochecha_ has quit IRC12:32
*** bochecha_ has joined #buildstream12:33
gitlab-br-botbuildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/34712:34
gitlab-br-botbuildstream: merge request (328-support-for-downloading-sources-from-mirrors->master: WIP: Resolve "Support for downloading sources from mirrors") #404 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/40412:36
*** bochecha_ has quit IRC12:37
*** bochecha_ has joined #buildstream12:42
gitlab-br-botbuildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/34712:56
gitlab-br-botbuildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/34712:57
gitlab-br-botbuildstream: merge request (jennis/alternative_remote_expiry->master: Expire artifacts in the remote artifact cache) #477 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/47712:58
gitlab-br-botbuildstream: merge request (awacheux/artifact-type-error->master: Fix artifact initialization result tuple) #469 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/46912:58
*** finn has quit IRC13:02
*** finn has joined #buildstream13:07
*** xjuan has joined #buildstream13:08
gitlab-br-botbuildstream: merge request (issue-21_Caching_build_trees->master: WIP: Issue 21 caching build trees) #372 changed state ("closed"): https://gitlab.com/BuildStream/buildstream/merge_requests/37213:10
toscalixNexus: closing MR#372 means you are working on issue #311 https://gitlab.com/BuildStream/buildstream/issues/311 ?13:17
toscalixshould it #311 moved to "Doing" status?13:17
toscalixshould be moved13:17
Nexustoscalix: no, it's been replaced with !47413:19
toscalixNexus: thanks13:20
toscalixwill make a note13:20
*** aday has joined #buildstream13:33
*** aday has quit IRC13:36
*** aday has joined #buildstream13:37
tlaterNews flash: The local cache expiry branch is finally ready for review now :)13:41
*** Prince781 has joined #buildstream13:42
laurencetlater, good news...who is getting the honours?14:12
tlaterlaurence: jennis said he'll do an initial review - probably not a bad idea, the branch is old enough that I doubt it will come out too nicely14:13
jennisI'll do an initial review today :)14:14
*** aday has quit IRC14:14
*** aday has joined #buildstream14:20
*** toscalix has quit IRC14:24
*** toscalix has joined #buildstream14:24
gitlab-br-botbuildstream: merge request (awacheux/artifact-type-error->master: _artifactcache/ostreecache.py: Fix artifact initialization result tuple) #469 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/46914:42
*** Prince781 has quit IRC14:53
gitlab-br-botbuildstream: issue #415 ("Feature request: sharing built artifacts between bst instances") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/41514:56
*** Prince781 has joined #buildstream14:59
*** ernestask has quit IRC15:04
*** finn has quit IRC15:29
*** finn has joined #buildstream15:30
*** bochecha_ has quit IRC15:33
*** bochecha_ has joined #buildstream15:34
noisecellif one file overlaps another (as warning: "Staged files overwrite existing files in staging area:\n") 1) will this file overwrite the previous one 2) the element which does this overlaping will continue adding files to that staging area?15:38
*** tiago has quit IRC15:42
noisecellfor reference: I am trying to build https://gitlab.com/baserock/definitions/blob/master/elements/systems/minimal-system.bst and the logs which I based my question on are: https://paste.baserock.org/yanikobaqu15:48
*** tiago has joined #buildstream15:52
*** jennis has quit IRC16:02
juergbinoisecell: 1) yes, the file from the later staged dependency will replace the file from the previously staged dependency16:02
juergbi2) yes, as long as overlaps are not configured as fatal, it won't stop16:02
juergbi(and if they are configured as fatal, the build will be aborted)16:03
noisecelljuergbi, cheers, then Im looking at something else here. As you can see in https://paste.baserock.org/yanikobaqu init and shutdown doesn't appear to be in /sbin, I did check into the sandbox and init is under /usr/bin but pointing to busybox and shutdown is not in the sandbox so something made these 2 disappear or not even been in the staging area :/16:05
juergbinoisecell: is it possible that the build commands expect a filesystem hierarchy where /bin and /sbin are symlinked to /usr/bin?16:06
juergbi(as is common for systemd-based systems nowadays)16:06
juergbior if you're expecting non-busybox init, do you have the corresponding dependency (systemd?) installed?16:07
juergbiI mean, is that listed as dependency?16:07
noisecelljuergbi, so far: https://gitlab.com/baserock/definitions/blob/master/elements/initramfs/initramfs-scripts.bst is called: https://gitlab.com/baserock/definitions/blob/master/elements/initramfs/initramfs.bst which is called: https://gitlab.com/baserock/definitions/blob/master/elements/initramfs/initramfs-gz.bst16:08
noisecellso if  initramfs-scripts.bst import the files in https://gitlab.com/baserock/definitions/tree/master/files/initramfs-scripts -- I would expect these not to be moved elsewhere16:09
*** Prince781 has quit IRC16:10
juergbimaybe an issue with split domains16:15
juergbinoisecell: initramfs.bst only includes the runtime domain16:16
juergbiwhile sbindir is included in the runtime domain by default, the default sbindir is /usr/sbin, not /sbin16:16
juergbinot sure whether that's the issue but it might be16:17
juergbiyou could either change/extend the split rules or use a unified /usr hierarchy16:18
noisecelljuergbi, ok, I will play around with it to see if I can fix the issue. Thanks!!16:18
*** wsgalaxy has joined #buildstream16:24
*** Prince781 has joined #buildstream16:26
*** aday has quit IRC16:31
*** aday has joined #buildstream16:32
*** tiago has quit IRC16:33
tlaterI keep running into tests that fail with this: https://gitlab.com/BuildStream/buildstream/-/jobs/7157697616:34
tlaterLooks to me like mkdir -p succeeds but the directory isn't created16:34
tlaterRetrying the job usually solves it, but I wonder what causes it...16:35
*** wsgalaxy has quit IRC16:39
*** aday has quit IRC16:40
*** aday has joined #buildstream16:41
gitlab-br-botbuildstream: merge request (tlater/context-trailing-slash->master: tests/context/context.py: Don't break with trailing slashes) #470 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/47016:46
*** jonathanmaw has quit IRC16:50
juergbitlater: hm, no, it looks to me like there are multiple files that match the dist/buildstream/.coverage.* glob16:55
gitlab-br-botbuildstream: merge request (tlater/context-trailing-slash->master: tests/context/context.py: Don't break with trailing slashes) #470 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/47016:55
tlaterAh16:55
juergbiand the cp command line only works if there is exactly one16:55
juergbiit might be related to the coverage warning above16:55
tlaterAnd it complains about the directory because it's trying to write to a single file :)16:55
juergbiyes16:55
tlaterSo it looks like coverage is broken on my branch16:56
tlaterWell, specifically on debian 916:56
* tlater looks into the docker container16:57
*** dominic has quit IRC17:04
*** toscalix has quit IRC17:09
*** Prince781 has quit IRC17:24
*** Prince781 has joined #buildstream17:25
*** Prince781 has quit IRC17:27
*** Prince781 has joined #buildstream17:28
*** Prince781 has quit IRC17:34
*** Prince781 has joined #buildstream17:34
*** Prince781 has quit IRC17:37
*** Prince781 has joined #buildstream17:38
*** Prince781 has joined #buildstream17:39
*** Prince781 has quit IRC18:01
*** Prince781 has joined #buildstream18:06
*** jsgrant has quit IRC18:09
*** mohan43u has quit IRC18:31
*** mohan43u has joined #buildstream18:34
*** Prince781 has quit IRC19:20
*** Prince781 has joined #buildstream20:04
*** aday has quit IRC20:25
*** aday has joined #buildstream20:25
*** aday has quit IRC20:29
*** aday has joined #buildstream20:31
*** xjuan has quit IRC21:08
*** aday has quit IRC21:11
*** aday_ has joined #buildstream21:12
*** aday_ is now known as aday21:12
*** Prince781 has quit IRC21:17
*** bochecha_ has quit IRC21:48
*** bochecha_ has joined #buildstream21:51
*** aday has quit IRC22:10
*** bochecha_ has quit IRC22:45
*** Prince781 has joined #buildstream23:39

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!