*** Prince781 has joined #buildstream | 01:12 | |
*** Prince781 has quit IRC | 01:52 | |
*** Prince781 has joined #buildstream | 03:40 | |
*** Prince781 has quit IRC | 06:38 | |
noisecell | jjardon, thank you for that :) | 06:42 |
---|---|---|
*** ernestask has joined #buildstream | 07:06 | |
*** jsgrant has joined #buildstream | 07:08 | |
paulsherwood | juergbi: are you aware of this https://github.com/google/gvisor ? | 07:27 |
juergbi | no, I don't think so, reading | 07:28 |
juergbi | it's interesting but at a first glance I don't see a big benefit compared to BuildStream's current approach and I expect the performance to be lower (and there may be compatibility issues) | 07:33 |
juergbi | paulsherwood: is there a particular aspect that you think would benefit BuildStream or did you just want to make sure we're aware of it? | 07:35 |
paulsherwood | juergbi: i only heard about it today (in the context of the 'no hypervisor required' discussion)... and just wondered if it was worth considering for isolation in buildstream | 07:38 |
paulsherwood | but actually it seems to be x86_64 only in any case | 07:39 |
juergbi | yes | 07:39 |
paulsherwood | so an interesting curiosity, for now | 07:39 |
paulsherwood | but i guess this is the 'google folks are re-writing linux in go' project i heard about a couple of years ago | 07:40 |
juergbi | we can probably improve our sandbox but I don't think we need to completely change the approach there | 07:40 |
paulsherwood | ack | 07:41 |
juergbi | no idea. maybe they will support gVisor on top of Fuchsia | 07:41 |
juergbi | if gVisor supported other host operating systems, it could be interesting for macOS. although, virtualized Linux will likely cover that case as well | 07:42 |
juergbi | (as in VM) | 07:43 |
juergbi | on Windows there is already WSL | 07:43 |
*** toscalix has joined #buildstream | 07:54 | |
*** finn has joined #buildstream | 07:54 | |
*** dominic has joined #buildstream | 08:01 | |
*** jonathanmaw has joined #buildstream | 08:20 | |
paulsherwood | over in #baserock, the move from 1.1.2 to 1.1.3 seems to have broken the build... are there known issues? | 08:31 |
gitlab-br-bot | buildstream: merge request (juerg/googlecas->master: Remote Execution CAS-based artifact cache) #337 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/337 | 08:35 |
juergbi | will look into this now | 08:35 |
juergbi | valentind: fyi, I've applied a couple of tweaks to the googlecas branch | 08:37 |
juergbi | set minimum version for protobuf dependency to fix `__new__() got an unexpected keyword argument 'file'` | 08:37 |
juergbi | and updated documentation to set CN also for client certificate | 08:38 |
juergbi | if you have additional feedback, please let me know | 08:38 |
gitlab-br-bot | buildstream: merge request (jennis/alternative_remote_expiry->master: Expire artifacts in the remote artifact cache) #477 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/477 | 08:41 |
*** aday has joined #buildstream | 09:01 | |
jennis | I seem to have a test which is sometimes failing | 09:05 |
jennis | basically the test is pushing an artifact which is greater than the filesystem which mounts the test itself | 09:05 |
*** jonathanmaw has quit IRC | 09:06 | |
jennis | Eventually I try to terminate the push, and catch an exception for a BrokenPipeError here | 09:06 |
jennis | Now, the tests fail when we don't catch a BrokenPipeError | 09:07 |
jennis | Meaning that sometimes, bailing out of the tar stream will raise this error and sometimes it won't...? | 09:08 |
jennis | filesystem which mounts the cache* | 09:08 |
gitlab-br-bot | buildstream: issue #414 ("Project doesn't build when using bst 1.1.3 (it builds fine with 1.1.2)") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/414 | 09:18 |
*** jonathanmaw has joined #buildstream | 09:22 | |
gitlab-br-bot | buildstream: issue #414 ("Project doesn't build when using bst 1.1.3 (it builds fine with 1.1.2)") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/414 | 09:49 |
*** bochecha_ has joined #buildstream | 09:50 | |
*** aday has quit IRC | 09:53 | |
*** aday has joined #buildstream | 10:07 | |
gitlab-br-bot | buildstream: merge request (issue-21_Caching_build_trees->master: WIP: Issue 21 caching build trees) #372 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/372 | 10:25 |
gitlab-br-bot | buildstream: merge request (juerg/googlecas->master: Remote Execution CAS-based artifact cache) #337 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/337 | 10:44 |
gitlab-br-bot | buildstream: merge request (correcting_typo->master: Correcting a typo in safe_remove's comment) #472 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/472 | 11:08 |
gitlab-br-bot | buildstream: merge request (correcting_typo->master: Correcting a typo in safe_remove's comment) #472 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/472 | 11:09 |
*** cs_shadow has joined #buildstream | 11:13 | |
*** finn has quit IRC | 11:24 | |
gitlab-br-bot | buildstream: merge request (jennis/alternative_remote_expiry->master: Expire artifacts in the remote artifact cache) #477 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/477 | 11:46 |
jennis | !447: expiring artifacts in the remote cache - uses the available disk-space as opposed to determining the exact size of the ostree cache, is now ready for a review if anyone could spare sometime | 11:50 |
jennis | juergbi, the above MR (!477) doesn't implement a quota, I remember last week we said we'd discuss this. Please let me know if you feel like a quota is necessary for the new implementation | 11:52 |
*** finn has joined #buildstream | 12:00 | |
juergbi | jennis: ok. I expect it to suffice at least for the initial version | 12:04 |
*** aday has quit IRC | 12:32 | |
*** bochecha_ has quit IRC | 12:32 | |
*** bochecha_ has joined #buildstream | 12:33 | |
gitlab-br-bot | buildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/347 | 12:34 |
gitlab-br-bot | buildstream: merge request (328-support-for-downloading-sources-from-mirrors->master: WIP: Resolve "Support for downloading sources from mirrors") #404 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/404 | 12:36 |
*** bochecha_ has quit IRC | 12:37 | |
*** bochecha_ has joined #buildstream | 12:42 | |
gitlab-br-bot | buildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/347 | 12:56 |
gitlab-br-bot | buildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/347 | 12:57 |
gitlab-br-bot | buildstream: merge request (jennis/alternative_remote_expiry->master: Expire artifacts in the remote artifact cache) #477 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/477 | 12:58 |
gitlab-br-bot | buildstream: merge request (awacheux/artifact-type-error->master: Fix artifact initialization result tuple) #469 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/469 | 12:58 |
*** finn has quit IRC | 13:02 | |
*** finn has joined #buildstream | 13:07 | |
*** xjuan has joined #buildstream | 13:08 | |
gitlab-br-bot | buildstream: merge request (issue-21_Caching_build_trees->master: WIP: Issue 21 caching build trees) #372 changed state ("closed"): https://gitlab.com/BuildStream/buildstream/merge_requests/372 | 13:10 |
toscalix | Nexus: closing MR#372 means you are working on issue #311 https://gitlab.com/BuildStream/buildstream/issues/311 ? | 13:17 |
toscalix | should it #311 moved to "Doing" status? | 13:17 |
toscalix | should be moved | 13:17 |
Nexus | toscalix: no, it's been replaced with !474 | 13:19 |
toscalix | Nexus: thanks | 13:20 |
toscalix | will make a note | 13:20 |
*** aday has joined #buildstream | 13:33 | |
*** aday has quit IRC | 13:36 | |
*** aday has joined #buildstream | 13:37 | |
tlater | News flash: The local cache expiry branch is finally ready for review now :) | 13:41 |
*** Prince781 has joined #buildstream | 13:42 | |
laurence | tlater, good news...who is getting the honours? | 14:12 |
tlater | laurence: jennis said he'll do an initial review - probably not a bad idea, the branch is old enough that I doubt it will come out too nicely | 14:13 |
jennis | I'll do an initial review today :) | 14:14 |
*** aday has quit IRC | 14:14 | |
*** aday has joined #buildstream | 14:20 | |
*** toscalix has quit IRC | 14:24 | |
*** toscalix has joined #buildstream | 14:24 | |
gitlab-br-bot | buildstream: merge request (awacheux/artifact-type-error->master: _artifactcache/ostreecache.py: Fix artifact initialization result tuple) #469 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/469 | 14:42 |
*** Prince781 has quit IRC | 14:53 | |
gitlab-br-bot | buildstream: issue #415 ("Feature request: sharing built artifacts between bst instances") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/415 | 14:56 |
*** Prince781 has joined #buildstream | 14:59 | |
*** ernestask has quit IRC | 15:04 | |
*** finn has quit IRC | 15:29 | |
*** finn has joined #buildstream | 15:30 | |
*** bochecha_ has quit IRC | 15:33 | |
*** bochecha_ has joined #buildstream | 15:34 | |
noisecell | if one file overlaps another (as warning: "Staged files overwrite existing files in staging area:\n") 1) will this file overwrite the previous one 2) the element which does this overlaping will continue adding files to that staging area? | 15:38 |
*** tiago has quit IRC | 15:42 | |
noisecell | for reference: I am trying to build https://gitlab.com/baserock/definitions/blob/master/elements/systems/minimal-system.bst and the logs which I based my question on are: https://paste.baserock.org/yanikobaqu | 15:48 |
*** tiago has joined #buildstream | 15:52 | |
*** jennis has quit IRC | 16:02 | |
juergbi | noisecell: 1) yes, the file from the later staged dependency will replace the file from the previously staged dependency | 16:02 |
juergbi | 2) yes, as long as overlaps are not configured as fatal, it won't stop | 16:02 |
juergbi | (and if they are configured as fatal, the build will be aborted) | 16:03 |
noisecell | juergbi, cheers, then Im looking at something else here. As you can see in https://paste.baserock.org/yanikobaqu init and shutdown doesn't appear to be in /sbin, I did check into the sandbox and init is under /usr/bin but pointing to busybox and shutdown is not in the sandbox so something made these 2 disappear or not even been in the staging area :/ | 16:05 |
juergbi | noisecell: is it possible that the build commands expect a filesystem hierarchy where /bin and /sbin are symlinked to /usr/bin? | 16:06 |
juergbi | (as is common for systemd-based systems nowadays) | 16:06 |
juergbi | or if you're expecting non-busybox init, do you have the corresponding dependency (systemd?) installed? | 16:07 |
juergbi | I mean, is that listed as dependency? | 16:07 |
noisecell | juergbi, so far: https://gitlab.com/baserock/definitions/blob/master/elements/initramfs/initramfs-scripts.bst is called: https://gitlab.com/baserock/definitions/blob/master/elements/initramfs/initramfs.bst which is called: https://gitlab.com/baserock/definitions/blob/master/elements/initramfs/initramfs-gz.bst | 16:08 |
noisecell | so if initramfs-scripts.bst import the files in https://gitlab.com/baserock/definitions/tree/master/files/initramfs-scripts -- I would expect these not to be moved elsewhere | 16:09 |
*** Prince781 has quit IRC | 16:10 | |
juergbi | maybe an issue with split domains | 16:15 |
juergbi | noisecell: initramfs.bst only includes the runtime domain | 16:16 |
juergbi | while sbindir is included in the runtime domain by default, the default sbindir is /usr/sbin, not /sbin | 16:16 |
juergbi | not sure whether that's the issue but it might be | 16:17 |
juergbi | you could either change/extend the split rules or use a unified /usr hierarchy | 16:18 |
noisecell | juergbi, ok, I will play around with it to see if I can fix the issue. Thanks!! | 16:18 |
*** wsgalaxy has joined #buildstream | 16:24 | |
*** Prince781 has joined #buildstream | 16:26 | |
*** aday has quit IRC | 16:31 | |
*** aday has joined #buildstream | 16:32 | |
*** tiago has quit IRC | 16:33 | |
tlater | I keep running into tests that fail with this: https://gitlab.com/BuildStream/buildstream/-/jobs/71576976 | 16:34 |
tlater | Looks to me like mkdir -p succeeds but the directory isn't created | 16:34 |
tlater | Retrying the job usually solves it, but I wonder what causes it... | 16:35 |
*** wsgalaxy has quit IRC | 16:39 | |
*** aday has quit IRC | 16:40 | |
*** aday has joined #buildstream | 16:41 | |
gitlab-br-bot | buildstream: merge request (tlater/context-trailing-slash->master: tests/context/context.py: Don't break with trailing slashes) #470 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/470 | 16:46 |
*** jonathanmaw has quit IRC | 16:50 | |
juergbi | tlater: hm, no, it looks to me like there are multiple files that match the dist/buildstream/.coverage.* glob | 16:55 |
gitlab-br-bot | buildstream: merge request (tlater/context-trailing-slash->master: tests/context/context.py: Don't break with trailing slashes) #470 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/470 | 16:55 |
tlater | Ah | 16:55 |
juergbi | and the cp command line only works if there is exactly one | 16:55 |
juergbi | it might be related to the coverage warning above | 16:55 |
tlater | And it complains about the directory because it's trying to write to a single file :) | 16:55 |
juergbi | yes | 16:55 |
tlater | So it looks like coverage is broken on my branch | 16:56 |
tlater | Well, specifically on debian 9 | 16:56 |
* tlater looks into the docker container | 16:57 | |
*** dominic has quit IRC | 17:04 | |
*** toscalix has quit IRC | 17:09 | |
*** Prince781 has quit IRC | 17:24 | |
*** Prince781 has joined #buildstream | 17:25 | |
*** Prince781 has quit IRC | 17:27 | |
*** Prince781 has joined #buildstream | 17:28 | |
*** Prince781 has quit IRC | 17:34 | |
*** Prince781 has joined #buildstream | 17:34 | |
*** Prince781 has quit IRC | 17:37 | |
*** Prince781 has joined #buildstream | 17:38 | |
*** Prince781 has joined #buildstream | 17:39 | |
*** Prince781 has quit IRC | 18:01 | |
*** Prince781 has joined #buildstream | 18:06 | |
*** jsgrant has quit IRC | 18:09 | |
*** mohan43u has quit IRC | 18:31 | |
*** mohan43u has joined #buildstream | 18:34 | |
*** Prince781 has quit IRC | 19:20 | |
*** Prince781 has joined #buildstream | 20:04 | |
*** aday has quit IRC | 20:25 | |
*** aday has joined #buildstream | 20:25 | |
*** aday has quit IRC | 20:29 | |
*** aday has joined #buildstream | 20:31 | |
*** xjuan has quit IRC | 21:08 | |
*** aday has quit IRC | 21:11 | |
*** aday_ has joined #buildstream | 21:12 | |
*** aday_ is now known as aday | 21:12 | |
*** Prince781 has quit IRC | 21:17 | |
*** bochecha_ has quit IRC | 21:48 | |
*** bochecha_ has joined #buildstream | 21:51 | |
*** aday has quit IRC | 22:10 | |
*** bochecha_ has quit IRC | 22:45 | |
*** Prince781 has joined #buildstream | 23:39 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!