*** mohan43u has quit IRC | 00:30 | |
*** phildawson-ct has quit IRC | 00:30 | |
*** rdale has quit IRC | 00:30 | |
*** tpollard has quit IRC | 00:30 | |
*** phildawson has quit IRC | 00:30 | |
*** robjh has quit IRC | 00:30 | |
*** valentind has quit IRC | 00:30 | |
*** douglaswinship has quit IRC | 00:30 | |
*** coldtom has quit IRC | 00:30 | |
*** benbrown has quit IRC | 00:30 | |
*** phildawson-ct has joined #buildstream | 00:31 | |
*** rdale has joined #buildstream | 00:31 | |
*** tpollard has joined #buildstream | 00:31 | |
*** phildawson has joined #buildstream | 00:31 | |
*** robjh has joined #buildstream | 00:31 | |
*** valentind has joined #buildstream | 00:31 | |
*** douglaswinship has joined #buildstream | 00:31 | |
*** coldtom has joined #buildstream | 00:31 | |
*** benbrown has joined #buildstream | 00:31 | |
*** mohan43u has joined #buildstream | 00:31 | |
*** narispo has joined #buildstream | 00:35 | |
*** coldtom has quit IRC | 00:51 | |
*** coldtom has joined #buildstream | 00:52 | |
*** tristan has joined #buildstream | 03:38 | |
*** coldtom has quit IRC | 03:51 | |
*** phildawson-ct has quit IRC | 03:51 | |
*** rdale has quit IRC | 03:51 | |
*** tpollard has quit IRC | 03:51 | |
*** phildawson has quit IRC | 03:51 | |
*** robjh has quit IRC | 03:51 | |
*** valentind has quit IRC | 03:51 | |
*** douglaswinship has quit IRC | 03:51 | |
*** benbrown has quit IRC | 03:51 | |
*** coldtom has joined #buildstream | 03:57 | |
*** phildawson-ct has joined #buildstream | 03:57 | |
*** rdale has joined #buildstream | 03:57 | |
*** tpollard has joined #buildstream | 03:57 | |
*** phildawson has joined #buildstream | 03:57 | |
*** robjh has joined #buildstream | 03:57 | |
*** valentind has joined #buildstream | 03:57 | |
*** douglaswinship has joined #buildstream | 03:57 | |
*** benbrown has joined #buildstream | 03:57 | |
*** coldtom has quit IRC | 04:03 | |
*** phildawson-ct has quit IRC | 04:03 | |
*** rdale has quit IRC | 04:03 | |
*** tpollard has quit IRC | 04:03 | |
*** phildawson has quit IRC | 04:03 | |
*** robjh has quit IRC | 04:03 | |
*** valentind has quit IRC | 04:03 | |
*** douglaswinship has quit IRC | 04:03 | |
*** benbrown has quit IRC | 04:03 | |
*** coldtom has joined #buildstream | 04:07 | |
*** phildawson-ct has joined #buildstream | 04:07 | |
*** rdale has joined #buildstream | 04:07 | |
*** tpollard has joined #buildstream | 04:07 | |
*** phildawson has joined #buildstream | 04:07 | |
*** robjh has joined #buildstream | 04:07 | |
*** valentind has joined #buildstream | 04:07 | |
*** douglaswinship has joined #buildstream | 04:07 | |
*** benbrown has joined #buildstream | 04:07 | |
*** coldtom has quit IRC | 04:10 | |
*** phildawson-ct has quit IRC | 04:10 | |
*** rdale has quit IRC | 04:10 | |
*** tpollard has quit IRC | 04:10 | |
*** phildawson has quit IRC | 04:10 | |
*** robjh has quit IRC | 04:10 | |
*** valentind has quit IRC | 04:10 | |
*** douglaswinship has quit IRC | 04:10 | |
*** benbrown has quit IRC | 04:10 | |
*** coldtom has joined #buildstream | 04:11 | |
*** phildawson-ct has joined #buildstream | 04:11 | |
*** rdale has joined #buildstream | 04:11 | |
*** tpollard has joined #buildstream | 04:11 | |
*** phildawson has joined #buildstream | 04:11 | |
*** robjh has joined #buildstream | 04:11 | |
*** valentind has joined #buildstream | 04:11 | |
*** douglaswinship has joined #buildstream | 04:11 | |
*** benbrown has joined #buildstream | 04:11 | |
*** coldtom has quit IRC | 04:16 | |
*** phildawson-ct has quit IRC | 04:16 | |
*** rdale has quit IRC | 04:16 | |
*** tpollard has quit IRC | 04:16 | |
*** phildawson has quit IRC | 04:16 | |
*** robjh has quit IRC | 04:16 | |
*** valentind has quit IRC | 04:16 | |
*** douglaswinship has quit IRC | 04:16 | |
*** benbrown has quit IRC | 04:16 | |
*** coldtom has joined #buildstream | 04:19 | |
*** phildawson-ct has joined #buildstream | 04:19 | |
*** rdale has joined #buildstream | 04:19 | |
*** tpollard has joined #buildstream | 04:19 | |
*** phildawson has joined #buildstream | 04:19 | |
*** robjh has joined #buildstream | 04:19 | |
*** valentind has joined #buildstream | 04:19 | |
*** douglaswinship has joined #buildstream | 04:19 | |
*** benbrown has joined #buildstream | 04:19 | |
*** coldtom has quit IRC | 04:23 | |
*** phildawson-ct has quit IRC | 04:23 | |
*** rdale has quit IRC | 04:23 | |
*** tpollard has quit IRC | 04:23 | |
*** phildawson has quit IRC | 04:23 | |
*** robjh has quit IRC | 04:23 | |
*** valentind has quit IRC | 04:23 | |
*** douglaswinship has quit IRC | 04:23 | |
*** benbrown has quit IRC | 04:23 | |
*** coldtom has joined #buildstream | 04:33 | |
*** phildawson-ct has joined #buildstream | 04:33 | |
*** rdale has joined #buildstream | 04:33 | |
*** tpollard has joined #buildstream | 04:33 | |
*** phildawson has joined #buildstream | 04:33 | |
*** robjh has joined #buildstream | 04:33 | |
*** valentind has joined #buildstream | 04:33 | |
*** douglaswinship has joined #buildstream | 04:33 | |
*** benbrown has joined #buildstream | 04:33 | |
*** coldtom has quit IRC | 04:36 | |
*** phildawson-ct has quit IRC | 04:36 | |
*** rdale has quit IRC | 04:36 | |
*** tpollard has quit IRC | 04:36 | |
*** phildawson has quit IRC | 04:36 | |
*** robjh has quit IRC | 04:36 | |
*** valentind has quit IRC | 04:36 | |
*** douglaswinship has quit IRC | 04:36 | |
*** benbrown has quit IRC | 04:36 | |
*** coldtom has joined #buildstream | 04:52 | |
*** phildawson-ct has joined #buildstream | 04:52 | |
*** rdale has joined #buildstream | 04:52 | |
*** tpollard has joined #buildstream | 04:52 | |
*** phildawson has joined #buildstream | 04:52 | |
*** robjh has joined #buildstream | 04:52 | |
*** valentind has joined #buildstream | 04:52 | |
*** douglaswinship has joined #buildstream | 04:52 | |
*** benbrown has joined #buildstream | 04:52 | |
*** narispo has quit IRC | 04:55 | |
*** coldtom has quit IRC | 04:55 | |
*** phildawson-ct has quit IRC | 04:55 | |
*** rdale has quit IRC | 04:55 | |
*** tpollard has quit IRC | 04:55 | |
*** phildawson has quit IRC | 04:55 | |
*** robjh has quit IRC | 04:55 | |
*** valentind has quit IRC | 04:55 | |
*** douglaswinship has quit IRC | 04:55 | |
*** benbrown has quit IRC | 04:55 | |
*** coldtom has joined #buildstream | 04:56 | |
*** phildawson-ct has joined #buildstream | 04:56 | |
*** rdale has joined #buildstream | 04:56 | |
*** tpollard has joined #buildstream | 04:56 | |
*** phildawson has joined #buildstream | 04:56 | |
*** robjh has joined #buildstream | 04:56 | |
*** valentind has joined #buildstream | 04:56 | |
*** douglaswinship has joined #buildstream | 04:56 | |
*** benbrown has joined #buildstream | 04:56 | |
*** coldtom has quit IRC | 05:00 | |
*** phildawson-ct has quit IRC | 05:00 | |
*** rdale has quit IRC | 05:00 | |
*** tpollard has quit IRC | 05:00 | |
*** phildawson has quit IRC | 05:00 | |
*** robjh has quit IRC | 05:00 | |
*** valentind has quit IRC | 05:00 | |
*** douglaswinship has quit IRC | 05:00 | |
*** benbrown has quit IRC | 05:00 | |
*** coldtom has joined #buildstream | 05:01 | |
*** phildawson-ct has joined #buildstream | 05:01 | |
*** rdale has joined #buildstream | 05:01 | |
*** tpollard has joined #buildstream | 05:01 | |
*** phildawson has joined #buildstream | 05:01 | |
*** robjh has joined #buildstream | 05:01 | |
*** valentind has joined #buildstream | 05:01 | |
*** douglaswinship has joined #buildstream | 05:01 | |
*** benbrown has joined #buildstream | 05:01 | |
*** narispo has joined #buildstream | 05:17 | |
*** mohan43u has quit IRC | 06:20 | |
*** mohan43u has joined #buildstream | 06:23 | |
*** mohan43u has quit IRC | 07:34 | |
*** mohan43u has joined #buildstream | 07:36 | |
*** traveltissues has joined #buildstream | 07:40 | |
gitlab-br-bot | juergbi opened MR !1825 (juerg/reapi-readonly->master: _sandboxreapi.py: Support read-only root) on buildstream https://gitlab.com/BuildStream/buildstream/-/merge_requests/1825 | 09:14 |
---|---|---|
*** bochecha has joined #buildstream | 09:33 | |
*** santi has joined #buildstream | 09:42 | |
*** jonathanmaw has joined #buildstream | 09:47 | |
*** santi has quit IRC | 10:34 | |
*** santi has joined #buildstream | 10:34 | |
*** tme5 has joined #buildstream | 11:28 | |
*** santi has quit IRC | 11:29 | |
*** santi has joined #buildstream | 11:29 | |
*** santi has quit IRC | 13:11 | |
*** santi has joined #buildstream | 13:47 | |
gitlab-br-bot | juergbi merged MR !1822 (willsalmon/directorynote->master: Add doc note about directories) on buildstream https://gitlab.com/BuildStream/buildstream/-/merge_requests/1822 | 14:37 |
*** bochecha has quit IRC | 15:54 | |
*** phildawson_ has joined #buildstream | 16:12 | |
*** tmew5 has joined #buildstream | 16:12 | |
*** CTtpollard has joined #buildstream | 16:12 | |
*** phil has joined #buildstream | 16:12 | |
*** coldtom0 has joined #buildstream | 16:13 | |
*** tme5 has quit IRC | 16:13 | |
*** coldtom has quit IRC | 16:13 | |
*** phildawson-ct has quit IRC | 16:13 | |
*** rdale has quit IRC | 16:13 | |
*** tpollard has quit IRC | 16:13 | |
*** phildawson has quit IRC | 16:13 | |
*** robjh has quit IRC | 16:13 | |
*** valentind has quit IRC | 16:13 | |
*** douglaswinship has quit IRC | 16:13 | |
*** benbrown has quit IRC | 16:13 | |
*** rdale has joined #buildstream | 16:15 | |
*** benbrown has joined #buildstream | 16:15 | |
*** douglaswinship has joined #buildstream | 16:15 | |
*** robjh has joined #buildstream | 16:15 | |
*** valentind has joined #buildstream | 16:17 | |
WSalmon | https://manpages.debian.org/testing/ostree/rofiles-fuse.1.en.html juergbi i presume i cant use this in side the standard bwrap sandbox but can i use it in any of the buildbox sandboxes? | 16:24 |
juergbi | WSalmon: it might not work in either. why do you think there is a difference in this regard? | 16:26 |
WSalmon | i thought brap did not like you runnign fuss inside it, or is that only for pre buildbox brap | 16:26 |
WSalmon | i thought brap did not like you runnig fuss inside it, or is that only for pre buildbox brap | 16:26 |
juergbi | FUSE traditionally requires a setuid root helper binary (fusermount). this is normally not available inside a sandbox (at least not setuid to the real root) | 16:27 |
juergbi | with recent kernels, FUSE is also supported without special host privileges inside a user namespace | 16:27 |
juergbi | however, besides the kernel requirement, it might also require a change in the FUSE filesystem and/or libfuse to handle the mount a bit differently | 16:28 |
WSalmon | so this is a oneday thing not a cant thing? and is all that true for arm atm? | 16:29 |
juergbi | the default/recommended buildbox-run implementation on linux also uses bwrap, so the actual sandboxing mechanism is virtually identical | 16:30 |
juergbi | yes, at least with recent kernels it should theoretically be possible but it may not work out of the box yet | 16:30 |
juergbi | I don't think any of this is ISA-specific, so ARM and x86-64 should behave the same | 16:30 |
*** tmew5 has quit IRC | 16:32 | |
juergbi | WSalmon: another potential issue is that bubblewrap by default doesn't allow sandboxed commands to mount anything. granting this via --cap-add would also be required for the FUSE mount inside the sandbox | 16:33 |
juergbi | that said, it surprises me a bit that you want to work with an OStree repo inside a buildstream element/sandbox | 16:35 |
WSalmon | https://fosdem.org/2020/schedule/event/deployment_to_hardware/ we make the full disk image for the robot in bst. and ostree is a really nice way to OTA update, or any other type of update | 16:37 |
WSalmon | making the ostree element takes 10min | 16:37 |
WSalmon | i would like to commit all the cuda bits first and then glue them together in a later bst element | 16:38 |
WSalmon | https://ostree.readthedocs.io/en/latest/manual/buildsystem-and-repos/ | 16:38 |
WSalmon | i tried making diffrent trees and then adding them up and it ended up taking loads longer than just building them | 16:38 |
WSalmon | https://ostree.readthedocs.io/en/latest/manual/buildsystem-and-repos/ dosnt *"need"* ROFILES-FUSE i wonder if i can do something a bit cleverer as im not running a intergration command as such | 16:40 |
WSalmon | actually given that bst has done the intergration bits its self maybe i can *just* runt the bits that dont need rofiles-fuse | 16:43 |
juergbi | WSalmon: the contents of the OSTree branch at time of rofiles-fuse are originally from BuildStream? | 16:44 |
WSalmon | juergbi, currently i just do a single commit of fullfilesystem element | 16:45 |
juergbi | I'm a bit confused what exactly you want to achieve in that rofiles-fuse-using element | 16:45 |
*** santi has quit IRC | 16:45 | |
abderrahim[m] | WSalmon: I'm interested in improving ostree performance. Please CC me if you find something interesting | 16:45 |
juergbi | as I understand it, the purpose of rofiles-fuse is to manipulate a OSTree branch using regular commands | 16:46 |
WSalmon | currently i do https://gitlab.com/celduin/crash/jetbot-system-bst/-/blob/master/elements/boards/minimal-systemd-nano-ostree-repo.bst the final line takes 10min | 16:46 |
abderrahim[m] | I was thinking a buildstream plugin can somehow cheat to improve performance | 16:46 |
juergbi | yes, at least theoretically, exporting from CAS to OSTree should be doable fairly efficiently | 16:47 |
WSalmon | well, that would be cool but i have not got my head round it | 16:47 |
juergbi | WSalmon: we don't have a OSTree deployment plugin yet, I guess (I haven't been following OSTree recently) | 16:48 |
juergbi | that's the direction I would go for | 16:48 |
WSalmon | i was thinking of making ostree commits of some of the bst elements so that ostree did not have to recompute everything every time. but a more direct approch would be better | 16:48 |
juergbi | drop the ostree part of the script, i.e., first just produce the desired contents as regular buildstream element output | 16:49 |
juergbi | and then create a second element whose only purpose is to export to OSTree | 16:49 |
juergbi | and do the magic in the code of that element plugin | 16:49 |
*** santi has joined #buildstream | 16:49 | |
WSalmon | im trying to rember the new plugin api | 16:50 |
*** narispo has quit IRC | 16:55 | |
*** coldtom0 is now known as coldtom | 16:56 | |
*** narispo has joined #buildstream | 16:56 | |
coldtom | woah, can you just pull a CAS into a build sandbox now?! | 16:56 |
WSalmon | no i dont think you can atm | 16:57 |
coldtom | ah, i'd really like to see that feature | 16:58 |
WSalmon | but it might be less effort to add that to bst than get fuse to work | 16:58 |
WSalmon | juergbi, would we need to add to the casbaseddirectory object a checkout a sub set of cas as cas rather than a dir | 17:05 |
WSalmon | also it might just be a case of making some new casdirs and the odd file, can i make a plugin that dosent even invoke a sand box | 17:07 |
juergbi | WSalmon: I think we rather want to avoid exposing CAS details to plugins, if we can | 17:08 |
juergbi | WSalmon: yes, that's what I was thinking of. an element plugin that exports from CAS to OSTree without invoking any commands, and thus not involving a sandbox | 17:08 |
WSalmon | but all this needs to do is add a file and some dirs to the cas and then say to buildstream thats the base of my artifact? | 17:09 |
juergbi | (you'll still have a sandbox object but you don't have to run anything in it) | 17:09 |
WSalmon | fair | 17:09 |
juergbi | not sure what you mean by adding a file and some dirs | 17:10 |
WSalmon | a ostree repo is a cas + ref file | 17:10 |
WSalmon | as far as i can tell | 17:10 |
juergbi | ok, we have to be careful about terminology now. CAS is ambiguous, unfortunately | 17:11 |
WSalmon | indeed | 17:11 |
juergbi | it's a general concept that is used by OSTree, git and REAPI CAS | 17:11 |
WSalmon | i need to go check quite a few of my assumtions | 17:11 |
juergbi | OSTree is indeed a (generic) CAS + ref file, very similar to git | 17:11 |
juergbi | the CAS part is not fully compatible with REAPI CAS, though | 17:12 |
WSalmon | ah yes you would need to make a cas to live in a cas... | 17:12 |
WSalmon | haha | 17:12 |
WSalmon | tricky but this is a good line of thought, thanks juergbi got to go now | 17:13 |
juergbi | we currently use the same hash algorithm for files (SHA-256), so it's fairly close, except for the different directory structure | 17:13 |
juergbi | (+ OSTree commit objects) | 17:13 |
juergbi | however, hash algorithm in REAPI CAS is theoretically not fixed | 17:13 |
juergbi | ok, have a nice evening | 17:13 |
*** traveltissues has quit IRC | 17:55 | |
*** santi has quit IRC | 18:04 | |
*** jonathanmaw has quit IRC | 18:08 | |
*** benschubert has quit IRC | 20:58 | |
*** narispo has quit IRC | 21:38 | |
*** narispo has joined #buildstream | 21:40 | |
*** narispo has quit IRC | 21:43 | |
*** narispo has joined #buildstream | 21:44 | |
*** narispo has quit IRC | 22:44 | |
*** narispo has joined #buildstream | 22:44 | |
*** juergbi has quit IRC | 22:56 | |
*** narispo has quit IRC | 23:35 | |
*** narispo has joined #buildstream | 23:35 | |
*** narispo has quit IRC | 23:48 | |
*** narispo has joined #buildstream | 23:49 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!